This is an online experiment conducted by Beijing Foreign Studies University, Beijing, China. The experiment aims to explore relationship between AI generated summary and users' perception and behaviour.
We do not collect any sensitive or personally identifiable information. All data collected will remain entirely anonymous and will be used solely for academic research purposes.
Consent:
You are invited to participate in a research study examining AI-generated online review summaries. During this experiment, you will be presented with scenarios reflecting everyday online shopping experiences and asked to evaluate them based on your personal perceptions.
Time Commitment: The study will take approximately 5 minutes to complete.
Data & Privacy: We do not collect any sensitive or personally identifiable information. All data collected will remain entirely anonymous and will be used solely for academic research purposes.
Voluntary Participation: Your participation is strictly voluntary. You may withdraw from the study at any time without penalty or loss of benefits.
Consent: By selecting "Yes" below, you acknowledge that you have read the information above and agree to participate in this study.
Yes, I consent. No, I do not consent.
This is the first section of the study.
In this section, you will be shown a product from a major e-commerce platform (Platform A), along with its detailed specifications and customer reviews. Please review the information carefully and evaluate the product based on the details provided.
Once you have finished reviewing the product info, you will proceed to the next section to answer a series of related questions.
Proceed
Please imagine:
One day, you feel that your phone has served you 3 years and it seems kind of outdated now. So you decided to search and buy a new one. You opend a famous e-commerce platform (Platform A) and saw a recommened phone. You clicked the link, and saw the following page.
Please check "Proceed" if you have finished reading all the content we provide in this page. Proceed
Please imagine:
You are interested by the detail page. Thus, you scrolled down the page and saw the following review page. You noticed that the platform has recently provided a function called "Customers Say" , which is a review summary generated by AI.
Please check "Proceed" if you have finished reading all the content we provide in this page. Proceed
Please imagine:
You looked closely the summary and found out that it also provided certain keywords. You were interested in how is the quality of the phone. So you clicked the first one and saw as below. Under each keyword the summary provided, it contains multiple sentences extracted from actual user generated reviews, and after each sentence, there is a hyperlink that could direct you to the full original review.
Please check "Proceed" if you have finished reading all the content we provide in this page. Proceed
Please imagine:
You clicked the frist "Read more". The platform redirected you to a single user's review as shown below.
Please check "Proceed" if you have finished reading all the content we provide in this page. Proceed
This section has ended. In the next section, you will need to answer some questions based on the shopping experience and your impression on the product and the review. Please check "Proceed" if you have finished reading all the content we provide in this section. Proceed
Did the AI summary you just read contain a clickable hyperlink to the original reviews? Yes No
I clearly noticed the hyperlink providing the source of the AI's information. Strongly disagree
Strongly agree
The [AI summary] is conveying truthful information about the product. Strongly disagree
Strongly agree
The [AI summary] reflects the actual beliefs of the consumers it evaluated. Strongly disagree
Strongly agree
The [AI summary] presents its information with a genuine intention to be helpful. Strongly disagree
Strongly agree
I believe the [AI summary] provides feedback that reflects authentic consumer feelings. Strongly disagree
Strongly agree
The [AI summary] is providing false information. Strongly disagree
Strongly agree
I feel like the [AI summary] is designed to deceive me. Strongly disagree
Strongly agree
The information provided by the [AI summary] was truthful. Strongly disagree
Strongly agree
I would characterize the [AI summary] as honest. Strongly disagree
Strongly agree
The [AI summary] appeared to be unbiased. Strongly disagree
Strongly agree
The [AI summary] did not unfairly favor the [product] beyond its actual merits. Strongly disagree
Strongly agree
The [AI summary] was influenced by outside factors when providing the evaluation. Strongly disagree
Strongly agree
The [AI summary] was free from bias when evaluating the [product]. Strongly disagree
Strongly agree
The [AI summary] provided a misleading evaluation of the [product]. Strongly disagree
Strongly agree
There is a sense of human contact in the [AI summary]. Strongly disagree
Strongly agree
There is a sense of personalness in the [AI summary]. Strongly disagree
Strongly agree
There is a sense of human warmth in the [AI summary]. Strongly disagree
Strongly agree
There is a sense of human sensitivity in the [AI summary]. Strongly disagree
Strongly agree
The [AI summary] makes me feel like I am interacting with real consumers. Strongly disagree
Strongly agree
To what extent do you think the [AI summary]: The way this [AI summary] was presented was intended to manipulate me. Strongly disagree
Strongly agree
Tried to manipulate me into buying the [product]. Strongly disagree
Strongly agree
Tried to manage my decision to buy the [product]. Strongly disagree
Strongly agree
Used sales tactics in its text. Strongly disagree
Strongly agree
I have some doubts about the [AI summary]. Strongly disagree
Strongly agree
I have some conflicts about the [AI summary]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
I want to deny the [AI summary]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
I am willing to use the [AI summary] as an aid to help with my decision about whether to buy the [product]. Strongly disagree
Strongly agree
I am willing to let the [AI summary] assist me in evaluating the [product]. Strongly disagree
Strongly agree
I am willing to use the [AI summary] as a tool to help me make my final choice regarding the [product]. Strongly disagree
Strongly agree
After reading the AI generated summay, you would: Make a purchase now Refer to more user generated reviews Abandon this product
The [AI summary] is helpful for me to evaluate the [product]. Strongly disagree
Strongly agree
The [AI summary] is helpful in familiarizing me with the [product]. Strongly disagree
Strongly agree
The [AI summary] is helpful for me to understand the performance of the [product]. Strongly disagree
Strongly agree
I have some questions about the [AI summary]. Strongly disagree
Strongly agree
This section has eneded. In the next section, you are required to answer a few questions based on your own real circumstances and habits. Proceed
Even though I may sometimes suffer the consequences of trusting artificial intelligence systems, I still prefer to trust than not to trust them. Strongly disagree
Strongly agree
I feel good about trusting artificial intelligence systems. Strongly disagree
Strongly agree
I believe that I am generally better off when I do not trust artificial intelligence systems than when I trust them. Strongly disagree
Strongly agree
I rarely trust artificial intelligence systems because I cannot handle the uncertainty. Strongly disagree
Strongly agree
I prefer evaluations made by human experts over those made by computer algorithms. Strongly disagree
Strongly agree
I believe algorithms miss important subjective nuances that human reviewers catch. Strongly disagree
Strongly agree
I am skeptical of using artificial intelligence to make subjective product recommendations. Strongly disagree
Strongly agree
Even if an algorithm is highly advanced, I feel more confident relying on human judgment. questions about the [AI summary]. Strongly disagree
Strongly agree
Please select your age group 18 to 24 years old 25 to 34 years old 35 to 44 years old 45 to 54 years old Over 55 years old
Please choose your gender Male Female
Please select your highest education General high school / technical secondary school / technical school / vocational school Traning School Bachelor degree Master degree Doctor degree
Which of the following best describes your online shopping frequency? Everyday Every two or three days Every week Every month