AIGS Experiment

This is an online experiment conducted by Beijing Foreign Studies University, Beijing, China. The experiment aims to explore relationship between AI generated summary and users' perception and behaviour.

We do not collect any sensitive or personally identifiable information. All data collected will remain entirely anonymous and will be used solely for academic research purposes.

Consent:

You are invited to participate in a research study examining AI-generated online review summaries. During this experiment, you will be presented with scenarios reflecting everyday online shopping experiences and asked to evaluate them based on your personal perceptions.

Time Commitment: The study will take approximately 5 minutes to complete.

Data & Privacy: We do not collect any sensitive or personally identifiable information. All data collected will remain entirely anonymous and will be used solely for academic research purposes.

Voluntary Participation: Your participation is strictly voluntary. You may withdraw from the study at any time without penalty or loss of benefits.

Consent: By selecting "Yes" below, you acknowledge that you have read the information above and agree to participate in this study.

Yes, I consent.

No, I do not consent.

This is the first section of the study.

In this section, you will be shown a product from a major e-commerce platform (Platform A), along with its detailed specifications and customer reviews. Please review the information carefully and evaluate the product based on the details provided.

Once you have finished reviewing the product info, you will proceed to the next section to answer a series of related questions.

Proceed

Please imagine:

One day, you feel that your phone has served you 3 years and it seems kind of outdated now. So you decided to search and buy a new one. You opend a famous e-commerce platform (Platform A) and saw a recommened phone. You clicked the link, and saw the following page.

Please check "Proceed" if you have finished reading all the content we provide in this page.

Proceed

Please imagine:

You are interested by the detail page. Thus, you scrolled down the page and saw the following review page. You noticed that the platform has recently provided a function called "Customers Say", which is a review summary generated by AI.

Please check "Proceed" if you have finished reading all the content we provide in this page.

Proceed

Please imagine:

You looked closely the summary and found out that it also provided certain keywords. You were interested in how is the quality of the phone. So you clicked the first one and saw as below. Under each keyword the summary provided, it contains multiple sentences extracted from actual user generated reviews, and after each sentence, there is a hyperlink that could direct you to the full original review.

Please check "Proceed" if you have finished reading all the content we provide in this page.

Proceed

Please imagine:

You clicked the frist "Read more". The platform redirected you to a single user's review as shown below.

Please check "Proceed" if you have finished reading all the content we provide in this page.

Proceed

This section has ended. In the next section, you will need to answer some questions based on the shopping experience and your impression on the product and the review. Please check "Proceed" if you have finished reading all the content we provide in this section.

Proceed

Did the AI summary you just read contain a clickable hyperlink to the original reviews?

Yes

I clearly noticed the hyperlink providing the source of the AI's information.

Strongly disagree

Strongly agree

The [AI summary] is conveying truthful information about the product.

Strongly disagree

Strongly agree

The [AI summary] reflects the actual beliefs of the consumers it evaluated.

Strongly disagree

Strongly agree

The [AI summary] presents its information with a genuine intention to be helpful.

Strongly disagree

Strongly agree

I believe the [AI summary] provides feedback that reflects authentic consumer feelings.

Strongly disagree

Strongly agree

The [AI summary] is providing false information.

Strongly disagree

Strongly agree

I feel like the [AI summary] is designed to deceive me.

Strongly disagree

Strongly agree

The information provided by the [AI summary] was truthful.

Strongly disagree

Strongly agree

I would characterize the [AI summary] as honest.

Strongly disagree

Strongly agree

The [AI summary] appeared to be unbiased.

Strongly disagree

Strongly agree

The [AI summary] did not unfairly favor the [product] beyond its actual merits.

Strongly disagree

Strongly agree

The [AI summary] was influenced by outside factors when providing the evaluation.

Strongly disagree

Strongly agree

The [AI summary] was free from bias when evaluating the [product].

Strongly disagree

Strongly agree

The [AI summary] provided a misleading evaluation of the [product].

Strongly disagree

Strongly agree

There is a sense of human contact in the [AI summary].

Strongly disagree

Strongly agree

There is a sense of personalness in the [AI summary].

Strongly disagree

Strongly agree

There is a sense of human warmth in the [AI summary].

Strongly disagree

Strongly agree

There is a sense of human sensitivity in the [AI summary].

Strongly disagree

Strongly agree

The [AI summary] makes me feel like I am interacting with real consumers.

Strongly disagree

Strongly agree

To what extent do you think the [AI summary]:

The way this [AI summary] was presented was intended to manipulate me.

Strongly disagree

Strongly agree

Tried to manipulate me into buying the [product].

Strongly disagree

Strongly agree

Tried to manage my decision to buy the [product].

Strongly disagree

Strongly agree

Used sales tactics in its text.

Strongly disagree

Strongly agree

I have some doubts about the [AI summary].

Strongly disagree

Strongly agree

I have some conflicts about the [AI summary].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

I want to deny the [AI summary].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

I am willing to use the [AI summary] as an aid to help with my decision about whether to buy the [product].

Strongly disagree

Strongly agree

I am willing to let the [AI summary] assist me in evaluating the [product].

Strongly disagree

Strongly agree

I am willing to use the [AI summary] as a tool to help me make my final choice regarding the [product].

Strongly disagree

Strongly agree

After reading the AI generated summay, you would:

Make a purchase now

Refer to more user generated reviews

Abandon this product

The [AI summary] is helpful for me to evaluate the [product].

Strongly disagree

Strongly agree

The [AI summary] is helpful in familiarizing me with the [product].

Strongly disagree

Strongly agree

The [AI summary] is helpful for me to understand the performance of the [product].

Strongly disagree

Strongly agree

I have some questions about the [AI summary].

Strongly disagree

Strongly agree

This section has eneded. In the next section, you are required to answer a few questions based on your own real circumstances and habits.

Proceed

Even though I may sometimes suffer the consequences of trusting artificial intelligence systems, I still prefer to trust than not to trust them.

Strongly disagree

Strongly agree

I feel good about trusting artificial intelligence systems.

Strongly disagree

Strongly agree

I believe that I am generally better off when I do not trust artificial intelligence systems than when I trust them.

Strongly disagree

Strongly agree

I rarely trust artificial intelligence systems because I cannot handle the uncertainty.

Strongly disagree

Strongly agree

I prefer evaluations made by human experts over those made by computer algorithms.

Strongly disagree

Strongly agree

I believe algorithms miss important subjective nuances that human reviewers catch.

Strongly disagree

Strongly agree

I am skeptical of using artificial intelligence to make subjective product recommendations.

Strongly disagree

Strongly agree

Even if an algorithm is highly advanced, I feel more confident relying on human judgment. questions about the [AI summary].

Strongly disagree

Strongly agree

Please select your age group

18 to 24 years old

25 to 34 years old

35 to 44 years old

45 to 54 years old

Over 55 years old

Please choose your gender

Male

Female

Please select your highest education

General high school / technical secondary school / technical school / vocational school

Traning School

Bachelor degree

Master degree

Doctor degree

Which of the following best describes your online shopping frequency?

Everyday

Every two or three days

Every week

Every month