University Research Ethical Approval Process Questioned after AI Study on r/ChangeMyView Operates Without Informed Community Consent

•

What looks to be a serious breach of research integrity protocol has taken place on a platform used by millions, with AI posing as victims of assault and other traumatic situations, all apparently ethically approved by one of the world’s top universities #researchintegrity #AIethics

You can read this post on Reddit describing a study the researchers have said would have been ruined by consent for more details, but I’ll summarise what went on and the implications. reddit.com/r/changemyview/s/VFCMpgkOJy

Researchers from the University of Zurich ran an AI experiment on Reddit’s r/ChangeMyView, without the consent of that community. They set up fake accounts with AI posing on Reddit as victims, counsellors, activists and the like. Real users who were trying to help were unknowingly studied and manipulated over several months.

The study aimed to show how AI generated comments could change the views of other users and did have ethical approval from the University of Zurich, although it appears that aspects of the research were changed after approval was granted.

The community raised a formal complaint as researchers had breached the subreddit rules about AI disclosure. They were also concerned about the research methods used, which could add more anxiety to people in challenging and dangerous situations that may need support and advice.

We are talking difficult situations here. AI posing as victims of sexual assault, responsible for causing death, in opposition to Black Lives Matter. The university have said risks are minimal, the research important, and they will not block publication.

What does this mean for the future of online safe spaces? Will people continue to share their concerns if manipulative and bot driven replies are the norm? Should this study have been conducted without informed consent? Is deception of this form ethical? The subreddit members don’t think so.