Skip to content
Tech News
← Back to articles

Authors face backlash for participation in 2022 Google AI study

read original more articles
Why This Matters

The participation of professional writers in Google's 2022 AI writing study has sparked controversy, highlighting ongoing debates about AI's role in creative industries and ethical considerations. This incident underscores the importance of transparency and consent in AI research, especially when involving artists and content creators. As AI continues to evolve, understanding its impact on creative professions remains crucial for both industry stakeholders and consumers.

Key Takeaways

In the spring of 2022, Google began reaching out to a series of writers, including award-winning science-fiction authors and New York Times bestsellers, for feedback on an experimental writing tool. Four years later, their participation has corners of the literary world up in arms.

Google researchers knew at the time that they were approaching a breakthrough point with large language models (LLMs). DeepMind, the company's AI division, was internally testing a natural language generation model called LaMDA which had demonstrated emergent writing capabilities. That model would eventually form the basis for Google Gemini. An internal study was launched to determine whether AI could serve as a brainstorming assistant, researcher or writing collaborator for professional writers.

DeepMind was among other things the incubation site for Magenta, an arts-focused research project for open-source machine learning tools, mostly known for building digital music plugins for Ableton Live. Its focus on the humanities made Magenta a natural home for the study, which was dubbed the Wordcraft Writers Workshop.

Thirteen writers were recruited to the so-called workshop, put under strict nondisclosure agreements and told they'd be given access to a "magic text editor" called Wordcraft, which was actually a writing-centric interface for LaMDA. One of the participating authors Engadget spoke with described the program as resembling Microsoft Word with a chatbot on the side. Each participant was given eight weeks to write a short story, using the LLM for any purpose and leveraging its outputs as much or as little as they pleased. At least one author ended up using no AI-generated text whatsoever. The resulting stories were published on Magenta's website alongside a white paper from the researchers.

In the time between the white paper's publication and now, public sentiment on AI — especially within creative professions — has shifted dramatically. Which is why, when Lily Lachance came across the Wordcraft website earlier this month, allegedly while browsing Codex, an exclusive online forum for professional speculative fiction authors, she was shocked.

Lachance is an author and self-described "anti-gen-AI absolutist," and on August 6, she posted a link to the Wordcraft study on her Bluesky profile. "This just in," the since-deleted post about a four-year-old study began, "13 professional writers teamed up with Google's AI slop engine (WordCraft) to write a story each, helping legitimize the plagiarism machine. Never going to read anything by them again. I hope the money was worth it, you bunch of clowns." (Participants in the Wordcraft Writers Workshop declined to tell Engadget how much they were compensated for the study; Google has not responded to a request for comment.)

The reactions were immediate, and Lachance's post quickly made the rounds among Bluesky's bookish users. Many bemoaned the participation of beloved authors in the Wordcraft study, while others threatened to boycott the works of all 13. "I'll even name and shame," one user whose account is followed by a number of prominent genre writers posted, alongside a list of participants whom they had labeled "The 'authors' who have betrayed all Creatives." The list format proved popular, and a number of other users also shared the names along with their own various decrials and epithets.

Much of the ire directed toward participants in the Wordcraft study stems from the practice of tech companies training LLMs, often without authors' permission, on vast reams of copyrighted texts. The particular perversion of this arrangement — the hoovering up of humanity's rich, artistic legacy in order to create a product which threatens to impoverish and replace working artists — has led many to publicly denounce the technology, or at least its worst likely outcomes.

Several hours after the initial post by Lachance, authors who had participated in the Wordcraft Writers Workshop began to issue statements addressing the controversy. Eugenia Triantafyllou, a Shirley Jackson Award-winning speculative fiction author from Greece, posted, "In 2022, before Chatgpt and everything that came next, I participated in this study. It was framed as a [sic] research on a new tool that I could try and offer my opinion on. I didn't know that it was trained on copyrighted material."

Some of those now being labeled "The Shameful 13" may not even be aware their reputations are under fire, while others may not care. Several of the authors, most notably science-fiction darling Ken Liu and bestseller Robin Sloan, appear to be infrequent users of social media. The former does not manage his own accounts; the latter publishes updates about his experiences with AI technology on his personal blog, though it's unclear how much of a role it may or may not play in his published work.

... continue reading