GoKawiilMarques Brownlee urges YouTube creators to reject video A/B testing feature
YouTube plans to let creators publish multiple 'variant' versions of the same video to test which performs better, similar to A/B testing. In a video essay, Marques Brownlee says YouTube engineers he spoke with couldn't answer basic questions about how the feature would work—like whether viewers know they're seeing a variant, or how comments and shared links would function across different versions. Brownlee is publicly asking creators not to use the feature once it ships.
GoKawiil's interpretation of the reporting above, not reported fact.
The concern raised is that A/B testing could fracture the shared viewing experience that Brownlee argues makes YouTube videos a communal cultural moment, since viewers, commenters and people sharing links might no longer be seeing the same content. The author extends this into a broader argument for software makers: chasing optimization metrics through constant variant-testing may be a worse use of time than simply creating and shipping complete work repeatedly. Whether YouTube proceeds despite creator pushback remains to be seen, as the company reportedly plans to ship the feature soon regardless of unresolved questions.
- YouTube is building a feature letting creators A/B test different video variants
- Brownlee says YouTube engineers lack answers on comments, links, and viewer awareness of variants
- Brownlee publicly asks creators to avoid using the feature, arguing it undermines shared viewing experience
Source: blog.jim-nielsen.com — Jim Nielsen, 2026-09-30
Published there as: “Dear Software Makers”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.