TikTok’s AI tool accidentally let you put Hitler’s words in a paid actor’s mouth


TikTok mistakenly posted a link to an internal version of its new AI digital avatar tool without guardrails, letting users create videos that say just about anything. The hiccup was first spotted by CNN and allowed the outlet to generate videos containing quotes from Hitler and a message telling people to drink bleach, among other phrases. TikTok has since taken this version of the tool down, while the version TikTok intended to launch remains available.
Launched earlier this week, TikTok’s Symphony Digital Avatars let businesses generate ads using the likeness of paid actors. It also uses AI-powered dubbing that lets advertisers enter a script to make the avatars say what they want within TikTok’s guidelines. Even though only users with a TikTok Ads Manager account can access this tool, the version CNN found let anyone with a personal account try.
In a statement to The Verge, TikTok spokesperson Laura Perez says TikTok has resolved the “technical error” that “allowed an extremely small number of users to create content using an internal testing version of the tool for a few days.”
When CNN discovered the internal tool, it let the outlet generate videos reciting Osama bin Laden’s “Letter to America,” a white supremacy slogan, and a video telling people to vote on the wrong day. None of the videos CNN produced had a watermark disclosing that the video is AI-generated, which is something the proper version of TikTok’s Symphony Digital Avatars does.
CNN didn’t post the videos it created to TikTok, but Perez notes that if it had, the content “would have been rejected for violating our policies.” Even though TikTok has since taken this version of its tool down, it calls into question whether people will find other ways to abuse the digital avatar creator — and if TikTok is ready for it.
TikTok mistakenly posted a link to an internal version of its new AI digital avatar tool without guardrails, letting users create videos that say just about anything. The hiccup was first spotted by CNN and allowed the outlet to generate videos containing quotes from Hitler and a message telling people…
Recent Posts
- The 5 Best Bread Makers, Tested & Reviewed (2025)
- OM System’s OM-3 camera marries vintage style with a high-tech stacked sensor
- KitchenAid reveals its color of the year for 2025 – and I want to eat it out of a tub with a spoon
- AT&T customers can now see why a business is calling
- Monster Hunter Wilds requirements for PC
Archives
- February 2025
- January 2025
- December 2024
- November 2024
- October 2024
- September 2024
- August 2024
- July 2024
- June 2024
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- September 2018
- October 2017
- December 2011
- August 2010