Generative artificial intelligence is reshaping digital advertising, but recent circulation of videos involving racist AI-generated advertisements are raising questions about how online platforms detect and moderate harmful content before it reaches viewers.
A recently circulated AI-generated video advertisement on YouTube as a promotional video for a self-improvement app called RiseGuide, has drawn some attention for containing racist imagery, mockery of accents and stereotypes, becoming part of a broader debate over the growing presence of AI-created harmful promotional content online.
While the origins of individual AI-generated ads are not always publicly identifiable, experts say advances in text-to-video and image-generation tools have made it easier to produce realistic marketing materials at low cost and in a short amount of time.
READ: Elon Musk to appeal after jury rejects OpenAI lawsuit for being too late with claims (May 19, 2026)
Such incidents showcase that generative AI systems can reproduce or amplify harmful stereotypical content if they are misused or trained on biased data.
Those concerns have become more pronounced as AI tools are increasingly adopted across the advertising industry to generate images, video, voiceovers and marketing copy.
The issue is not limited to a single platform. Earlier this year, independent game publisher Finji alleged that TikTok ran AI-generated versions of advertisements for its game Usual June that contained racist and sexist imagery.
The company said it had not approved the altered advertisements. TikTok disputed aspects of the publisher’s account, but the episode drew wider attention to the risks associated with AI-generated advertising content.
The spread of low-quality AI-generated advertisements, often referred to as “AI slop” has also become more visible across major digital platforms, since it costs less resources to produce such content.
Industry observers have reported an increase in AI-produced ads that rely on sensational or misleading visuals to attract attention, creating new moderation challenges for companies that review millions of advertisements every day.
Google, which owns YouTube, maintains advertising policies that prohibit content promoting hate, discrimination or harmful stereotypes.
READ: Trump Media launches Truth Social data service for businesses (July 16, 2026)
The company says advertisements are reviewed through a combination of automated systems and human evaluation before appearing on its platforms, and users can report ads they believe violate company policies.
Google has also introduced transparency measures for certain AI-generated election advertisements where required by regulation, reflecting broader efforts to address the growing role of AI in advertising.
The rise of generative AI has expanded those discussions from automated ad delivery to the content of advertisements themselves, as AI can now generate realistic visuals and narratives with minimal human effort.
As generative AI becomes more deeply integrated into marketing, technology experts say companies will face increasing pressure to strengthen content review processes and ensure AI-generated advertising complies with existing policies against hate speech and discriminatory content.
Recent incidents suggest that while AI can accelerate creative production, it also presents new challenges for platforms seeking to balance innovation with responsible content moderation.