Child Safety Group Criticizes YouTube for Risky Million-Dollar AI Content for Kids

Young children are frequently exposed to low-quality content on YouTube. Despite the abundance of such content, Google, which owns YouTube, believes its AI technology could ease parents’ concerns. On March 4, Google invested $1 million in Animaj, an AI-based children’s media company, marking it as the first of its kind supported by Google’s AI Future Funds accelerator. Animaj will gain exclusive access to Google’s AI tools, including Veo and Imagine. Although Google acknowledges its AI content issues, studies indicate that children are often recommended AI-generated content. A February analysis by the New York Times identified thousands of AI videos aimed at young viewers, some violating YouTube’s child safety policies. According to Rachel Franz of Fairplay for Kids, YouTube’s focus should be on improving its platform to ensure children’s safety, rather than deflecting attention. Animaj specializes in scaling IP through AI, aiming to provide content globally. However, experts argue that the mesmerizing nature of AI-powered content could hinder a child’s development, pointing out that both AI and non-AI-generated content can have adverse effects. They emphasize the risk posed by platforms like YouTube, which feature endless scrolling and algorithm-based suggestions. Despite Animaj’s focus on existing IP without creating disturbing content, experts like Franz remain concerned about the broader impact of AI normalization in children’s media.