Australia School Photos Scraped for AI-Fueled Image Misuse

Click to expand Image Students taking a group photo. © 2016 Owen Franken/Getty Images Australia’s eSafety commissioner issued an advisory on July 28 urging schools to review how they share images online, citing a rise in the misuse of school photos. Between January and March 2026, the commissioner received over 100 reports concerning anonymous accounts targeting schools and school staff through misuse of images taken from official school websites and social media accounts. Much of the content, shared on platforms including TikTok and Instagram, involved artificial intelligence (AI)-generated materials depicting both children and school staff, including sexualized deepfake images, face swaps, and other manipulated imagery.In 2024, Human Rights Watch documented that the personal photos of Australian children, including images posted by schools, had been scraped and used to train AI models. In addition to privacy risks, these practices enable the creation of convincing deepfakes, including sexualized imagery of children, which put children at even more risk of exploitation and harm.Once online, images shared by schools can be rapidly manipulated and distributed. Photos in data sets used to train AI models can also reveal information that could identify children, including names, events, locations, and schedules. This could expose children to lasting harm, as both the original images and malicious deepfakes created from them can remain accessible indefinitely.Australia has been considering stronger child data protections rules through the government’s proposed Children’s Online Privacy Code. The draft code, published in March, is expected to be finalized later this year. This code is a critical opportunity to strengthen protections for children’s personal information and require companies to act in children’s best interests in accordance with international human rights law. The cases highlighted by eSafety underscore the growing risks of a regulatory environment that does not explicitly prohibit the scraping and reuse of children’s images and personal data. As the government moves towards finalizing the code, it should ensure that it explicitly prohibits the scraping of children’s photos and personal data for AI training. It should also prohibit the digital replication or manipulation of children’s likenesses. Children should not have to worry that photographs shared online by their schools will be scraped, manipulated, and turned into harmful content beyond their control. Australia should make it clear as a matter of law that children’s images are not raw material for AI models. Your tax deductible gift can help stop human rights violations and save lives around the world. Region / Country Australia Topic Technology and Rights More Reading June 14, 2026 Background Briefing Addressing Artificial Intelligence in the Military Domain October 9, 2023 Statement EU: Artificial Intelligence Regulation Should Ban Social Scoring Reports July 28, 2026 Report Grabbed Land, Silenced Justice The Persecution of Environmentalists and Indigenous Leaders in Indonesia July 21, 2026 Report A Dangerous Partnership Abuses, Unanswered Questions, and US-Ecuador Security Cooperation More Reading June 14, 2026 Background Briefing Addressing Artificial Intelligence in the Military Domain October 9, 2023 Statement EU: Artificial Intelligence Regulation Should Ban Social Scoring Most Viewed November 12, 2018 News Release Pakistan: Girls Deprived of Education August 6, 2026 Report Lebanon: Israel’s Killing of Journalist an Apparent War Crime November 25, 2019 Report A Dirty Investment July 25, 2017 Report “I Want to Be Like Nature Made Me” December 14, 2017 Report “They Were Men in Uniform” Share this via Facebook Share this via Bluesky Share this via X Share this via WhatsApp Share this via Email More sharing options Share this via LinkedIn Share this via Reddit Share this via Telegram Share this via Printer