The term “illegal and restricted online content” includes videos and images depicting child sexual abuse or acts of terrorism or extreme violence.
According to experts, with the use of end-to-end encryption without built-in safety mechanisms, computer-generated imagery (CGI) including deepfakes and deepnudes, and on-demand live streaming and eXtended reality (XR) of child sexual abuse and exploitation material, the boom in generative AI and eXtended reality is continuously evolving and facilitating the harmful production and distribution of child sexual abuse and exploitation in the digital dimension.
DeepNude AI, which mostly targets images of women, uses artificial intelligence to create fake nude images from photos of people wearing clothing.
Immersion technologies that combine the real and virtual worlds are collectively referred to as Extended Reality (XR). This comprises Augmented reality (AR), which improves the real world by superimposing digital elements, and virtual reality (VR), which typically entails the user donning a headgear that displays a replica of the real world In order to create a blended experience where the virtual and physical interact smoothly, Mixed Reality (MR) combines aspects of VR and AR.
Predators can captivate children more easily using speech synthesis, AI chatbots, and online interactions. Children can trust them, and they can take advantage of them online.
Google and YouTube created tools to help organizations in safeguarding minors by more effectively prioritizing the examination of abusive content.The Content Safety API classifier helps organizations in categorizing and ranking billions of videos and images for evaluation using programmatic access and artificial intelligence.YouTube’s proprietary technology, CSAI Match, is used to block videos that depict child sexual abuse.
