Roblox has upgraded its security system with the introduction of a real-time multimodal AI system, designed to enhance the platform’s content moderation. Unlike previous systems that focused on individual elements, this new AI scans the entire game scene, analyzing avatars, messages, and 3D objects to detect inappropriate content. The goal is to catch what traditional filters might miss, ensuring a safer environment for players of all ages.
This AI is especially adept at understanding the context, meaning it can identify problematic symbols or actions, even if they are subtle or embedded within creative content like drawings. For example, if a player uses a drawing tool to create offensive symbols, the AI detects this action by understanding the broader context rather than merely flagging the individual item.
Since the AI’s implementation, it has been responsible for closing approximately 5,000 servers per day where rule violations have been detected, without affecting the overall game. This system not only helps keep Roblox secure but also provides a more efficient, less intrusive way of enforcing community standards across the platform.
 Origin: Digitaltrends
