理解Alpha世代數位語言:大型語言模型安全系統在內容審核中的評估
Understanding Gen Alpha Digital Language: Evaluation of LLM Safety Systems for Content Moderation
May 14, 2025
作者: Manisha Mehta, Fausto Giunchiglia
cs.AI
摘要
本研究提供了一項獨特的評估,探討人工智慧系統如何解讀Alpha世代(Gen Alpha,2010-2024年出生)的數位語言。作為與AI共同成長的第一代,Alpha世代因沉浸式的數位參與以及其不斷演變的溝通方式與現有安全工具之間日益加劇的不匹配,而面臨新型態的線上風險。他們獨特的語言,受到遊戲、迷因和AI驅動趨勢的影響,往往能將有害互動隱藏於人類審核員和自動化系統之外。我們評估了四種領先的AI模型(GPT-4、Claude、Gemini和Llama 3)在檢測Alpha世代話語中隱蔽的騷擾和操縱方面的能力。透過使用來自遊戲平台、社交媒體和影片內容的100個近期表達的數據集,本研究揭示了對線上安全具有直接影響的關鍵理解失敗。這項工作貢獻包括:(1) 首個捕捉Alpha世代表達的數據集;(2) 一個改進AI審核系統以保護青少年的框架;(3) 包含AI系統、人類審核員和家長的多視角評估,並直接採納了Alpha世代共同研究者的意見;以及(4) 對語言分歧如何增加青少年脆弱性的分析。研究結果強調了重新設計適應青少年溝通的安全系統的迫切需求,特別是考慮到Alpha世代在成年人無法理解其數位世界時不願尋求幫助的情況。本研究結合了Alpha世代研究者的洞察與系統的學術分析,以應對關鍵的數位安全挑戰。
English
This research offers a unique evaluation of how AI systems interpret the
digital language of Generation Alpha (Gen Alpha, born 2010-2024). As the first
cohort raised alongside AI, Gen Alpha faces new forms of online risk due to
immersive digital engagement and a growing mismatch between their evolving
communication and existing safety tools. Their distinct language, shaped by
gaming, memes, and AI-driven trends, often conceals harmful interactions from
both human moderators and automated systems. We assess four leading AI models
(GPT-4, Claude, Gemini, and Llama 3) on their ability to detect masked
harassment and manipulation within Gen Alpha discourse. Using a dataset of 100
recent expressions from gaming platforms, social media, and video content, the
study reveals critical comprehension failures with direct implications for
online safety. This work contributes: (1) a first-of-its-kind dataset capturing
Gen Alpha expressions; (2) a framework to improve AI moderation systems for
youth protection; (3) a multi-perspective evaluation including AI systems,
human moderators, and parents, with direct input from Gen Alpha co-researchers;
and (4) an analysis of how linguistic divergence increases youth vulnerability.
Findings highlight the urgent need to redesign safety systems attuned to youth
communication, especially given Gen Alpha reluctance to seek help when adults
fail to understand their digital world. This study combines the insight of a
Gen Alpha researcher with systematic academic analysis to address critical
digital safety challenges.Summary
AI-Generated Summary