Abstract: In recent years, with the rapid iterative development of information technology, tactics of telecom and cyber fraud have continued to evolve and upgrade. Fraudsters increasingly utilize generative artificial intelligence (AI) technologies such as deepfakes to fabricate or tamper with specific identity information with high fidelity, and carry out targeted telecom and cyber fraud on this basis. This issue has gradually become a prominent challenge in the prevention and governance of telecom and cyber fraud. To address these risks and problems, this research innovatively constructs a comprehensive multimodal deepfake detection system, which can identify AI-generated images, AI voice replacement, and AI face swapping. Meanwhile, an end-side lightweight multimodal detection SDK is also developed. The proposed system can be widely applied to a variety of business scenarios, including multimedia messages covering text, images, audio, video and virtual scenarios, 5G new calls, video conferences, and trusted identity authentication. It aims to provide flexible, efficient and accurate AI authenticity verification, early warning and authentication framework and capability for all industries.

Key words: new-type telecom and cyber fraud, deepfake, multimodal detection, lightweight detection, AI authenticity verification, early warning and authentication

摘要： 近年来，随着信息技术的快速迭代发展，电信网络诈骗手段持续演进升级，诈骗分子不断滥用深度伪造等生成式人工智能技术，对特定身份信息进行高度逼真的伪造或篡改，进而实施精准电信网络诈骗，该类作案模式已逐渐成为防范治理电信网络诈骗工作面临的新挑战。本文针对此类电信网络诈骗风险和问题，创新研发了一种针对人工智能（AI）图片合成、AI换声、AI换脸等场景的综合性多模态深度伪造检测系统，以及端侧轻量级多模态检测软件开发工具包（Software Development Kit，SDK），可广泛应用于各类文本、图片、音频、视频、虚拟场景等多媒体消息、5G新通话、视频会议、可信认证等服务场景，旨在为各行各业提供一种灵活、高效、精准的AI鉴伪、预警与认证服务思路和能力。

关键词: 新型电信网络诈骗, 深度伪造, 多模态检测, 轻量级检测, AI鉴伪、预警与认证