Google DeepMind 与新加坡政府合作打造反诈骗微调 AI 模型
Google DeepMind and Singapore Government collaborate to build fine-tuned AI model for scam detection
Google DeepMind 与新加坡政府科技局(GovTech Singapore)合作,基于轻量级 Gemma 模型在本地诈骗对话数据上微调出一个端侧反诈骗检测模型。该模型完全在设备本地运行,新加坡政府和 Google 均无法访问用户对话,并通过"轻量分类器初筛 + Gemma 上下文分析"两阶段流程触发实时警告。模型在新加坡国际网络周(SICW 2026)上展示,将分阶段在应用中推出。
October 14, 2026 Responsibility & Safety
JJ Geewax and Miguel de Andrés
Collaborating with the Government Technology Agency of Singapore (GovTech Singapore) to protect users without compromising privacy.
Scams, such as investment fraud, fake job offers, and impersonation of public officials make up over half of Singapore’s reported crimes, and account for more than S$4 billion in losses since 2019. At the same time, scam tactics have shifted from simple phishing to complex social engineering, whereby attackers manipulate victims with convincing conversations before requesting money. Such scams now account for up to 80% of all losses.
To address this, Google DeepMind and the Government Technology Agency of Singapore (GovTech Singapore) have been working together as part of our National AI Partnership with the Singapore Government. Together, we've fine-tuned a privacy-preserving, on-device scam detection model.
On-device AI protection without compromising privacy
Generic models often struggle with local deception techniques, making scam detection harder. To address this, Google’s lightweight Gemma model was fine-tuned on local scam conversations. These ranged from impersonations of public institutions, banks, and local figures, to trending regional schemes. This ensures the fine-tuned model will be able to distinguish benign social chatter from genuine manipulation when deployed in applications installed by citizens.
Unlike traditional threat detection, which relies on server-side scanning of messages in the cloud, this model can process conversation data directly on-device. When integrated into applications, this will allow faster analysis of conversation patterns to detect manipulative intent and help citizens act before financial or credential exposure can occur.
The roll out of the model within applications will be carefully phased and developed in partnership with the Singapore Government. When deployed, the model will only be able to access on-device conversations with the user's consent, in accordance with the terms of use of that application. As the model runs entirely on-device, neither the Singapore Government nor Google, will be able to access users’ conversations through its deployment.
Under the hood: local context and edge efficiency
When the model detects manipulative conversational patterns, it triggers a real-time warning directly on the user's device advising them to pause and exercise caution before sharing sensitive information or funds.
Running a complex scam classifier model on modern smartphones is no easy task, with battery efficiency being a critical area of concern. To do this, we're relying on a two-stage pipeline:
- Stage 1: A lightweight, efficient classifier screens inbound messages, using minimal power, focused on catching potential threats.
- Stage 2: In-context analysis with our fine-tuned Gemma model, where we analyze a larger snapshot of the conversation to confirm a threat or discard a false alarm.
Built on strict governance
Presented at Singapore International Cyber Week (SICW 2026), this collaboration provides a model for messaging platforms balancing user protection with end-to-end encryption. Strict governance was maintained throughout development:
- Sovereign Sandbox: Fine-tuning took place within GovTech Singapore's managed and maintained GCP environment, keeping training data isolated.
- No Citizen Data: Training strictly excluded private or personally identifiable information, utilising anonymised datasets derived from scam reports and intelligence feeds.
- Stress-Testing: The model was tested against synthetic dialogues and local corpora to cover diverse scam categories and evolving impersonation tactics.
The future of on-device safety
The project demonstrates how AI can help counter criminality without compromising safety or privacy. It also shows how governments and model providers can work together to build tech for public good. With this lightweight, on-device model, we've proven the ability for local, real-time scam detection while ensuring chat interactions remain secure. We look forward to sharing more soon on our collaboration with the Singapore government, as well as exploring the potential for similar technology to be deployed in other countries.
来源:Google DeepMind · deepmind.google