Mizuho Financial Group is partnering with NVIDIA to build secure AI infrastructure that enables financial institutions to deploy generative AI and AI agents while meeting stringent data protection and governance standards.
The initiative involves introducing NVIDIA DGX B200 hardware for on-premises AI development and validating NVIDIA NemoClaw, a secure framework for executing AI agents with built-in controls for data isolation, access management, and execution auditing.
This addresses a critical challenge for banks: leveraging advanced AI capabilities without exposing confidential customer and operational data.
What happened
Mizuho Financial Group has begun exploring advanced AI infrastructure by partnering with NVIDIA, focusing on two areas—introducing NVIDIA DGX B200 GPUs for on-premises computing and validating a secure AI agent execution environment using NVIDIA NemoClaw.
Why it matters
Financial institutions need to balance expanded use of generative AI and AI agents with strict security, compliance, and governance requirements. Mizuho's framework addresses the core challenge: protecting highly confidential data and internal systems while enabling AI agents to autonomously handle tasks like information gathering, document preparation, and analysis across operations.
What to watch
Mizuho is validating NVIDIA NemoClaw for execution environment isolation, data protection, network access control, and permission management in AI agent deployments. The bank also plans to study future GPU cluster architecture to support production workloads, with a goal of securely integrating its own Mizuho LLM (a large language model under development) with confidential internal data and systems.
Ask the AI about this article →
Mizuho's exploration reflects a broader challenge facing financial institutions: how to harness generative AI and autonomous agents without compromising the data security and regulatory compliance that banking demands. The initiative addresses this by grounding the infrastructure in two complementary layers—on-premises GPU computing for controlled model development and training, and a secure agent runtime environment with built-in governance controls.
The choice of NVIDIA DGX B200 as the foundation for on-premises AI workloads signals Mizuho's intention to maintain direct control over sensitive model training and inference validation. This is critical for the bank's proprietary Mizuho LLM, which is designed to embed specialized financial knowledge and internal rules, and cannot safely reside in public cloud environments. By studying a future GPU cluster architecture, Mizuho is also preparing for production-scale inference demands—a sign the bank expects AI agent deployment to grow well beyond proof-of-concept.
The parallel validation of NVIDIA NemoClaw underscores the governance challenge. Financial institutions must ensure that AI agents, despite their autonomy, operate within strict boundaries: they cannot access data beyond their assigned scope, cannot execute transactions without proper authorization, and must leave auditable records of all decisions. Mizuho's focus on permission management, data isolation, and execution history verification indicates this is not a casual experiment but a methodical building of trust in the technology before wider rollout.
For example, today's edition would include:
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. Q&As are published on this page for other readers too.
Israeli startup DataAgent Ltd
SK Hynix presented a custom HBM concept at SEMICON Taiwan 2026, where compute functions are placed in the base…
Taoyuan is positioning itself as a northern hub for AI data centers (AIDC), citing the Tatan area and an LNG c…
The U.S. Department of Defense announced on August 31 that it has deployed ChatGPT Mil, a customized version o…
Nvidia reported earnings that were both remarkable and boring, reflecting its focus on avoiding a consolidated…
Anthropic has agreed to a $35bn cloud-computing contract with Lambda, a Nvidia-backed cloud provider
