Mizuho to Build Secure AI Infrastructure Using NVIDIA Technologies

Mizuho's exploration reflects a broader challenge facing financial institutions: how to harness generative AI and autonomous agents without compromising the data security and regulatory compliance that banking demands. The initiative addresses this by grounding the infrastructure in two complementary layers—on-premises GPU computing for controlled model development and training, and a secure agent runtime environment with built-in governance controls.

The choice of NVIDIA DGX B200 as the foundation for on-premises AI workloads signals Mizuho's intention to maintain direct control over sensitive model training and inference validation. This is critical for the bank's proprietary Mizuho LLM, which is designed to embed specialized financial knowledge and internal rules, and cannot safely reside in public cloud environments. By studying a future GPU cluster architecture, Mizuho is also preparing for production-scale inference demands—a sign the bank expects AI agent deployment to grow well beyond proof-of-concept.

The parallel validation of NVIDIA NemoClaw underscores the governance challenge. Financial institutions must ensure that AI agents, despite their autonomy, operate within strict boundaries: they cannot access data beyond their assigned scope, cannot execute transactions without proper authorization, and must leave auditable records of all decisions. Mizuho's focus on permission management, data isolation, and execution history verification indicates this is not a casual experiment but a methodical building of trust in the technology before wider rollout.