AIToday

HY-World 2.0 enables AI to generate navigable 3D scenes from text, images, or videos using advanced multi-modal processing

arXiv cs.CVApr 17, 20261 min read
HY-World 2.0 enables AI to generate navigable 3D scenes from text, images, or videos using advanced multi-modal processing

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  1. Accepts diverse inputs including text prompts, single-view images, multi-view images, and videos to create 3D world representations

  2. Generates high-fidelity 3D Gaussian Splatting (3DGS) scenes through a four-stage pipeline: panorama generation, trajectory planning, world expansion, and composition

  3. Introduces upgraded components including HY-Pano 2.0 for improved panorama fidelity, WorldStereo 2.0 with consistent memory for keyframe-based view generation, and WorldMirror 2.0 for universal 3D prediction

  4. Represents an advancement over the original HY-World 1.0 with enhanced 3D scene understanding and planning capabilities

Discussion

No discussion yet for this article

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →