AI technology developed by Cornell University, called DRAWER, can turn ordinary videos of rooms into interactive 3D models, allowing users to explore and interact with the space realistically.
The system uses AI to analyze videos and create realistic 3D scenes without the need for special equipment or sensors, making it user-friendly and accessible.
Different AI models work together to create detailed digital twins of rooms, enabling tasks like opening doors, moving objects, and training robots virtually for real-world applications.
While currently focusing on hard objects, researchers aim to expand the technology to include soft materials and larger areas, with the ultimate goal of creating digital twins for various real-world applications.