Mistral AI has released Robostral Navigate, its first model built for embodied navigation. The 8B model takes RGB images and a plain-language instruction, then moves a robot. Notably, it reaches 76.6% success on R2R-CE validation unseen using only a single RGB camera.
What is Robostral Navigate?
Robostral Navigate is an 8B model for robotic navigation through complex environments. These environments include offices, residential buildings, commercial buildings, and outdoor settings. You give it one instruction, and it completes the whole task alone. For example: ‘Leave the lobby, walk through the corridor, enter the supply room, and stop to face the second shelf.‘ Importantly, it moves through live spaces full of people and obstacles never seen in training.
Moreover, most navigation systems use depth sensors, LiDAR, or several cameras together. By contrast, Robostral Navigate uses one ordinary RGB camera and no depth sensors. Fewer sensors also make the system more efficient than multi-sensor approaches.
Navigation via Pointing: How It Works
