Topics
Models that map perception and language directly to robot actions.
Vision-language-action models try to make robots learn from the same semantic world that language and vision models already use. The goal is not only recognizing objects or parsing instructions, but producing continuous or tokenized actions that work on real hardware.
This topic is early but strategically important. RT-2 shows how web-scale vision-language knowledge can transfer into robot control by representing actions in a language-like format. π0 pushes toward a more general robot policy with flow matching over continuous actions. The hard open questions are data collection, safety, embodiment transfer, latency, and whether a single policy can handle the physical diversity of real robots.
Vision-Language-Action · Physical Intelligence
A single vision-language-action model, trained on data from seven robot platforms, performs dexterous everyday tasks like folding laundry from plain language prompts.
Vision-Language-Action · Google DeepMind
RT-2 shows that robot actions can be represented as language-like tokens, letting web-trained vision-language models transfer semantic knowledge into physical control.
Vision-Language-Action · Google DeepMind
RT-2 shows that robot actions can be represented as language-like tokens, letting web-trained vision-language models transfer semantic knowledge into physical control.
Vision-Language-Action · Physical Intelligence
A single vision-language-action model, trained on data from seven robot platforms, performs dexterous everyday tasks like folding laundry from plain language prompts.
Vision-Language-Action · Physical Intelligence
A single vision-language-action model, trained on data from seven robot platforms, performs dexterous everyday tasks like folding laundry from plain language prompts.
Vision-Language-Action · Google DeepMind
RT-2 shows that robot actions can be represented as language-like tokens, letting web-trained vision-language models transfer semantic knowledge into physical control.
Vision-Language-Action · Physical Intelligence
A single vision-language-action model, trained on data from seven robot platforms, performs dexterous everyday tasks like folding laundry from plain language prompts.
Vision-Language-Action · Google DeepMind
RT-2 shows that robot actions can be represented as language-like tokens, letting web-trained vision-language models transfer semantic knowledge into physical control.