Model launches

AI-generated text

Dyna’s world-action models power semi-humanoid robots for hour-long autonomy and real deployments

Dyna Robotics says its Dyna-2 world‑action model was pretrained on over one million hours of human egocentric video and is now controlling physical agents that can run hour‑long workflows.

Dyna’s world-action models power semi-humanoid robots for hour-long autonomy and real deployments

Dyna Robotics has released the Dyna‑2 world‑action model and a matched physical agent (Dyna‑2.1) aimed at real, operational deployments. According to the company, Dyna‑2 was pretrained on more than one million hours of human egocentric video and combines predicted future visual states with actions that robots can execute. Jason Ma, co‑founder and Chief Scientist of Dyna Robotics, explained the architecture, deployment experience and current limitations in a recent on‑site interview and talk.

What a world‑action model does

Inputs include short‑horizon video from a robot’s cameras, proprioceptive data (actuator positions, joint encoders) and optional language instructions. Outputs are action commands the robot can execute and—distinctively for a world‑action model—predicted future video or visual state representations that guide those actions. Dyna frames this as a visual analogue of chain‑of‑thought: the model reasons in visual/physics space and then emits actions.

Under the hood, Dyna‑2 uses an encoder‑only transformer in a diffusion‑transformer style; diffusion (and the related flow matching variant) is used because it helps produce precise, smooth, high‑fidelity trajectories. Flow matching reduces the number of diffusion steps and the need for manual scheduler tuning, which is valuable for real‑time control.

Data scale and the robotics data bottleneck

Dyna emphasizes data as the primary resource for robotics. The Dyna‑2 model was pretrained on over one million hours of human egocentric video to provide a diverse prior over physical interaction. However, because human embodiment differs from robot embodiment, robot‑collected demonstrations remain necessary for final adaptation. Dyna reports that some tasks can be adapted from tens of minutes to a few hours of robot demonstrations—one example cited was about 45 minutes for a chopping/onboarding task.

The company encourages data partnerships (datapartnerships@dyna.co) and says million‑hour scale is a starting point: additional domain‑specific data and synthetic/simulated data will be needed to reach broader generality.

Synthetic data, simulation and self‑generated training data

Dyna is exploring frontier models to generate synthetic environments and training data. The team also uses its own world‑action model to generate video and action sequences, creating a potential self‑improving loop where the model generates training examples for further refinement.

On‑device inference and latency constraints

Robotic control requires low inference latency. For many dynamic tasks, network latency is untenable, so deployed models must run locally on device. Dyna trains large models but distills them into smaller, on‑device models and builds its own inference stack tailored to the deployed models to meet real‑time constraints.

Why Dyna builds hardware: the semi‑humanoid approach

Dyna co‑designs hardware and models. The company’s platform is a wheeled semi‑humanoid: a humanoid upper body (shoulders, arms, torso degrees of freedom) mounted on wheels. The rationale: wheels are more energy‑efficient and stable for current deployments, while a humanoid upper body better leverages human egocentric pretraining for transfer. Dyna plans to own or design critical components—especially actuators—because actuator dynamics strongly affect modeling and controllability.

Manufacturing and supply chains are practical challenges; rare‑earth magnets and other materials create long supply chains that are hard to fully repatriate.

Main bottlenecks to broader generality

Dyna identifies two primary bottlenecks:

  • Data and sensor modalities: vision alone may be insufficient for every task; richer multimodal sensing (tactile, audio, infrared) could be required for data efficiency and robustness.
  • Hardware durability and dexterity: state‑of‑the‑art dexterous hands can overheat and lack robustness for continuous, hours‑long workflows.

Without progress on these fronts, some classes of complex, multi‑step tasks will remain difficult.

Agentic harness and long‑horizon workflows

To run multi‑hour workflows, Dyna wraps its world‑action model in an agentic harness: a hierarchical control layer that manages high‑level planning, sequencing of skills, and decision logic (for example, knowing to return to the dryer when a wash cycle completes). This hierarchical approach is intended to compose low‑level continuous control with higher‑level task reasoning.

Real deployments: Best Western and Din Tai Fung

Dyna reports real customer deployments. The company has pilots with Best Western (hotel laundry applications) and scaled deployments at multiple Din Tai Fung restaurant locations, where robots fold thousands of napkins per day. Dyna highlights that achieving scale across multiple sites is a meaningful validation beyond single‑site pilots. In one 24‑hour continuous folding trial, Dyna reported a 99.4% success rate and the ability to recover after disrupting the napkin stack.

Research culture, product focus and near‑term goals

Dyna describes itself as a research‑plus‑product company: frontier research is driven by practical deployment goals. The team runs fast experimental evals, invites creative task proposals, and iterates from real‑world feedback. Current stated targets include scaling deployments from the tens of robots currently in the field toward hundreds over the next year.

Jason Ma’s background (PhD at Penn, work at NVIDIA and Google DeepMind) influenced Dyna’s emphasis on reinforcement learning, simulation, and automated environment generation; the company’s name references Sutton’s Dyna framework and a personal cultural allusion.

Technical landscape and alternatives

Dyna positions world‑action models—predicting future visual states and actions—as a first‑principles approach to robotics. Other groups pursue vision‑language‑action (VLA) models that focus on higher‑level abstractions or directly predict actions from vision+language. Dyna argues that predicting raw future sensory observations reduces human bias about what to predict, but concedes that adding modalities (tactile, audio, thermal) could change the tradeoffs and potentially be more data‑efficient for some problems.

Summary

Dyna‑2 demonstrates a path from large, human‑video pretrained world models to physical agents operating in real settings. The company highlights diffusion/flow‑matching transformer architectures, rapid adaptation from limited robot demonstrations (minutes to hours), and full‑stack co‑design (hardware, sensors, inference, models) as core elements. Data diversity and hardware for durable dexterity remain the main obstacles to achieving broader general‑purpose robot autonomy.


Contacts and resources referenced by Dyna: