Skip to main content

View as Markdown

Page content converted to Markdown. Use the original page link at the end to explore interactive graphics.

4. Embodied AI platforms

An embodied AI platform is the body an agent uses to perceive, act, and interact with its environment. For a physical robot, this includes mechanical structures, sensors, and actuators. Different bodies determine what a robot can observe, which actions it can perform, and where it can operate.

4.1 What the body determines​

ComponentWhat it determinesExamples
Mechanical structureDegrees of freedom, workspace, and whether the robot can moveAn arm can only manipulate within its reach; legs can climb steps and wheels cannot
SensorsWhat the robot can observeA wrist camera sees details near the gripper; an IMU measures orientation and angular velocity; tactile sensors detect contact
ActuatorsWhich actions the robot can produce and how much force it can applyMotor torque limits determine how much a robot can lift and how high it can jump; a dexterous hand can do more in-hand manipulation than a parallel gripper

Here, degrees of freedom (DoF) are the number of independently controllable directions of motion. For example, a common industrial arm has 6 joints and therefore 6 degrees of freedom; a typical quadruped has 3 joints per leg, for 12 degrees of freedom in its legs.

Move the same method to a different body and the observations, actions, and achievable tasks all change. So when you read a paper or reproduce an experiment, first check which robot platform it uses.

4.2 Common platforms​

With the four skills from Chapter 3 in mind, explore these five common types of physical platform, followed by simulated bodies used in research. The demos below show how each type moves; switch between official clips and 3D illustrations:

Humanoid robots​

  • Body: two legs, a torso, and two arms.
  • Example platforms: Unitree G1, Figure 03.
  • Related skills: grasping, manipulation, locomotion, and navigation, which can be studied together depending on the configuration.
  • Common research questions: biped walking, balance, whole-body coordination of arms and body, and manipulation while moving. Hand design, sensors, and control interfaces determine which experiments are possible.

Fixed-base robot arms​

  • Body: one or two arms on a fixed base.
  • Example platforms: Franka Research 3, ALOHA 2, SO-101.
  • Related skills: grasping, manipulation.
  • Common research questions: tabletop grasping, assembly, bimanual coordination, and imitation learning. Useful for focusing on end-effector–object interaction, with a workspace limited by the arms' reach.

Wheeled mobile robots​

  • Body: move using a wheeled base.
  • Example platforms: TurtleBot 4, Jackal, Husky A300.
  • Related skills: locomotion, navigation.
  • Common research questions: localization, mapping, path planning, obstacle avoidance, and multirobot coordination. Motion control must account for steering constraints, wheel–ground contact, and slipping.

Quadruped robots​

  • Body: use four legs for support and movement.
  • Example platforms: Unitree Go2, Spot.
  • Related skills: locomotion, navigation; adding an arm enables manipulation skills.
  • Common research questions: gaits, balance, challenging terrain, perception–locomotion coordination, and sim-to-real policy transfer. Navigation and locomotion must be validated together in the target environment.

Mobile manipulation platforms​

  • Body: a mobile base combined with a manipulator.
  • Example platforms: Stretch 3, Mobile ALOHA, ALMA.
  • Related skills: grasping, manipulation, locomotion, and navigation, with an emphasis on coordinating mobility and manipulation.
  • Common research questions: reach a work location, then pick and place objects, open doors, or carry items. The base may use wheels or legs; its position must be coordinated with arm reach and body stability.

Simulated bodies​

  • Body: models define the body and sensors.
  • Example platforms / tools: Habitat, Isaac Lab, MuJoCo.
  • Related skills: depend on the simulated body and task.
  • Common research questions: study navigation, manipulation, or locomotion in configurable scenes, collect interaction data, and run repeatable evaluations. Observations, actions, and physics settings determine what the experiment can demonstrate.

4.3 Compare the platforms​

PlatformTypical observationsTypical actionsRelated skills
Humanoid robotsJoint states, IMU, head cameraWhole-body joint targetsGrasping, manipulation, locomotion, navigation
Fixed-base robot armsJoint states, external or wrist cameras, optionally force sensingEnd-effector poses or joint targets, gripper open/closeGrasping, manipulation
Wheeled mobile robotsLiDAR, cameras, odometryLinear and angular velocity of the baseLocomotion, navigation
Quadruped robotsJoint states, IMU, optionally depth cameras or elevation mapsTarget angles for 12 jointsLocomotion, navigation
Mobile manipulation platformsCombined sensors of the base and armBase velocity and arm actionsGrasping, manipulation, locomotion, navigation
Simulated bodiesDefined by the simulation modelDefined by the simulation modelDepend on the simulated body and task

The table shows common configurations; specific platforms vary.

4.4 The categories overlap​

These categories overlap: humanoids and quadrupeds with arms can also be mobile manipulation platforms. The body enables skills; actual capabilities still require validation in specific tasks.

A simulated body is a robot or agent in simulation. Habitat, Isaac Lab, and MuJoCo listed above are platforms and tools for building or running these bodies. Virtual bodies also require explicitly defined sensors, action spaces, and interactions with the environment.

Simulation makes training safer and cheaper, and it allows parallel runs and repeatable evaluation. The cost is a gap between simulation and reality, which Chapter 5 discusses.

4.5 Choosing a platform for learning​

  • Start in simulation: simulators such as MuJoCo are free to use, and mistakes cannot damage hardware. Build a quadruped from scratch takes place entirely in simulation.
  • For imitation learning and real-robot manipulation: a low-cost open source arm with LeRobot supports data collection, training, and deployment. See the SO-101 + LeRobot hardware tutorial.
  • For motion control: training legged robots in simulation is a good starting point. See MicroDuck RL.

For more directions and entry points, see projects.

Summary​

  • A platform is the agent's body: its mechanical structure, sensors, and actuators determine observations, actions, and working environments.
  • Common platforms include humanoids, fixed-base arms, wheeled mobile robots, quadrupeds, mobile manipulation platforms, and simulated bodies, and the categories overlap.
  • While learning, start in simulation, then choose a real robot platform based on your direction.

Further reading​

References​

  1. Modern Robotics: Wheeled robots and mobile manipulation
  2. For platform details, refer to the official pages linked above.