Robot rollouts with exact labels
Phase
Caption
Gripper
Grip force
Battery height
Progress
Every frame
- Success or failurereason and measurement
- Subtask phases and events
- Timestamped captions
- Joint states and end-effector pose
- Gripper state and contact forces
- Object poses
- Depth, segmentation, albedo
- Camera intrinsics and extrinsics
Variations
- RobotFranka · SO-101 · YAM · UR · your arm
- Task and objects
- Failure modesjam · slip · missed grasp · drop · wrong target
- Near-miss pairssame start, success and failure
- Execution speed
- Environment, lighting, materials
- Background activity and distractors
- Camera viewpoints
- Photoreal restylingpixel-aligned, labels unchanged
Delivery
- 1080p, 30 fps, multi-camera
- LeRobot, Parquet, JSON, MP4
- Isaac Sim or MuJoCo physics
- Balanced success and failure