π0.5
Results reported
Results
Score / Success
| Suite | Mean | Clean | Random |
|---|---|---|---|
| Overall | 7.63 / 6.38% | 8.94 / 7.56% | 6.32 / 5.20% |
| Mind | 4.46 / 3.50% | 6.60 / 5.47% | 2.32 / 1.53% |
| Act | 15.88 / 12.00% | 16.75 / 12.67% | 15.02 / 11.33% |
| Mind2Act | 5.08 / 3.63% | 6.21 / 4.53% | 3.96 / 2.73% |
Task results
Score / Success · Averages across Easy, Medium and Hard.
Mind
| Task | Mean | Clean | Random |
|---|---|---|---|
| EEntity memory | 2.97 / 0.50% | 3.27 / 0.67% | 2.66 / 0.33% |
| E1Duplicate Item Identification | 3.74 / 1.00% | 4.25 / 1.33% | 3.23 / 0.67% |
| E2Object-Code Keypad Entry | 2.19 / 0.00% | 2.30 / 0.00% | 2.09 / 0.00% |
| PProcess memory | 9.23 / 7.67% | 15.85 / 14.00% | 2.61 / 1.33% |
| P1Order-Based Meal Assembly | 1.29 / 1.00% | 0.93 / 0.67% | 1.64 / 1.33% |
| P2Steamer Stack Order Reconstruction | 17.18 / 14.33% | 30.78 / 27.33% | 3.58 / 1.33% |
| SSpatial memory | 3.79 / 3.67% | 4.77 / 4.67% | 2.82 / 2.67% |
| S1Rotating Tray Layout Reconstruction | 0.25 / 0.00% | 0.20 / 0.00% | 0.31 / 0.00% |
| S2Hidden-Zone Navigation | 7.33 / 7.33% | 9.33 / 9.33% | 5.33 / 5.33% |
| FFeedback-rule learning | 4.72 / 4.67% | 6.05 / 6.00% | 3.38 / 3.33% |
| F1Unknown Button Mapping and Slider Navigation | 5.77 / 5.67% | 8.10 / 8.00% | 3.43 / 3.33% |
| F2Color-Block Trial Ordering | 3.67 / 3.67% | 4.00 / 4.00% | 3.33 / 3.33% |
| MIntegrated memory | 1.59 / 1.00% | 3.05 / 2.00% | 0.14 / 0.00% |
| M1Workpiece Tracking and Route Reproduction | 0.03 / 0.00% | 0.00 / 0.00% | 0.05 / 0.00% |
| M2Memory Card Matching | 3.16 / 2.00% | 6.09 / 4.00% | 0.23 / 0.00% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| E1Duplicate Item Identification | Easy | 7.80 / 3.00% | 8.80 / 4.00% | 6.80 / 2.00% |
| Medium | 2.37 / 0.00% | 2.64 / 0.00% | 2.09 / 0.00% | |
| Hard | 1.05 / 0.00% | 1.30 / 0.00% | 0.80 / 0.00% | |
| E2Object-Code Keypad Entry | Easy | 3.15 / 0.00% | 3.30 / 0.00% | 3.00 / 0.00% |
| Medium | 1.98 / 0.00% | 2.20 / 0.00% | 1.76 / 0.00% | |
| Hard | 1.45 / 0.00% | 1.40 / 0.00% | 1.50 / 0.00% | |
| P1Order-Based Meal Assembly | Easy | 0.38 / 0.00% | 0.45 / 0.00% | 0.30 / 0.00% |
| Medium | 1.22 / 1.00% | 0.11 / 0.00% | 2.33 / 2.00% | |
| Hard | 2.26 / 2.00% | 2.23 / 2.00% | 2.30 / 2.00% | |
| P2Steamer Stack Order Reconstruction | Easy | 25.20 / 22.00% | 47.40 / 44.00% | 3.00 / 0.00% |
| Medium | 21.45 / 18.00% | 36.64 / 32.00% | 6.25 / 4.00% | |
| Hard | 4.90 / 3.00% | 8.30 / 6.00% | 1.50 / 0.00% | |
| S1Rotating Tray Layout Reconstruction | Easy | 0.30 / 0.00% | 0.30 / 0.00% | 0.30 / 0.00% |
| Medium | 0.28 / 0.00% | 0.22 / 0.00% | 0.33 / 0.00% | |
| Hard | 0.19 / 0.00% | 0.07 / 0.00% | 0.30 / 0.00% | |
| S2Hidden-Zone Navigation | Easy | 20.00 / 20.00% | 24.00 / 24.00% | 16.00 / 16.00% |
| Medium | 2.00 / 2.00% | 4.00 / 4.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| F1Unknown Button Mapping and Slider Navigation | Easy | 17.30 / 17.00% | 24.30 / 24.00% | 10.30 / 10.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| F2Color-Block Trial Ordering | Easy | 10.00 / 10.00% | 12.00 / 12.00% | 8.00 / 8.00% |
| Medium | 1.00 / 1.00% | 0.00 / 0.00% | 2.00 / 2.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| M1Workpiece Tracking and Route Reproduction | Easy | 0.07 / 0.00% | 0.00 / 0.00% | 0.15 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| M2Memory Card Matching | Easy | 7.95 / 6.00% | 15.60 / 12.00% | 0.30 / 0.00% |
| Medium | 1.43 / 0.00% | 2.53 / 0.00% | 0.33 / 0.00% | |
| Hard | 0.11 / 0.00% | 0.15 / 0.00% | 0.07 / 0.00% |
Act
| Task | Mean | Clean | Random |
|---|---|---|---|
| DRDynamic response | 28.62 / 22.92% | 30.33 / 24.17% | 26.91 / 21.67% |
| DR1Continuous Conveyor Picking | 20.94 / 13.00% | 24.61 / 15.33% | 17.27 / 10.67% |
| DR2Light-Guided Button Response | 14.85 / 0.00% | 15.33 / 0.00% | 14.37 / 0.00% |
| DR3Periodic Gate Crossing and Withdrawal | 78.69 / 78.67% | 81.37 / 81.33% | 76.00 / 76.00% |
| DR4Ball-on-Tray Transport and Placement | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| PRPrecise execution | 7.39 / 4.72% | 7.69 / 5.00% | 7.10 / 4.44% |
| PR1Linear Resistor Adjustment | 28.77 / 16.33% | 29.45 / 17.33% | 28.09 / 15.33% |
| PR2Rotary Voltage Regulator Setting | 3.42 / 1.00% | 2.70 / 0.00% | 4.14 / 2.00% |
| PR3Marker Line Tracing | 1.07 / 1.00% | 2.00 / 2.00% | 0.15 / 0.00% |
| PR4Cloth Edge Alignment and Placement | 10.00 / 10.00% | 10.67 / 10.67% | 9.33 / 9.33% |
| PR5Oriented Stamp Placement | 1.10 / 0.00% | 1.34 / 0.00% | 0.87 / 0.00% |
| PR6Domino Chain Bell Ringing | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| DR1Continuous Conveyor Picking | Easy | 47.10 / 34.00% | 48.80 / 36.00% | 45.40 / 32.00% |
| Medium | 12.96 / 5.00% | 21.35 / 10.00% | 4.58 / 0.00% | |
| Hard | 2.76 / 0.00% | 3.69 / 0.00% | 1.84 / 0.00% | |
| DR2Light-Guided Button Response | Easy | 21.06 / 0.00% | 21.96 / 0.00% | 20.16 / 0.00% |
| Medium | 14.10 / 0.00% | 14.48 / 0.00% | 13.73 / 0.00% | |
| Hard | 9.38 / 0.00% | 9.54 / 0.00% | 9.21 / 0.00% | |
| DR3Periodic Gate Crossing and Withdrawal | Easy | 76.00 / 76.00% | 78.00 / 78.00% | 74.00 / 74.00% |
| Medium | 81.06 / 81.00% | 86.11 / 86.00% | 76.00 / 76.00% | |
| Hard | 79.00 / 79.00% | 80.00 / 80.00% | 78.00 / 78.00% | |
| DR4Ball-on-Tray Transport and Placement | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR1Linear Resistor Adjustment | Easy | 43.35 / 23.00% | 45.93 / 26.00% | 40.77 / 20.00% |
| Medium | 24.57 / 13.00% | 26.95 / 16.00% | 22.18 / 10.00% | |
| Hard | 18.40 / 13.00% | 15.48 / 10.00% | 21.32 / 16.00% | |
| PR2Rotary Voltage Regulator Setting | Easy | 7.96 / 2.00% | 6.41 / 0.00% | 9.50 / 4.00% |
| Medium | 2.17 / 1.00% | 1.61 / 0.00% | 2.73 / 2.00% | |
| Hard | 0.14 / 0.00% | 0.07 / 0.00% | 0.20 / 0.00% | |
| PR3Marker Line Tracing | Easy | 3.00 / 3.00% | 6.00 / 6.00% | 0.00 / 0.00% |
| Medium | 0.22 / 0.00% | 0.00 / 0.00% | 0.44 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR4Cloth Edge Alignment and Placement | Easy | 28.00 / 28.00% | 30.00 / 30.00% | 26.00 / 26.00% |
| Medium | 1.00 / 1.00% | 0.00 / 0.00% | 2.00 / 2.00% | |
| Hard | 1.00 / 1.00% | 2.00 / 2.00% | 0.00 / 0.00% | |
| PR5Oriented Stamp Placement | Easy | 2.10 / 0.00% | 2.70 / 0.00% | 1.50 / 0.00% |
| Medium | 1.21 / 0.00% | 1.32 / 0.00% | 1.10 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR6Domino Chain Bell Ringing | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
Mind2Act
| Task | Mean | Clean | Random |
|---|---|---|---|
| CPMind–action coordination | 5.08 / 3.63% | 6.21 / 4.53% | 3.96 / 2.73% |
| CP01Conveyor Meal Assembly | 11.85 / 8.67% | 13.91 / 10.00% | 9.79 / 7.33% |
| CP02Rotating Cake Decoration | 0.78 / 0.67% | 1.49 / 1.33% | 0.07 / 0.00% |
| CP03Dynamic Rack Loading | 1.20 / 0.00% | 1.20 / 0.00% | 1.21 / 0.00% |
| CP04Dual-Arm Cooking | 0.26 / 0.00% | 0.21 / 0.00% | 0.31 / 0.00% |
| CP05Keyboard Sequence Reproduction | 1.18 / 0.00% | 1.29 / 0.00% | 1.07 / 0.00% |
| CP06Produce Weighing and Balancing | 26.35 / 20.67% | 28.04 / 22.00% | 24.66 / 19.33% |
| CP07Bridge Construction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP08Reference-Guided Block Construction | 7.73 / 6.00% | 14.88 / 12.00% | 0.59 / 0.00% |
| CP09Whiteboard Drawing Reconstruction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP10Predictive Ball Return and Red-Ball Avoidance | 1.47 / 0.33% | 1.04 / 0.00% | 1.90 / 0.67% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| CP01Conveyor Meal Assembly | Easy | 24.15 / 20.00% | 26.10 / 22.00% | 22.20 / 18.00% |
| Medium | 8.17 / 5.00% | 10.23 / 6.00% | 6.10 / 4.00% | |
| Hard | 3.22 / 1.00% | 5.39 / 2.00% | 1.06 / 0.00% | |
| CP02Rotating Cake Decoration | Easy | 2.11 / 2.00% | 4.22 / 4.00% | 0.00 / 0.00% |
| Medium | 0.15 / 0.00% | 0.13 / 0.00% | 0.17 / 0.00% | |
| Hard | 0.08 / 0.00% | 0.12 / 0.00% | 0.05 / 0.00% | |
| CP03Dynamic Rack Loading | Easy | 1.95 / 0.00% | 1.30 / 0.00% | 2.60 / 0.00% |
| Medium | 1.42 / 0.00% | 1.88 / 0.00% | 0.96 / 0.00% | |
| Hard | 0.24 / 0.00% | 0.42 / 0.00% | 0.06 / 0.00% | |
| CP04Dual-Arm Cooking | Easy | 0.45 / 0.00% | 0.45 / 0.00% | 0.45 / 0.00% |
| Medium | 0.20 / 0.00% | 0.10 / 0.00% | 0.30 / 0.00% | |
| Hard | 0.14 / 0.00% | 0.09 / 0.00% | 0.19 / 0.00% | |
| CP05Keyboard Sequence Reproduction | Easy | 2.98 / 0.00% | 3.30 / 0.00% | 2.66 / 0.00% |
| Medium | 0.35 / 0.00% | 0.35 / 0.00% | 0.35 / 0.00% | |
| Hard | 0.21 / 0.00% | 0.23 / 0.00% | 0.19 / 0.00% | |
| CP06Produce Weighing and Balancing | Easy | 51.35 / 46.00% | 53.80 / 48.00% | 48.90 / 44.00% |
| Medium | 21.82 / 16.00% | 23.90 / 18.00% | 19.75 / 14.00% | |
| Hard | 5.87 / 0.00% | 6.41 / 0.00% | 5.32 / 0.00% | |
| CP07Bridge Construction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP08Reference-Guided Block Construction | Easy | 19.25 / 17.00% | 37.30 / 34.00% | 1.20 / 0.00% |
| Medium | 2.95 / 1.00% | 5.45 / 2.00% | 0.45 / 0.00% | |
| Hard | 0.99 / 0.00% | 1.88 / 0.00% | 0.11 / 0.00% | |
| CP09Whiteboard Drawing Reconstruction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP10Predictive Ball Return and Red-Ball Avoidance | Easy | 3.40 / 1.00% | 2.10 / 0.00% | 4.70 / 2.00% |
| Medium | 0.72 / 0.00% | 0.70 / 0.00% | 0.75 / 0.00% | |
| Hard | 0.29 / 0.00% | 0.33 / 0.00% | 0.26 / 0.00% |
Efficiency
- Avg. task time
- 8.6 min
- Avg. inference time
- 77.1 ms
- Inference hardware
- RTX PRO 5000 · 72GB
Mind · Act · Mind2Act
| Tasks | Avg. task time |
|---|---|
| Mind | 5.7 min |
| Act | 6.5 min |
| Mind2Act | 13.5 min |