End-to-end Leaderboard (VLA / WAM)

π0.5

VLAPhysical Intelligence

Results reported

Results

Score / Success

SuiteMeanCleanRandom
Overall7.63 / 6.38%8.94 / 7.56%6.32 / 5.20%
Mind4.46 / 3.50%6.60 / 5.47%2.32 / 1.53%
Act15.88 / 12.00%16.75 / 12.67%15.02 / 11.33%
Mind2Act5.08 / 3.63%6.21 / 4.53%3.96 / 2.73%

Task results

Score / Success · Averages across Easy, Medium and Hard.

Mind

TaskMeanCleanRandom
EEntity memory2.97 / 0.50%3.27 / 0.67%2.66 / 0.33%
E1Duplicate Item Identification3.74 / 1.00%4.25 / 1.33%3.23 / 0.67%
E2Object-Code Keypad Entry2.19 / 0.00%2.30 / 0.00%2.09 / 0.00%
PProcess memory9.23 / 7.67%15.85 / 14.00%2.61 / 1.33%
P1Order-Based Meal Assembly1.29 / 1.00%0.93 / 0.67%1.64 / 1.33%
P2Steamer Stack Order Reconstruction17.18 / 14.33%30.78 / 27.33%3.58 / 1.33%
SSpatial memory3.79 / 3.67%4.77 / 4.67%2.82 / 2.67%
S1Rotating Tray Layout Reconstruction0.25 / 0.00%0.20 / 0.00%0.31 / 0.00%
S2Hidden-Zone Navigation7.33 / 7.33%9.33 / 9.33%5.33 / 5.33%
FFeedback-rule learning4.72 / 4.67%6.05 / 6.00%3.38 / 3.33%
F1Unknown Button Mapping and Slider Navigation5.77 / 5.67%8.10 / 8.00%3.43 / 3.33%
F2Color-Block Trial Ordering3.67 / 3.67%4.00 / 4.00%3.33 / 3.33%
MIntegrated memory1.59 / 1.00%3.05 / 2.00%0.14 / 0.00%
M1Workpiece Tracking and Route Reproduction0.03 / 0.00%0.00 / 0.00%0.05 / 0.00%
M2Memory Card Matching3.16 / 2.00%6.09 / 4.00%0.23 / 0.00%
Results by difficulty
TaskLevelMeanCleanRandom
E1Duplicate Item IdentificationEasy7.80 / 3.00%8.80 / 4.00%6.80 / 2.00%
Medium2.37 / 0.00%2.64 / 0.00%2.09 / 0.00%
Hard1.05 / 0.00%1.30 / 0.00%0.80 / 0.00%
E2Object-Code Keypad EntryEasy3.15 / 0.00%3.30 / 0.00%3.00 / 0.00%
Medium1.98 / 0.00%2.20 / 0.00%1.76 / 0.00%
Hard1.45 / 0.00%1.40 / 0.00%1.50 / 0.00%
P1Order-Based Meal AssemblyEasy0.38 / 0.00%0.45 / 0.00%0.30 / 0.00%
Medium1.22 / 1.00%0.11 / 0.00%2.33 / 2.00%
Hard2.26 / 2.00%2.23 / 2.00%2.30 / 2.00%
P2Steamer Stack Order ReconstructionEasy25.20 / 22.00%47.40 / 44.00%3.00 / 0.00%
Medium21.45 / 18.00%36.64 / 32.00%6.25 / 4.00%
Hard4.90 / 3.00%8.30 / 6.00%1.50 / 0.00%
S1Rotating Tray Layout ReconstructionEasy0.30 / 0.00%0.30 / 0.00%0.30 / 0.00%
Medium0.28 / 0.00%0.22 / 0.00%0.33 / 0.00%
Hard0.19 / 0.00%0.07 / 0.00%0.30 / 0.00%
S2Hidden-Zone NavigationEasy20.00 / 20.00%24.00 / 24.00%16.00 / 16.00%
Medium2.00 / 2.00%4.00 / 4.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
F1Unknown Button Mapping and Slider NavigationEasy17.30 / 17.00%24.30 / 24.00%10.30 / 10.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
F2Color-Block Trial OrderingEasy10.00 / 10.00%12.00 / 12.00%8.00 / 8.00%
Medium1.00 / 1.00%0.00 / 0.00%2.00 / 2.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
M1Workpiece Tracking and Route ReproductionEasy0.07 / 0.00%0.00 / 0.00%0.15 / 0.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
M2Memory Card MatchingEasy7.95 / 6.00%15.60 / 12.00%0.30 / 0.00%
Medium1.43 / 0.00%2.53 / 0.00%0.33 / 0.00%
Hard0.11 / 0.00%0.15 / 0.00%0.07 / 0.00%

Act

TaskMeanCleanRandom
DRDynamic response28.62 / 22.92%30.33 / 24.17%26.91 / 21.67%
DR1Continuous Conveyor Picking20.94 / 13.00%24.61 / 15.33%17.27 / 10.67%
DR2Light-Guided Button Response14.85 / 0.00%15.33 / 0.00%14.37 / 0.00%
DR3Periodic Gate Crossing and Withdrawal78.69 / 78.67%81.37 / 81.33%76.00 / 76.00%
DR4Ball-on-Tray Transport and Placement0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
PRPrecise execution7.39 / 4.72%7.69 / 5.00%7.10 / 4.44%
PR1Linear Resistor Adjustment28.77 / 16.33%29.45 / 17.33%28.09 / 15.33%
PR2Rotary Voltage Regulator Setting3.42 / 1.00%2.70 / 0.00%4.14 / 2.00%
PR3Marker Line Tracing1.07 / 1.00%2.00 / 2.00%0.15 / 0.00%
PR4Cloth Edge Alignment and Placement10.00 / 10.00%10.67 / 10.67%9.33 / 9.33%
PR5Oriented Stamp Placement1.10 / 0.00%1.34 / 0.00%0.87 / 0.00%
PR6Domino Chain Bell Ringing0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Results by difficulty
TaskLevelMeanCleanRandom
DR1Continuous Conveyor PickingEasy47.10 / 34.00%48.80 / 36.00%45.40 / 32.00%
Medium12.96 / 5.00%21.35 / 10.00%4.58 / 0.00%
Hard2.76 / 0.00%3.69 / 0.00%1.84 / 0.00%
DR2Light-Guided Button ResponseEasy21.06 / 0.00%21.96 / 0.00%20.16 / 0.00%
Medium14.10 / 0.00%14.48 / 0.00%13.73 / 0.00%
Hard9.38 / 0.00%9.54 / 0.00%9.21 / 0.00%
DR3Periodic Gate Crossing and WithdrawalEasy76.00 / 76.00%78.00 / 78.00%74.00 / 74.00%
Medium81.06 / 81.00%86.11 / 86.00%76.00 / 76.00%
Hard79.00 / 79.00%80.00 / 80.00%78.00 / 78.00%
DR4Ball-on-Tray Transport and PlacementEasy0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
PR1Linear Resistor AdjustmentEasy43.35 / 23.00%45.93 / 26.00%40.77 / 20.00%
Medium24.57 / 13.00%26.95 / 16.00%22.18 / 10.00%
Hard18.40 / 13.00%15.48 / 10.00%21.32 / 16.00%
PR2Rotary Voltage Regulator SettingEasy7.96 / 2.00%6.41 / 0.00%9.50 / 4.00%
Medium2.17 / 1.00%1.61 / 0.00%2.73 / 2.00%
Hard0.14 / 0.00%0.07 / 0.00%0.20 / 0.00%
PR3Marker Line TracingEasy3.00 / 3.00%6.00 / 6.00%0.00 / 0.00%
Medium0.22 / 0.00%0.00 / 0.00%0.44 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
PR4Cloth Edge Alignment and PlacementEasy28.00 / 28.00%30.00 / 30.00%26.00 / 26.00%
Medium1.00 / 1.00%0.00 / 0.00%2.00 / 2.00%
Hard1.00 / 1.00%2.00 / 2.00%0.00 / 0.00%
PR5Oriented Stamp PlacementEasy2.10 / 0.00%2.70 / 0.00%1.50 / 0.00%
Medium1.21 / 0.00%1.32 / 0.00%1.10 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
PR6Domino Chain Bell RingingEasy0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%

Mind2Act

TaskMeanCleanRandom
CPMind–action coordination5.08 / 3.63%6.21 / 4.53%3.96 / 2.73%
CP01Conveyor Meal Assembly11.85 / 8.67%13.91 / 10.00%9.79 / 7.33%
CP02Rotating Cake Decoration0.78 / 0.67%1.49 / 1.33%0.07 / 0.00%
CP03Dynamic Rack Loading1.20 / 0.00%1.20 / 0.00%1.21 / 0.00%
CP04Dual-Arm Cooking0.26 / 0.00%0.21 / 0.00%0.31 / 0.00%
CP05Keyboard Sequence Reproduction1.18 / 0.00%1.29 / 0.00%1.07 / 0.00%
CP06Produce Weighing and Balancing26.35 / 20.67%28.04 / 22.00%24.66 / 19.33%
CP07Bridge Construction0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
CP08Reference-Guided Block Construction7.73 / 6.00%14.88 / 12.00%0.59 / 0.00%
CP09Whiteboard Drawing Reconstruction0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
CP10Predictive Ball Return and Red-Ball Avoidance1.47 / 0.33%1.04 / 0.00%1.90 / 0.67%
Results by difficulty
TaskLevelMeanCleanRandom
CP01Conveyor Meal AssemblyEasy24.15 / 20.00%26.10 / 22.00%22.20 / 18.00%
Medium8.17 / 5.00%10.23 / 6.00%6.10 / 4.00%
Hard3.22 / 1.00%5.39 / 2.00%1.06 / 0.00%
CP02Rotating Cake DecorationEasy2.11 / 2.00%4.22 / 4.00%0.00 / 0.00%
Medium0.15 / 0.00%0.13 / 0.00%0.17 / 0.00%
Hard0.08 / 0.00%0.12 / 0.00%0.05 / 0.00%
CP03Dynamic Rack LoadingEasy1.95 / 0.00%1.30 / 0.00%2.60 / 0.00%
Medium1.42 / 0.00%1.88 / 0.00%0.96 / 0.00%
Hard0.24 / 0.00%0.42 / 0.00%0.06 / 0.00%
CP04Dual-Arm CookingEasy0.45 / 0.00%0.45 / 0.00%0.45 / 0.00%
Medium0.20 / 0.00%0.10 / 0.00%0.30 / 0.00%
Hard0.14 / 0.00%0.09 / 0.00%0.19 / 0.00%
CP05Keyboard Sequence ReproductionEasy2.98 / 0.00%3.30 / 0.00%2.66 / 0.00%
Medium0.35 / 0.00%0.35 / 0.00%0.35 / 0.00%
Hard0.21 / 0.00%0.23 / 0.00%0.19 / 0.00%
CP06Produce Weighing and BalancingEasy51.35 / 46.00%53.80 / 48.00%48.90 / 44.00%
Medium21.82 / 16.00%23.90 / 18.00%19.75 / 14.00%
Hard5.87 / 0.00%6.41 / 0.00%5.32 / 0.00%
CP07Bridge ConstructionEasy0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
CP08Reference-Guided Block ConstructionEasy19.25 / 17.00%37.30 / 34.00%1.20 / 0.00%
Medium2.95 / 1.00%5.45 / 2.00%0.45 / 0.00%
Hard0.99 / 0.00%1.88 / 0.00%0.11 / 0.00%
CP09Whiteboard Drawing ReconstructionEasy0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Medium0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
Hard0.00 / 0.00%0.00 / 0.00%0.00 / 0.00%
CP10Predictive Ball Return and Red-Ball AvoidanceEasy3.40 / 1.00%2.10 / 0.00%4.70 / 2.00%
Medium0.72 / 0.00%0.70 / 0.00%0.75 / 0.00%
Hard0.29 / 0.00%0.33 / 0.00%0.26 / 0.00%

Efficiency

Avg. task time
8.6 min
Avg. inference time
77.1 ms
Inference hardware
RTX PRO 5000 · 72GB
Mind · Act · Mind2Act
TasksAvg. task time
Mind5.7 min
Act6.5 min
Mind2Act13.5 min