Gemini 4 Argon
Results reported
Results
Score / Success
| Suite | Mean | Clean | Random |
|---|---|---|---|
| Overall | 4.36 / 4.67% | 4.77 / 5.33% | 3.94 / 4.00% |
| Mind | 4.97 / 4.33% | 5.73 / 5.33% | 4.21 / 3.33% |
| Act | 12.25 / 9.67% | 13.15 / 10.67% | 11.36 / 8.67% |
| Mind2Act | 0.10 / 0.00% | 0.11 / 0.00% | 0.09 / 0.00% |
Task results
Score / Success · Averages across Easy, Medium and Hard.
Mind
| Task | Mean | Clean | Random |
|---|---|---|---|
| EEntity memory | 8.48 / 6.67% | 8.08 / 6.67% | 8.88 / 6.67% |
| E1Duplicate Item Identification | 7.00 / 6.67% | 6.67 / 6.67% | 7.33 / 6.67% |
| E2Object-Code Keypad Entry | 9.96 / 6.67% | 9.49 / 6.67% | 10.42 / 6.67% |
| PProcess memory | 0.75 / 0.00% | 0.50 / 0.00% | 1.00 / 0.00% |
| P1Order-Based Meal Assembly | 1.50 / 0.00% | 1.00 / 0.00% | 2.00 / 0.00% |
| P2Steamer Stack Order Reconstruction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| SSpatial memory | 5.09 / 5.00% | 6.67 / 6.67% | 3.52 / 3.33% |
| S1Rotating Tray Layout Reconstruction | 0.18 / 0.00% | 0.00 / 0.00% | 0.37 / 0.00% |
| S2Hidden-Zone Navigation | 10.00 / 10.00% | 13.33 / 13.33% | 6.67 / 6.67% |
| FFeedback-rule learning | 5.25 / 5.00% | 10.00 / 10.00% | 0.50 / 0.00% |
| F1Unknown Button Mapping and Slider Navigation | 7.17 / 6.67% | 13.33 / 13.33% | 1.00 / 0.00% |
| F2Color-Block Trial Ordering | 3.33 / 3.33% | 6.67 / 6.67% | 0.00 / 0.00% |
| MIntegrated memory | 5.28 / 5.00% | 3.40 / 3.33% | 7.17 / 6.67% |
| M1Workpiece Tracking and Route Reproduction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| M2Memory Card Matching | 10.56 / 10.00% | 6.79 / 6.67% | 14.33 / 13.33% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| E1Duplicate Item Identification | Easy | 20.00 / 20.00% | 20.00 / 20.00% | 20.00 / 20.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 1.00 / 0.00% | 0.00 / 0.00% | 2.00 / 0.00% | |
| E2Object-Code Keypad Entry | Easy | 13.00 / 10.00% | 6.00 / 0.00% | 20.00 / 20.00% |
| Medium | 15.87 / 10.00% | 21.47 / 20.00% | 10.27 / 0.00% | |
| Hard | 1.00 / 0.00% | 1.00 / 0.00% | 1.00 / 0.00% | |
| P1Order-Based Meal Assembly | Easy | 4.50 / 0.00% | 3.00 / 0.00% | 6.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| P2Steamer Stack Order Reconstruction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| S1Rotating Tray Layout Reconstruction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.55 / 0.00% | 0.00 / 0.00% | 1.10 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| S2Hidden-Zone Navigation | Easy | 30.00 / 30.00% | 40.00 / 40.00% | 20.00 / 20.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| F1Unknown Button Mapping and Slider Navigation | Easy | 11.50 / 10.00% | 20.00 / 20.00% | 3.00 / 0.00% |
| Medium | 10.00 / 10.00% | 20.00 / 20.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| F2Color-Block Trial Ordering | Easy | 10.00 / 10.00% | 20.00 / 20.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| M1Workpiece Tracking and Route Reproduction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| M2Memory Card Matching | Easy | 31.50 / 30.00% | 20.00 / 20.00% | 43.00 / 40.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.19 / 0.00% | 0.38 / 0.00% | 0.00 / 0.00% |
Act
| Task | Mean | Clean | Random |
|---|---|---|---|
| DRDynamic response | 14.01 / 10.83% | 13.28 / 10.00% | 14.75 / 11.67% |
| DR1Continuous Conveyor Picking | 4.07 / 0.00% | 3.15 / 0.00% | 4.99 / 0.00% |
| DR2Light-Guided Button Response | 11.98 / 3.33% | 16.63 / 6.67% | 7.33 / 0.00% |
| DR3Periodic Gate Crossing and Withdrawal | 40.00 / 40.00% | 33.33 / 33.33% | 46.67 / 46.67% |
| DR4Ball-on-Tray Transport and Placement | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| PRPrecise execution | 11.08 / 8.89% | 13.07 / 11.11% | 9.10 / 6.67% |
| PR1Linear Resistor Adjustment | 47.98 / 40.00% | 46.25 / 40.00% | 49.71 / 40.00% |
| PR2Rotary Voltage Regulator Setting | 18.52 / 13.33% | 32.16 / 26.67% | 4.87 / 0.00% |
| PR3Marker Line Tracing | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| PR4Cloth Edge Alignment and Placement | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| PR5Oriented Stamp Placement | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| PR6Domino Chain Bell Ringing | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| DR1Continuous Conveyor Picking | Easy | 7.00 / 0.00% | 6.00 / 0.00% | 8.00 / 0.00% |
| Medium | 2.64 / 0.00% | 0.88 / 0.00% | 4.40 / 0.00% | |
| Hard | 2.57 / 0.00% | 2.57 / 0.00% | 2.57 / 0.00% | |
| DR2Light-Guided Button Response | Easy | 12.90 / 0.00% | 17.40 / 0.00% | 8.40 / 0.00% |
| Medium | 17.48 / 10.00% | 25.28 / 20.00% | 9.68 / 0.00% | |
| Hard | 5.55 / 0.00% | 7.20 / 0.00% | 3.90 / 0.00% | |
| DR3Periodic Gate Crossing and Withdrawal | Easy | 40.00 / 40.00% | 40.00 / 40.00% | 40.00 / 40.00% |
| Medium | 40.00 / 40.00% | 20.00 / 20.00% | 60.00 / 60.00% | |
| Hard | 40.00 / 40.00% | 40.00 / 40.00% | 40.00 / 40.00% | |
| DR4Ball-on-Tray Transport and Placement | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR1Linear Resistor Adjustment | Easy | 43.78 / 30.00% | 55.15 / 40.00% | 32.42 / 20.00% |
| Medium | 38.93 / 30.00% | 43.61 / 40.00% | 34.25 / 20.00% | |
| Hard | 61.23 / 60.00% | 40.00 / 40.00% | 82.46 / 80.00% | |
| PR2Rotary Voltage Regulator Setting | Easy | 21.18 / 10.00% | 33.75 / 20.00% | 8.61 / 0.00% |
| Medium | 12.40 / 10.00% | 21.13 / 20.00% | 3.68 / 0.00% | |
| Hard | 21.97 / 20.00% | 41.60 / 40.00% | 2.34 / 0.00% | |
| PR3Marker Line Tracing | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR4Cloth Edge Alignment and Placement | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR5Oriented Stamp Placement | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| PR6Domino Chain Bell Ringing | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
Mind2Act
| Task | Mean | Clean | Random |
|---|---|---|---|
| CPMind–action coordination | 0.10 / 0.00% | 0.11 / 0.00% | 0.09 / 0.00% |
| CP01Conveyor Meal Assembly | 0.33 / 0.00% | 0.67 / 0.00% | 0.00 / 0.00% |
| CP02Rotating Cake Decoration | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP03Dynamic Rack Loading | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP04Dual-Arm Cooking | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP05Keyboard Sequence Reproduction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP06Produce Weighing and Balancing | 0.58 / 0.00% | 0.33 / 0.00% | 0.83 / 0.00% |
| CP07Bridge Construction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP08Reference-Guided Block Construction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP09Whiteboard Drawing Reconstruction | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| CP10Predictive Ball Return and Red-Ball Avoidance | 0.08 / 0.00% | 0.08 / 0.00% | 0.08 / 0.00% |
Results by difficulty
| Task | Level | Mean | Clean | Random |
|---|---|---|---|---|
| CP01Conveyor Meal Assembly | Easy | 1.00 / 0.00% | 2.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP02Rotating Cake Decoration | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP03Dynamic Rack Loading | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP04Dual-Arm Cooking | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP05Keyboard Sequence Reproduction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP06Produce Weighing and Balancing | Easy | 1.50 / 0.00% | 1.00 / 0.00% | 2.00 / 0.00% |
| Medium | 0.25 / 0.00% | 0.00 / 0.00% | 0.50 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP07Bridge Construction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP08Reference-Guided Block Construction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP09Whiteboard Drawing Reconstruction | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| CP10Predictive Ball Return and Red-Ball Avoidance | Easy | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% |
| Medium | 0.00 / 0.00% | 0.00 / 0.00% | 0.00 / 0.00% | |
| Hard | 0.23 / 0.00% | 0.23 / 0.00% | 0.23 / 0.00% |
Efficiency
- Avg. cost per attempt
- ≈ ¥7.83
- Avg. task time
- 18.0 min
- Avg. response time
- 27.8 s
Mind · Act · Mind2Act
| Tasks | Avg. cost per attempt | Avg. task time | Avg. response time |
|---|---|---|---|
| Mind | ≈ ¥7.43 | 15.2 min | 26.8 s |
| Act | ≈ ¥7.24 | 15.8 min | 23.8 s |
| Mind2Act | ≈ ¥8.81 | 22.9 min | 32.0 s |
Usage totals
Evaluation cost
900 selected official episodes across Clean and Random.
| Metric | Recorded total | Coverage |
|---|---|---|
| Model decisions | 29,628 | 900 / 900 episodes |
| API request attempts | 29,998 | 900 / 900 episodes |
| Upstream requests | 29,998 | 29,998 / 29,998 requests |
| Input tokens | 688,190,635 | 29,628 / 29,998 requests |
| Output tokens | 2,757,409 | 29,628 / 29,998 requests |
| Cached input tokens (included) | 209,113,683 | 29,624 / 29,998 requests |
| Reasoning output tokens (included) | 522,311 | 29,578 / 29,998 requests |
| Cumulative API request time | 231 h 19 min 14 s | 29,998 / 29,998 requests |
| Cumulative inference time | 234 h 36 min 59 s | 900 / 900 episodes |
| Cumulative episode time | 269 h 34 min 17 s | 900 / 900 episodes |
| Cumulative run time | 289 h 41 min 39 s | 900 / 900 episodes |
| Estimated API cost | CNY 7,044.21 | 29,624 / 29,998 requests |
Cost basis
Recorded requests with complete input, cached-input and output usage.
CNY per 1M tokens: input 14; cached input 0.7; output 70.
Cost = uncached input × input rate + cached input × cache rate + output × output rate.
API platform billing, 1–10 Nov 2026.