2048 - the sliding-tile game
Run of , staffed by a mixed roster (google + meta). Combines Muse Spark (primary) with minority vendors for cost savings - composite 59.58.
The verdict.
58.94 composite · rubric v15
- duration
- 218 min
- requests
- 2570
- failed requests
- 13 (0.51%)
- cost
- $99.16
Scores come from the open scoring pipeline - methodology and leaderboards at Favur Evals ↗
Per-subject scores.
| subject | score |
|---|---|
| code quality | 32.42 |
| cost efficiency | 33.48 |
| deliverables | 36.6 |
| effort efficiency | 44.49 |
| process discipline | 48.44 |
| test quality | 48.63 |
| tool discipline | 83.63 |
| velocity | 52.13 |
Who staffed it.
| role | model |
|---|---|
| code | meta/muse-spark-1.2 |
| spec | meta/muse-spark-1.2 |
| test | google/gemini-3.5-flash-lite |
| build | google/gemini-3.5-flash-lite |
| scout | meta/muse-spark-1.2 |
| develop | google/gemini-3.5-flash-lite |
| platform | meta/muse-spark-1.2 |
| architect | meta/muse-spark-1.2 |
| concierge | google/gemini-3.5-flash-lite |
| pseudocode | meta/muse-spark-1.2 |
| code-review | meta/muse-spark-1.2 |
| sprint-plan | meta/muse-spark-1.2 |
| orchestrator | google/gemini-3.5-flash-lite |
| sprint-review | meta/muse-spark-1.2 |
What shipped.
- tests
- 57/93 passing
- source
- 1533 lines
- test code
- 978 lines
- coverage
- 46.15%