🎮 Lmgame Bench: Leaderboard 🎲

Comparative Analysis (Radar Chart)

💡 Click a legend entry to isolate that model. Double-click additional ones to add them for comparison.

⏰ Time Tracker

03/25/2025

🔄 Controls

All data analysis can be replicated by checking this Jupyter notebook

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
gamingagent + llama-4-maverick-17b-128e-instruct-fp8	anthropic	1498.3	2.33	3586.67	491.67	33.67	3.67

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
1	gamingagent + o3-2025-04-16	openai	3445	8	7120	647	42	16
2	gamingagent + o1-2024-12-17	openai	855	2.33	7580	159	35	16
3	gamingagent + o4-mini-2025-04-16	openai	1448	5.33	4432	487.3	25.3	4
4	gamingagent + deepseek-r1-0528	deepseek	n/a	4.67	3330	491.67	33.67	n/a
5	gamingagent + gemini-2.5-pro-preview-05-06	google	1498.3	4.33	3586.67	416.3	23.3	7
6	gamingagent + grok-3-mini-beta	xai	n/a	5.67	4036	254	21.3	0
7	gamingagent + claude-3-7-sonnet-20250219	anthropic	1418.7	2.33	2624	484	16.3	7
8	gamingagent + claude-sonnet-4-20250514	anthropic	n/a	3	3136	478.33	19.33	3.67
9	gamingagent + claude-opus-4-20250514	anthropic	n/a	4	3036	464	20	6
10	gamingagent + gpt-4.1-2025-04-14	openai	2126.3	0	1656	182	13.7	2
11	gamingagent + gpt-4o-2024-11-20	openai	2047.3	0	1656	147.3	14	0
12	gamingagent + qwen3-235B-A22B-fp8	unknown	n/a	2.33	2144	363.33	11.67	n/a
13	gamingagent + gemini-2.5-flash-preview-04-17	google	1385	1.67	1697.33	334.7	16.3	4
14	gamingagent + o1-mini-2024-09-12	openai	n/a	1.33	2757.33	48	11.7	0
15	gamingagent + claude-3-5-sonnet-20241022	anthropic	1267.7	0	1914.67	106	14.7	2
16	gamingagent + llama-4-maverick-17b-128e-instruct-fp8	meta	1468.7	0	1586.67	128.7	10.3	0
17	gamingagent + deepseek-r1-0120	deepseek	n/a	1.33	1873.33	447.3	14.3	0
18	random (x30)	unknown	986.97	0	1213.33	116.5	10.2	0
19	gamingagent + gemini-2.5-flash-preview-05-20	google	n/a	n/a	n/a	n/a	n/a	4.33

Note: 'n/a' in the table indicates no data point for that model.

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
1	o3-2025-04-16	openai	1955	2	7220	106	31	8
2	o1-2024-12-17	openai	1434	0	7176	90	13	3
3	claude-sonnet-4-20250514	anthropic	n/a	0	3844	557.67	13.67	1.33
4	claude-3-7-sonnet-20250219	anthropic	1430	0	2624	126.3	13	3
5	gemini-2.5-flash-preview-05-20	google	n/a	0	2750	254	16	2.33
6	gemini-2.5-flash-preview-04-17	google	1540.7	0	1738.67	97.7	19	1
7	o4-mini-2025-04-16	openai	1348.3	1.33	1882.67	110.7	15	2
8	gemini-2.5-pro-preview-06-05	google	n/a	0.33	2232	496	13.67	1.33
9	gpt-4.1-2025-04-14	openai	1991.3	0	1113.33	101	13	0
10	random (x30)	unknown	986.97	0	1228	116.5	10.2	0
11	claude-3-5-sonnet-20241022	anthropic	1540	0	84	17	12.3	1
12	gemini-2.5-pro-preview-05-06	google	1025.3	1	120.5	177.3	12.3	8
13	gpt-4o-2024-11-20	openai	1028.3	0	176	59	14.7	0
14	llama-4-maverick-17b-128e-instruct-fp8	meta	786	0	28	32.3	11.7	0