🎮 Lmgame Bench: Leaderboard 🎲

Comparative Analysis (Radar Chart)

💡 Click a legend entry to isolate that model. Double-click additional ones to add them for comparison.

⏰ Time Tracker

03/25/2025

🔄 Controls

All data analysis can be replicated by checking this Jupyter notebook

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
gamingagent + gemini-2.5-flash-preview-04-17 (thinking)	anthropic	1498.3	2.33	3586.67	491.67	33.67	3.67

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
1	gamingagent + o3-2025-04-16	openai	3445	8	7120	647	42	16
2	gamingagent + o1-2024-12-17	openai	855	2.33	7580	159	35	16
3	gamingagent + o4-mini-2025-04-16	openai	1448	5.33	4432	487.3	25.3	4
4	gamingagent + deepseek-r1-0528	deepseek	n/a	4.67	3330	491.67	33.67	n/a
5	gamingagent + gemini-2.5-pro-preview-05-06 (thinking)	google	1498.3	4.33	3586.67	416.3	23.3	7
6	gamingagent + grok-3-mini-beta (thinking)	xai	n/a	5.67	4036	254	21.3	0
7	gamingagent + claude-3-7-sonnet-20250219 (thinking)	anthropic	1418.7	2.33	2624	484	16.3	7
8	gamingagent + claude-sonnet-4-20250514	anthropic	n/a	3	3136	478.33	19.33	3.67
9	gamingagent + claude-opus-4-20250514	anthropic	n/a	4	3036	464	20	6
10	gamingagent + gpt-4.1-2025-04-14	openai	2126.3	0	1656	182	13.7	2
11	gamingagent + gpt-4o-2024-11-20	openai	2047.3	0	1656	147.3	14	0
12	gamingagent + qwen3-235B-A22B-fp8	unknown	n/a	2.33	2144	363.33	11.67	n/a
13	gamingagent + gemini-2.5-flash-preview-04-17 (thinking)	google	1385	1.67	1697.33	334.7	16.3	4
14	gamingagent + o1-mini-2024-09-12	openai	n/a	1.33	2757.33	48	11.7	0
15	gamingagent + claude-3-5-sonnet-20241022	anthropic	1267.7	0	1914.67	106	14.7	2
16	gamingagent + llama-4-maverick-17b-128e-instruct-fp8	meta	1468.7	0	1586.67	128.7	10.3	0
17	gamingagent + deepseek-r1-0120	deepseek	n/a	1.33	1873.33	447.3	14.3	0
18	random (x30)	unknown	986.97	0	1213.33	116.5	10.2	0
19	gamingagent + gemini-2.5-flash-preview-05-20	google	n/a	n/a	n/a	n/a	n/a	4.33

Note: 'n/a' in the table indicates no data point for that model.

	Player	Organization	Super Mario Bros Score	Sokoban Score	2048 Score	Candy Crush Score	Tetris Score	Ace Attorney Score
1	claude-sonnet-4-20250514	anthropic	n/a	0	3844	557.67	13.67	1.33
2	gemini-2.5-flash-preview-05-20	google	n/a	0	2750	254	16	2.33
3	o3-2025-04-16	openai	1955	2	128.2	106	31	8
4	gpt-4.1-2025-04-14	openai	1991.3	0	94.5	101	13	0
5	gemini-2.5-flash-preview-04-17 (thinking)	google	1540.7	0	97.7	97.7	19	1
6	claude-3-7-sonnet-20250219 (thinking)	anthropic	1430	0	126.3	126.3	13	3
7	o1-2024-12-17	openai	1434	0	128.1	90	13	3
8	claude-3-5-sonnet-20241022	anthropic	1540	0	17	17	12.3	1
9	o4-mini-2025-04-16	openai	1348.3	1.33	97.6	110.7	15	2
10	gemini-2.5-pro-preview-05-06 (thinking)	google	1025.3	1	120.5	177.3	12.3	8
11	random (x30)	unknown	986.97	0	100.4	116.5	10.2	0
12	gpt-4o-2024-11-20	openai	1028.3	0	70.4	59	14.7	0
13	llama-4-maverick-17b-128e-instruct-fp8	meta	786	0	44.6	32.3	11.7	0
14	gemini-2.5-pro-preview-06-05	google	n/a	0.33	1	496	12	n/a