Model Leaderboard

Viewing: December 1, 2024

LLM Model Performance Comparison
Rank	Model	Overall Score	Coding Style	Creative Writing Style	Full Style	Hard-6 Style	Coding	Creative Writing	Instruction Following	Math	Multi-turn	No Refusal	No Short	No Tie	Long User	Hard-6	Hard English-6	English	Chinese	French	German	Japanese	Korean	Russian	Spanish	Organization	Model Slug	Date	Cutoff Date	License	Battles
2.00	ChatGPT-4o-latest (2024-11-20)	1366.07	1306.48	1378.54	1317.14	1284.00	1353.87	1408.40	1356.36	1291.28	1403.13	1371.70	1367.71	1512.97	1377.98	1339.58	1326.59	1339.41	1444.96	1342.47	1367.65	1470.44	1542.08	1382.61	1339.58	OpenAI	chatgpt-4o-latest-20241120	12/1/2024	-	Proprietary	19888.00
3.00	ChatGPT-4o-latest (2024-09-03)	1339.36	1297.33	1341.20	1299.83	1282.73	1338.50	1366.80	1338.48	1274.33	1377.27	1344.05	1341.05	1471.43	1364.36	1331.66	1320.49	1319.20	1422.27	1305.82	1322.19	1447.31	1426.58	1346.99	1320.36	OpenAI	chatgpt-4o-latest-20240903	12/1/2024	2023/10	Proprietary	48935.00
3.00	o1-preview	1333.91	1309.87	1314.89	1301.46	1308.11	1354.10	1318.36	1346.36	1340.20	1366.87	1345.18	1335.59	1454.18	1351.17	1351.69	1352.78	1327.57	1380.68	1290.40	1303.74	1454.07	1409.82	1335.54	1297.92	OpenAI	o1-preview	12/1/2024	2023/10	Proprietary	29747.00
5.00	ChatGPT-4o-latest (2024-08-08)	1316.41	1295.25	1320.77	1291.87	1280.13	1324.45	1328.20	1320.62	1273.16	1346.47	1320.80	1318.31	1433.05	1344.06	1315.75	1305.99	1295.95	1373.02	1287.60	1317.70	1418.53	1400.28	1337.64	1310.70	OpenAI	chatgpt-4o-latest-20240808	12/1/2024	2023/10	Proprietary	35574.00
5.00	Gemini-Exp-1121	1363.95	1275.77	1322.18	1291.62	1283.05	1342.28	1390.13	1353.33	1307.52	1381.04	1368.13	1365.82	1501.48	1365.00	1344.14	1327.92	1331.89	1444.68	1361.16	1355.51	1481.39	1546.59	1379.18	1363.40	Google	gemini-exp-1121	12/1/2024	-	Proprietary	13583.00
7.00	Claude 3.5 Sonnet (20241022)	1282.96	1307.60	1316.81	1284.02	1299.41	1321.08	1290.10	1301.49	1280.91	1327.37	1289.11	1284.40	1375.88	1314.04	1303.29	1291.40	1256.49	1332.14	1245.70	1301.17	1393.60	1325.94	1323.64	1273.78	Anthropic	claude-3-5-sonnet-20241022	12/1/2024	2024/4	Proprietary	33295.00
13.00	Gemini-Exp-1114	1347.02	1266.59	1309.66	1272.19	1277.74	1325.86	1377.10	1341.79	1312.12	1367.54	1351.95	1349.01	1477.63	1352.21	1337.52	1322.36	1310.46	1450.64	1352.91	1372.28	1477.18	1501.75	1370.79	1286.22	Google	gemini-exp-1114	12/1/2024	-	Proprietary	16208.00
14.00	Gemini-1.5-Pro-002	1301.24	1253.66	1305.13	1267.20	1266.14	1289.91	1328.63	1301.55	1281.35	1299.58	1306.09	1302.49	1407.24	1316.02	1299.33	1282.20	1271.28	1389.89	1244.39	1284.46	1423.53	1415.62	1332.29	1299.12	Google	gemini-1.5-pro-002	12/1/2024	-	Proprietary	31240.00
14.00	Gemini-1.5-Pro-Exp-0801	1297.97	1253.17	1310.78	1270.04	1255.30	1277.13	1328.14	1290.10	1261.89	1305.46	1301.93	1299.19	1401.80	1299.52	1278.31	1261.55	1267.74	1369.59	1296.22	1290.81	1424.63	1398.67	1335.28	1296.92	Google	gemini-1.5-pro-exp-0801	12/1/2024	2023/11	Proprietary	26024.00
14.00	Gemini-1.5-Pro-Exp-0827	1299.24	1266.80	1299.40	1269.32	1262.13	1287.23	1320.13	1293.96	1273.28	1306.57	1303.90	1300.48	1407.90	1322.07	1288.24	1274.46	1268.28	1384.87	1278.09	1302.58	1423.68	1401.28	1342.70	1307.64	Google	gemini-1.5-pro-exp-0827	12/1/2024	2023/11	Proprietary	32312.00
20.00	GPT-4o-2024-05-13	1284.94	1264.62	1285.26	1262.68	1252.02	1292.90	1289.17	1287.58	1254.96	1301.99	1289.47	1286.58	1379.01	1300.60	1284.71	1275.53	1262.89	1334.84	1258.31	1277.24	1397.73	1369.73	1305.72	1283.59	OpenAI	gpt-4o-2024-05-13	12/1/2024	2023/10	Proprietary	115598.00
21.00	o1-mini	1307.41	1301.38	1230.84	1258.13	1283.30	1362.36	1245.82	1315.27	1327.64	1326.42	1316.22	1308.57	1416.21	1331.10	1340.06	1340.30	1297.27	1371.87	1259.02	1284.63	1384.64	1369.03	1309.04	1296.47	OpenAI	o1-mini	12/1/2024	2023/10	Proprietary	35691.00
22.00	Claude 3.5 Sonnet (20240620)	1268.02	1280.93	1255.72	1258.81	1269.92	1294.64	1242.03	1280.43	1271.59	1305.70	1276.12	1269.46	1351.93	1286.78	1279.32	1268.64	1241.19	1321.27	1245.09	1263.70	1369.79	1337.38	1303.06	1280.72	Anthropic	claude-3-5-sonnet-20240620	12/1/2024	2024/4	Proprietary	86447.00
23.00	Meta-Llama-3.1-405B-Instruct-bf16	1265.98	1263.60	1247.82	1251.73	1254.34	1283.94	1255.89	1265.94	1255.49	1289.21	1269.88	1266.60	1350.82	1275.65	1272.59	1275.65	1260.42	1288.72	1221.14	1247.79	1346.59	1309.28	1274.59	1248.41	Meta	llama-3.1-405b-instruct-bf16	12/1/2024	2023/12	Llama 3.1 Community	14541.00
24.00	Gemini Advanced App (2024-05-14)	1266.56	1238.83	1282.36	1253.57	1237.51	1254.82	1275.40	1259.31	1238.46	1273.30	1270.18	1267.54	1348.91	1263.41	1253.51	1235.13	1234.40	1332.21	1259.07	1268.54	1381.98	1371.20	1304.69	1238.89	Google	gemini-advanced-0514	12/1/2024	Online	Proprietary	52216.00
24.00	Meta-Llama-3.1-405B-Instruct-fp8	1267.50	1256.44	1257.10	1252.70	1248.30	1277.14	1264.80	1268.89	1248.64	1293.46	1271.42	1268.66	1352.87	1271.31	1266.94	1267.70	1260.89	1292.95	1221.84	1248.05	1316.80	1323.10	1286.13	1252.29	Meta	llama-3.1-405b-instruct-fp8	12/1/2024	2023/12	Llama 3.1 Community	56051.00
27.00	GPT-4o-2024-08-06	1264.72	1250.31	1273.77	1249.11	1238.37	1273.58	1273.22	1272.38	1252.97	1277.82	1269.90	1265.93	1347.43	1285.63	1266.98	1258.81	1244.45	1311.24	1222.31	1252.56	1372.80	1358.61	1289.38	1272.06	OpenAI	gpt-4o-2024-08-06	12/1/2024	2023/10	Proprietary	46335.00
29.00	Grok-2-08-13	1288.86	1255.56	1264.20	1249.10	1240.03	1284.94	1284.09	1277.15	1253.25	1295.30	1293.49	1290.38	1387.11	1287.44	1275.61	1265.61	1270.70	1347.91	1274.25	1284.35	1392.22	1368.03	1308.10	1276.57	xAI	grok-2-2024-08-13	12/1/2024	2024/3	Proprietary	54702.00
32.00	Yi-Lightning	1286.93	1261.02	1247.15	1245.32	1251.42	1302.64	1281.08	1285.92	1269.19	1315.40	1290.97	1288.32	1385.41	1305.10	1299.90	1297.52	1278.08	1374.71	1251.40	1261.11	1370.61	1334.26	1277.55	1309.15	01 AI	yi-lightning	12/1/2024	-	Proprietary	29201.00
36.00	GPT-4-Turbo-2024-04-09	1256.43	1239.72	1270.10	1241.79	1227.53	1262.80	1266.43	1260.10	1242.03	1267.70	1260.71	1258.07	1332.13	1263.99	1254.30	1247.98	1241.15	1301.13	1228.53	1255.22	1338.67	1319.86	1274.04	1254.52	OpenAI	gpt-4-turbo-2024-04-09	12/1/2024	2023/12	Proprietary	102256.00
37.00	Gemini-1.5-Flash-Exp-0827	1269.13	1240.39	1249.76	1238.90	1237.04	1258.48	1274.36	1265.67	1243.36	1285.62	1273.50	1270.39	1358.21	1310.61	1263.87	1250.62	1237.12	1353.24	1260.91	1266.47	1380.96	1367.20	1311.12	1275.10	Google	gemini-1.5-flash-exp-0827	12/1/2024	2023/11	Proprietary	25437.00
37.00	Gemini-1.5-Pro-001	1259.74	1243.84	1272.96	1240.16	1238.34	1262.32	1275.06	1261.99	1237.38	1267.25	1266.43	1260.69	1339.15	1293.49	1258.24	1243.39	1231.24	1330.04	1229.11	1244.68	1380.95	1360.03	1297.26	1237.80	Google	gemini-1.5-pro-001	12/1/2024	2023/11	Proprietary	82552.00
37.00	Yi-Lightning-lite	1264.11	1237.58	1248.60	1237.60	1235.75	1266.95	1259.85	1268.35	1246.64	1292.59	1269.97	1265.61	1347.13	1288.42	1272.12	1261.60	1246.93	1320.75	1264.21	1266.08	1365.09	1314.85	1270.07	1273.74	01 AI	yi-lightning-lite	12/1/2024	-	Proprietary	17206.00
39.00	Athene-v2-Chat-72B	1276.43	1256.42	1202.75	1231.54	1249.63	1297.44	1237.15	1282.34	1283.72	1292.80	1280.35	1276.76	1369.48	1291.54	1296.53	1290.26	1258.28	1358.97	1282.11	1272.59	1343.45	1338.21	1302.58	1266.03	NexusFlow	athene-v2-chat	12/1/2024	-	NexusFlow	7159.00
39.00	Claude 3 Opus	1247.51	1235.27	1239.87	1238.46	1235.06	1250.17	1240.58	1257.02	1239.51	1277.86	1259.57	1249.21	1316.91	1270.25	1245.72	1228.08	1213.99	1311.32	1229.20	1252.15	1350.71	1323.70	1305.84	1243.77	Anthropic	claude-3-opus-20240229	12/1/2024	2023/8	Proprietary	190685.00
41.00	GLM-4-Plus	1273.79	1245.78	1238.29	1233.88	1232.19	1283.45	1263.68	1273.48	1245.01	1288.15	1278.97	1274.99	1363.67	1291.80	1274.35	1261.81	1247.73	1349.68	1258.49	1276.28	1352.11	1376.65	1295.55	1298.52	Zhipu AI	glm-4-plus	12/1/2024	-	Proprietary	28021.00
43.00	GPT-4-1106-preview	1249.96	1231.90	1240.98	1234.36	1226.71	1252.86	1247.95	1249.65	1242.21	1260.01	1257.17	1251.20	1318.33	1248.03	1246.43	1238.67	1231.56	1299.30	1241.63	1247.08	1336.55	1319.64	1271.95	1259.78	OpenAI	gpt-4-1106-preview	12/1/2024	2023/4	Proprietary	103865.00
43.00	GPT-4o-mini-2024-07-18	1272.74	1245.73	1242.44	1233.39	1223.00	1284.67	1267.32	1265.90	1231.37	1290.61	1277.50	1273.60	1362.31	1294.47	1268.38	1258.48	1253.85	1322.47	1248.16	1266.47	1360.07	1328.32	1292.45	1273.83	OpenAI	gpt-4o-mini-2024-07-18	12/1/2024	2023/10	Proprietary	53789.00
44.00	Qwen-Max-0919	1263.48	1244.86	1234.32	1230.45	1233.47	1279.93	1250.00	1271.79	1244.57	1280.59	1268.99	1265.01	1345.08	1296.30	1273.34	1265.29	1244.12	1310.03	1272.97	1250.15	1353.37	1288.35	1292.18	1275.70	Alibaba	qwen-max-0919	12/1/2024	-	Qwen	17592.00
47.00	GPT-4-0125-preview	1244.86	1221.56	1237.44	1230.61	1218.63	1243.56	1238.22	1244.55	1236.32	1255.01	1251.07	1246.39	1311.42	1249.10	1241.51	1234.47	1226.38	1295.81	1233.78	1237.47	1342.27	1311.33	1261.31	1244.84	OpenAI	gpt-4-0125-preview	12/1/2024	2023/12	Proprietary	97210.00
47.00	Mistral-Large-2407	1251.35	1243.85	1238.32	1230.82	1231.69	1269.24	1245.35	1256.29	1231.56	1262.64	1255.75	1252.57	1326.78	1269.39	1259.40	1253.40	1238.40	1298.40	1229.39	1248.70	1340.25	1317.87	1276.97	1234.04	Mistral	mistral-large-2407	12/1/2024	2024/7	Mistral Research	48383.00
47.00	Mistral-Large-2411	1251.10	1247.28	1241.65	1225.30	1216.70	1277.24	1256.23	1266.10	1225.58	1272.13	1255.36	1253.23	1327.64	1295.96	1249.88	1254.60	1240.24	1301.54	1377.53	1145.75	1378.40	1258.46	1274.68	1285.22	Mistral	mistral-large-2411	12/1/2024	-	MRL	2273.00
48.00	Gemini-1.5-Flash-002	1271.00	1209.37	1246.42	1228.12	1216.78	1253.27	1284.26	1266.18	1236.96	1258.30	1276.57	1272.39	1359.23	1292.10	1257.10	1245.96	1239.94	1350.29	1218.18	1262.07	1394.90	1347.67	1306.43	1238.84	Google	gemini-1.5-flash-002	12/1/2024	-	Proprietary	24792.00
53.00	Deepseek-v2.5	1257.74	1255.35	1214.00	1224.45	1234.28	1288.17	1238.05	1259.98	1242.93	1264.94	1262.22	1258.64	1336.90	1280.71	1272.97	1262.66	1238.33	1337.42	1237.61	1228.41	1340.35	1327.69	1274.87	1256.07	DeepSeek	deepseek-v2.5	12/1/2024	-	DeepSeek	26527.00
54.00	Grok-2-Mini-08-13	1266.46	1230.11	1227.21	1223.60	1220.77	1262.12	1249.44	1256.41	1237.75	1268.20	1270.79	1267.51	1351.54	1275.60	1260.26	1253.06	1252.11	1319.33	1239.54	1269.52	1354.90	1325.84	1280.37	1259.79	xAI	grok-2-mini-2024-08-13	12/1/2024	2024/3	Proprietary	45929.00
55.00	Athene-70B	1250.13	1234.14	1219.93	1222.25	1224.78	1253.63	1238.87	1234.25	1200.77	1255.38	1253.88	1250.40	1327.03	1241.79	1247.31	1241.55	1237.83	1294.28	1238.47	1244.68	1287.08	1298.12	1272.48	1246.58	NexusFlow	athene-70b-0725	12/1/2024	2024/7	CC-BY-NC-4.0	20660.00
56.00	Qwen2.5-72B-Instruct	1258.52	1245.64	1215.16	1222.24	1228.77	1281.73	1233.95	1266.06	1251.83	1276.79	1263.39	1259.89	1337.81	1292.85	1270.71	1260.77	1238.60	1326.89	1238.45	1235.98	1326.15	1334.31	1280.90	1254.08	Alibaba	qwen2.5-72b-instruct	12/1/2024	2024/9	Qwen	30128.00
61.00	Gemini-1.5-Pro-Preview-0409	1257.34	1205.30	1256.26	1217.74	1200.20	1231.31	1274.38	1248.43	1213.00	1254.80	1260.92	1259.32	1330.09	1247.48	1232.49	1220.01	1233.37	1315.20	1257.43	1253.56	1347.18	1416.28	1302.64	1265.97	Google	gemini-1.5-pro-api-0409-preview	12/1/2024	2023/11	Proprietary	55588.00
61.00	Llama-3.1-Nemotron-70B-Instruct	1268.50	1230.02	1227.35	1215.04	1223.24	1271.35	1269.10	1262.10	1243.28	1278.80	1272.73	1269.81	1355.90	1251.09	1266.20	1264.95	1263.54	1320.37	1271.20	1302.24	1351.66	1249.21	1249.39	1277.93	Nvidia	llama-3.1-nemotron-70b-instruct	12/1/2024	2023/12	Llama 3.1	7675.00
65.00	Meta-Llama-3.1-70B-Instruct	1247.23	1220.26	1214.28	1213.03	1211.12	1251.12	1237.90	1241.30	1221.49	1259.65	1250.84	1248.22	1321.05	1249.30	1243.33	1243.63	1246.17	1273.86	1204.51	1221.62	1284.28	1282.97	1255.24	1248.10	Meta	llama-3.1-70b-instruct	12/1/2024	2023/12	Llama 3.1 Community	52009.00
68.00	Gemma-2-27B-it	1219.71	1203.35	1240.27	1206.50	1192.76	1210.21	1241.60	1214.86	1185.54	1227.47	1224.68	1220.52	1275.32	1237.43	1204.12	1191.96	1194.41	1278.45	1185.08	1206.46	1325.76	1311.72	1255.32	1223.75	Google	gemma-2-27b-it	12/1/2024	2024/6	Gemma license	61424.00
68.00	Llama-3.1-Nemotron-51B-Instruct	1211.43	1192.69	1213.96	1203.70	1192.69	1210.76	1215.17	1209.71	1200.15	1230.00	1215.97	1212.61	1263.32	1216.57	1207.11	1188.77	1216.92	1239.00	1227.41	1171.12	1207.58	1242.14	1210.43	1222.22	Nvidia	llama-3.1-nemotron-51b-instruct	12/1/2024	2023/12	Llama 3.1	3924.00
68.00	Qwen-Plus-0828	1227.43	1217.12	1213.19	1205.85	1208.61	1245.53	1219.20	1234.95	1216.70	1248.93	1232.10	1228.87	1284.48	1265.89	1241.52	1234.89	1217.67	1313.55	1166.88	1182.22	1294.81	1267.90	1269.17	1242.73	Alibaba	qwen-plus-0828	12/1/2024	-	Proprietary	14689.00
68.00	Reka-Core-20240904	1234.93	1200.64	1221.24	1206.62	1192.79	1222.05	1239.10	1223.24	1194.81	1230.49	1239.41	1235.11	1299.22	1234.18	1215.72	1199.85	1208.54	1300.06	1143.93	1238.42	1336.22	1352.56	1270.77	1210.29	Reka AI	reka-core-20240904	12/1/2024	-	Proprietary	7975.00
70.00	Reka-Core-20240722	1230.24	1191.32	1221.81	1203.84	1186.49	1208.34	1240.84	1212.29	1186.81	1237.51	1233.90	1230.59	1292.92	1232.90	1205.24	1191.08	1204.58	1301.19	1232.26	1209.50	1308.70	1331.74	1267.58	1221.51	Reka AI	reka-core-20240722	12/1/2024	-	Proprietary	13310.00
70.00	Yi-Large-preview	1239.62	1209.51	1206.00	1206.19	1205.90	1245.08	1240.48	1236.26	1218.58	1235.21	1243.85	1241.48	1309.32	1246.67	1239.73	1228.94	1216.45	1316.14	1203.81	1225.21	1357.29	1285.21	1271.84	1243.27	01 AI	yi-large-preview	12/1/2024	Unknown	Proprietary	51724.00
71.00	Jamba-1.5-Large	1221.02	1207.98	1215.19	1204.09	1193.33	1227.60	1217.48	1220.46	1191.19	1223.55	1224.82	1221.40	1277.83	1214.48	1219.18	1214.84	1217.41	1261.23	1199.82	1196.03	1267.79	1284.01	1215.64	1246.05	AI21 Labs	jamba-1.5-large	12/1/2024	2024/3	Jamba Open	9149.00
72.00	Deepseek-v2-API-0628	1219.42	1222.85	1199.56	1201.71	1211.57	1241.97	1207.84	1221.57	1217.12	1229.26	1223.26	1220.82	1275.04	1243.57	1234.10	1224.34	1198.53	1282.40	1201.03	1199.78	1303.38	1272.18	1260.01	1216.99	DeepSeek AI	deepseek-v2-api-0628	12/1/2024	-	DeepSeek	19568.00
72.00	Gemini-1.5-Flash-001	1226.83	1208.33	1217.15	1203.51	1200.84	1231.83	1228.15	1222.40	1199.28	1232.24	1232.24	1227.41	1287.90	1262.96	1224.71	1210.71	1200.35	1291.15	1197.56	1211.27	1331.22	1333.90	1259.46	1222.61	Google	gemini-1.5-flash-001	12/1/2024	2023/11	Proprietary	65763.00
73.00	Gemma-2-9B-it-SimPO	1215.70	1179.89	1237.43	1198.89	1186.76	1196.73	1243.44	1203.46	1145.41	1225.54	1218.86	1216.76	1269.24	1238.14	1203.76	1187.66	1195.95	1283.92	1182.82	1215.06	1292.24	1264.78	1248.38	1203.30	Princeton	gemma-2-9b-it-simpo	12/1/2024	2024/7	MIT	10564.00
75.00	Command R+ (08-2024)	1215.14	1166.44	1214.60	1196.91	1171.70	1181.51	1235.24	1205.92	1162.56	1216.76	1222.42	1216.38	1266.11	1242.20	1188.89	1178.33	1189.24	1283.98	1160.39	1212.70	1312.09	1312.67	1250.03	1228.14	Cohere	command-r-plus-08-2024	12/1/2024	2024/8	CC-BY-NC-4.0	10569.00
75.00	Deepseek-Coder-v2-0724	1214.03	1244.10	1186.59	1196.92	1210.54	1266.51	1190.04	1221.08	1211.18	1218.47	1221.17	1215.58	1266.22	1254.36	1235.00	1233.65	1194.81	1286.55	1185.41	1201.03	1294.24	1255.88	1241.88	1202.29	DeepSeek	deepseek-coder-v2-0724	12/1/2024	-	Proprietary	11746.00
75.00	GPT-4-0314	1186.21	1202.28	1203.04	1199.70	1202.87	1195.53	1189.47	1204.47	1193.95	1201.12	1189.20	1187.32	1223.05	1200.47	1195.89	1183.65	1164.30	1236.90	1178.14	1197.93	1275.93	1235.00	1219.50	1196.60	OpenAI	gpt-4-0314	12/1/2024	2021/9	Proprietary	55980.00
78.00	Nemotron-4-340B-Instruct	1209.07	1187.36	1192.91	1196.08	1189.00	1197.96	1207.63	1212.05	1185.86	1217.02	1213.25	1210.22	1261.37	1231.99	1202.25	1184.73	1186.52	1270.36	1149.51	1187.34	1279.20	1284.29	1243.98	1194.84	Nvidia	nemotron-4-340b-instruct	12/1/2024	2023/6	NVIDIA Open Model	20646.00
79.00	Claude 3 Sonnet	1200.98	1201.39	1197.45	1197.16	1190.44	1212.94	1187.64	1204.57	1181.63	1226.68	1209.17	1201.97	1246.31	1222.24	1199.03	1186.68	1175.31	1245.36	1181.47	1198.63	1287.25	1264.30	1247.50	1205.81	Anthropic	claude-3-sonnet-20240229	12/1/2024	2023/8	Proprietary	113103.00
79.00	Yi-Large	1212.34	1195.07	1190.27	1194.24	1185.51	1219.64	1202.56	1207.89	1195.08	1219.83	1218.93	1213.14	1266.39	1218.40	1208.61	1197.66	1194.71	1267.37	1168.97	1197.43	1311.65	1265.22	1244.08	1207.48	01 AI	yi-large	12/1/2024	Unknown	Proprietary	16673.00
81.00	Reka-Flash-20240904	1205.09	1182.15	1197.42	1192.00	1176.53	1191.81	1206.97	1194.06	1168.86	1192.38	1209.00	1205.41	1245.55	1205.85	1185.61	1172.05	1176.59	1279.98	1184.43	1178.70	1297.60	1278.49	1236.66	1241.66	Reka AI	reka-flash-20240904	12/1/2024	-	Proprietary	8167.00
82.00	Llama-3-70B-Instruct	1206.44	1191.03	1207.97	1194.70	1187.45	1199.65	1213.77	1199.17	1188.60	1224.87	1208.91	1206.73	1257.81	1185.55	1197.06	1211.66	1226.12	1175.95	1184.81	1166.27	1177.54	1170.02	1187.15	1241.32	Meta	llama-3-70b-instruct	12/1/2024	2023/12	Llama 3 Community	163906.00
85.00	Qwen2.5-Coder-32B-Instruct	1217.32	1226.43	1159.94	1189.17	1219.24	1260.80	1179.30	1234.49	1224.83	1226.46	1221.79	1218.07	1269.01	1262.19	1257.39	1255.22	1202.53	1276.59	1189.39	1192.27	1266.97	1248.00	1250.01	1219.03	Alibaba	qwen2.5-coder-32b-instruct	12/1/2024	-	Apache 2.0	5755.00
87.00	GLM-4-0520	1206.46	1192.25	1193.30	1187.89	1189.52	1216.00	1198.38	1209.09	1188.55	1221.54	1209.70	1207.46	1257.17	1217.27	1213.49	1201.57	1190.12	1289.22	1161.16	1177.61	1272.25	1189.58	1235.44	1219.99	Zhipu AI	glm-4-0520	12/1/2024	Unknown	Proprietary	10229.00
92.00	Gemini App (2024-01-24)	1208.40	1162.08	1168.76	1180.12	1141.90	1171.17	1193.06	1158.29	1134.82	1198.02	1212.42	1207.94	1248.86	1133.29	1156.34	1141.60	1181.75	1274.85	1263.64	1242.88	1333.10	1406.57	1259.74	1225.27	Google	bard-jan-24-gemini-pro	12/1/2024	Online	Proprietary	11829.00
92.00	Aya-Expanse-32B	1206.97	1178.46	1173.92	1182.45	1181.02	1188.80	1198.08	1205.25	1173.32	1194.05	1212.44	1208.48	1252.19	1239.67	1197.30	1175.84	1177.92	1268.58	1188.98	1186.98	1302.97	1290.87	1243.38	1193.22	Cohere	c4ai-aya-expanse-32b	12/1/2024	-	CC-BY-NC-4.0	17583.00
92.00	DeepSeek-Coder-V2-Instruct	1178.34	1226.04	1159.04	1181.74	1197.19	1239.05	1128.45	1189.32	1210.96	1180.48	1204.91	1179.55	1212.01	1224.65	1211.02	1202.67	1150.03	1259.25	1139.04	1159.33	1283.73	1247.47	1210.58	1153.90	DeepSeek AI	deepseek-coder-v2	12/1/2024	2024/6	DeepSeek License	15788.00
92.00	GPT-4-0613	1163.07	1179.74	1211.49	1185.52	1181.89	1166.94	1187.43	1188.41	1178.07	1174.34	1168.52	1164.18	1187.49	1193.37	1168.02	1164.09	1147.94	1182.35	1123.07	1156.14	1268.33	1206.27	1195.21	1167.46	OpenAI	gpt-4-0613	12/1/2024	2021/9	Proprietary	91679.00
93.00	Command R+ (04-2024)	1189.87	1154.11	1186.35	1182.82	1159.91	1164.29	1199.45	1187.07	1136.69	1196.92	1194.33	1191.21	1231.78	1214.84	1168.80	1154.11	1163.07	1253.81	1161.15	1188.71	1305.29	1272.15	1224.85	1181.23	Cohere	command-r-plus	12/1/2024	2024/3	CC-BY-NC-4.0	80919.00
93.00	Qwen2-72B-Instruct	1187.08	1178.43	1176.92	1180.65	1178.13	1186.77	1183.47	1189.99	1202.14	1196.95	1192.31	1187.90	1225.30	1200.40	1189.07	1184.44	1171.07	1293.16	1128.66	1146.05	1265.43	1225.67	1195.12	1171.75	Alibaba	qwen2-72b-instruct	12/1/2024	2024/6	Qianwen LICENSE	38960.00
93.00	Reka-Flash-20240722	1200.78	1173.39	1178.57	1180.05	1164.90	1187.20	1197.64	1187.75	1161.01	1198.02	1204.78	1200.71	1244.83	1194.27	1178.34	1167.80	1173.98	1270.44	1195.94	1202.20	1289.38	1286.68	1248.69	1213.78	Reka AI	reka-flash-20240722	12/1/2024	-	Proprietary	13749.00
97.00	Gemini-1.5-Flash-8B-001	1211.23	1165.32	1190.24	1177.38	1173.77	1205.71	1220.48	1209.53	1182.74	1190.11	1216.79	1212.17	1259.93	1228.99	1210.70	1194.35	1181.32	1286.67	1189.41	1196.46	1286.05	1295.96	1256.26	1214.46	Google	gemini-1.5-flash-8b-001	12/1/2024	-	Proprietary	26266.00
97.00	Gemma-2-9B-it	1190.23	1165.38	1208.50	1177.83	1161.09	1169.52	1208.60	1183.92	1152.23	1193.61	1194.63	1190.59	1227.14	1207.07	1170.56	1157.22	1167.96	1243.99	1150.81	1180.63	1287.85	1277.58	1220.41	1199.39	Google	gemma-2-9b-it	12/1/2024	2024/6	Gemma license	43070.00
98.00	Claude 3 Haiku	1179.32	1183.47	1170.18	1177.25	1174.16	1189.45	1163.12	1181.90	1159.55	1191.85	1188.39	1179.54	1213.87	1199.54	1178.04	1167.71	1157.51	1211.54	1150.38	1169.56	1255.58	1250.03	1224.59	1169.64	Anthropic	claude-3-haiku-20240307	12/1/2024	2023/8	Proprietary	122419.00
98.00	Command R (08-2024)	1179.57	1160.77	1168.46	1175.64	1165.42	1161.90	1179.10	1179.77	1129.72	1168.36	1184.86	1180.60	1204.12	1211.35	1169.69	1159.60	1154.70	1242.43	1140.12	1170.71	1295.12	1292.01	1201.22	1169.27	Cohere	command-r-08-2024	12/1/2024	2024/8	CC-BY-NC-4.0	10882.00
98.00	Reka-Core-20240501	1199.59	1172.79	1181.68	1177.28	1168.15	1190.06	1196.12	1186.04	1159.23	1188.86	1203.88	1200.97	1246.33	1192.46	1186.74	1173.40	1175.97	1260.62	1178.86	1197.50	1283.31	1273.20	1229.92	1190.10	Reka AI	reka-core-20240501	12/1/2024	-	Proprietary	62620.00
103.00	Gemini-1.5-Flash-8B-Exp-0827	1205.09	1161.11	1184.72	1172.21	1162.35	1189.37	1213.81	1199.13	1172.46	1201.47	1209.41	1205.73	1251.43	1232.01	1195.98	1181.67	1176.27	1274.08	1193.32	1181.28	1303.53	1300.82	1251.71	1221.04	Google	gemini-1.5-flash-8b-exp-0827	12/1/2024	2023/11	Proprietary	25419.00
106.00	Qwen-Max-0428	1182.86	1175.09	1164.54	1171.30	1168.26	1189.57	1177.52	1179.97	1167.18	1175.14	1186.53	1183.65	1219.48	1197.84	1186.37	1178.03	1167.85	1292.96	1162.52	1130.15	1265.62	1219.70	1179.73	1154.54	Alibaba	qwen-max-0428	12/1/2024	-	Proprietary	25704.00
113.00	GLM-4-0116	1183.02	1167.47	1170.17	1162.58	1164.96	1190.56	1180.61	1180.66	1161.62	1181.29	1186.19	1185.84	1220.80	1193.30	1186.75	1176.62	1176.89	1274.08	1128.73	1153.86	1244.89	1147.05	1182.56	1199.34	Zhipu AI	glm-4-0116	12/1/2024	Unknown	Proprietary	7590.00
113.00	Jamba-1.5-Mini	1175.75	1164.54	1166.95	1159.15	1146.20	1180.66	1171.69	1157.91	1131.47	1162.85	1179.82	1176.21	1202.08	1170.44	1168.78	1165.83	1177.44	1196.82	1135.13	1158.51	1174.36	1182.62	1179.70	1221.99	AI21 Labs	jamba-1.5-mini	12/1/2024	2024/3	Jamba Open	9288.00
113.00	Ministral-8B-2410	1182.58	1172.37	1176.58	1159.47	1167.80	1201.10	1182.33	1176.38	1165.61	1171.18	1186.94	1182.82	1206.24	1226.70	1198.85	1193.23	1168.71	1256.48	1132.46	1126.31	1290.80	1210.90	1223.44	1130.52	Mistral	ministral-8b-2410	12/1/2024	-	MRL	5161.00
114.00	Claude-1	1148.83	1149.19	1163.99	1158.84	1134.95	1135.57	1134.19	1141.11	1114.39	1171.52	1165.95	1148.34	1167.81	1162.98	1125.57	1116.90	1129.29	1194.89	1115.74	1172.96	1230.37	1101.48	1192.36	1171.14	Anthropic	claude-1	12/1/2024	-	Proprietary	21164.00
114.00	Hunyuan-Standard-256K	1188.23	1192.41	1154.28	1151.00	1181.73	1225.77	1176.77	1208.84	1205.13	1180.01	1194.27	1190.98	1222.87	1235.38	1219.61	1212.21	1168.65	1295.33	1173.33	1139.18	1247.45	1234.89	1189.64	1285.05	Tencent	hunyuan-standard-256k	12/1/2024	-	Proprietary	2931.00
115.00	Mistral-Large-2402	1157.11	1170.10	1158.83	1157.52	1164.21	1169.56	1159.13	1172.37	1164.74	1165.72	1159.25	1158.43	1180.88	1176.95	1165.33	1157.16	1146.02	1178.16	1162.33	1173.57	1174.01	1159.89	1196.02	1193.41	Mistral	mistral-large-2402	12/1/2024	-	Proprietary	64950.00
115.00	Qwen1.5-110B-Chat	1161.48	1163.49	1147.10	1155.36	1154.58	1174.62	1150.25	1163.14	1150.74	1158.85	1164.72	1161.40	1184.86	1166.45	1168.82	1166.70	1150.66	1259.45	1108.12	1117.47	1228.01	1187.71	1144.55	1144.49	Alibaba	qwen1.5-110b-chat	12/1/2024	2024/4	Qianwen LICENSE	27482.00
116.00	Reka-Flash-21B-online	1155.77	1145.07	1130.78	1151.05	1143.93	1146.73	1131.12	1137.88	1140.22	1149.34	1157.91	1155.68	1179.24	1150.94	1142.67	1133.05	1135.86	1196.51	1110.64	1148.05	1231.75	1244.89	1189.50	1145.48	Reka AI	reka-flash-21b-20240226-online	12/1/2024	Online	Proprietary	16035.00
116.00	Reka-Flash-Preview-20240611	1165.13	1145.98	1148.85	1151.66	1136.60	1155.01	1158.55	1146.56	1126.91	1148.48	1168.32	1165.34	1189.72	1147.18	1144.46	1130.75	1141.71	1218.52	1141.36	1161.23	1251.57	1250.39	1196.63	1175.33	Reka AI	reka-flash-preview-20240611	12/1/2024	-	Proprietary	20453.00
119.00	Mistral-Next	1124.28	1154.29	1164.38	1149.18	1148.15	1132.28	1135.07	1157.61	1139.67	1137.12	1126.18	1124.73	1130.64	1150.30	1128.88	1121.33	1109.89	1134.05	1111.47	1154.73	1138.52	1041.54	1173.01	1129.78	Mistral	mistral-next	12/1/2024	-	Proprietary	12377.00
122.00	Claude-2.0	1131.82	1152.25	1143.94	1145.84	1141.10	1134.95	1101.79	1130.18	1126.42	1161.01	1150.39	1131.71	1140.37	1146.39	1126.13	1119.29	1113.96	1189.49	1102.69	1152.00	1215.34	1149.59	1204.35	1137.84	Anthropic	claude-2.0	12/1/2024	-	Proprietary	12764.00
122.00	Gemini-1.0-Pro-001	1131.34	1119.41	1153.11	1146.95	1124.75	1102.73	1133.66	1118.85	1098.94	1119.23	1133.37	1130.49	1144.62	1143.45	1105.64	1095.33	1108.35	1181.23	1103.00	1124.51	1199.36	1221.10	1207.90	1127.26	Google	gemini-pro-dev-api	12/1/2024	2023/4	Proprietary	18800.00
122.00	Mixtral-8x22b-Instruct-v0.1	1147.50	1151.52	1146.97	1149.24	1146.49	1152.53	1146.83	1154.69	1152.44	1131.02	1150.61	1148.37	1163.66	1155.47	1148.46	1142.95	1136.43	1177.41	1122.36	1138.80	1195.11	1198.04	1179.96	1143.54	Mistral	mixtral-8x22b-instruct-v0.1	12/1/2024	2024/4	Apache 2.0	53851.00
123.00	Qwen1.5-72B-Chat	1147.43	1156.70	1136.48	1147.89	1142.65	1159.96	1135.49	1143.98	1128.43	1153.70	1150.48	1147.18	1166.21	1165.62	1146.78	1140.92	1135.04	1240.38	1112.89	1077.75	1218.75	1189.35	1128.70	1110.89	Alibaba	qwen1.5-72b-chat	12/1/2024	2024/2	Qianwen LICENSE	40654.00
124.00	Command R (04-2024)	1148.67	1124.71	1153.21	1147.83	1122.79	1122.97	1159.21	1132.27	1089.14	1148.62	1150.86	1148.45	1167.92	1166.98	1119.46	1105.83	1123.34	1208.67	1113.11	1123.07	1247.37	1239.96	1184.08	1150.70	Cohere	command-r	12/1/2024	2024/3	CC-BY-NC-4.0	56401.00
124.00	GPT-3.5-Turbo-0314	1106.74	1142.99	1135.66	1141.37	1137.85	1114.69	1089.43	1148.65	1139.82	1107.20	1114.34	1106.48	1096.87	1117.31	1116.58	1096.89	1081.46	1204.50	1149.54	1152.49	1283.68	1220.53	1165.05	1164.45	OpenAI	gpt-3.5-turbo-0314	12/1/2024	2021/9	Proprietary	5648.00
127.00	Reka-Flash-21B	1147.62	1138.51	1128.84	1141.65	1134.62	1141.10	1128.65	1129.66	1123.53	1142.00	1150.67	1147.16	1165.46	1150.72	1133.61	1126.68	1126.10	1193.93	1129.85	1150.43	1211.94	1217.83	1181.65	1141.86	Reka AI	reka-flash-21b-20240226	12/1/2024	2023/11	Proprietary	25818.00
128.00	Llama-3-8B-Instruct	1152.04	1138.65	1151.26	1142.26	1129.13	1145.90	1154.90	1136.66	1118.88	1152.96	1154.45	1150.86	1171.08	1136.04	1137.12	1144.24	1163.69	1135.03	1113.89	1101.43	1138.51	1150.96	1138.79	1174.07	Meta	llama-3-8b-instruct	12/1/2024	2023/3	Llama 3 Community	109332.00
129.00	Mistral Medium	1147.84	1141.71	1147.35	1141.09	1136.97	1152.46	1160.68	1153.48	1139.30	1145.28	1148.36	1148.16	1167.82	1162.53	1144.17	1132.03	1137.85	1165.02	1133.66	1149.44	1182.23	1163.53	1190.01	1144.25	Mistral	mistral-medium	12/1/2024	-	Proprietary	35563.00
133.00	GPT-3.5-Turbo-0125	1105.81	1145.90	1145.36	1137.12	1130.71	1123.63	1099.23	1125.10	1109.71	1114.99	1111.92	1105.50	1100.19	1136.81	1112.00	1106.13	1086.79	1130.71	1073.55	1091.54	1204.58	1168.26	1147.53	1118.07	OpenAI	gpt-3.5-turbo-0125	12/1/2024	2021/9	Proprietary	68903.00
133.00	GPT-3.5-Turbo-0613	1116.81	1146.97	1130.77	1136.72	1134.39	1134.80	1109.76	1128.44	1107.00	1117.16	1123.81	1116.70	1120.22	1125.39	1123.05	1115.82	1098.14	1156.90	1099.42	1121.05	1209.66	1201.26	1184.16	1120.50	OpenAI	gpt-3.5-turbo-0613	12/1/2024	2021/9	Proprietary	38958.00
135.00	Claude-2.1	1118.20	1151.94	1097.20	1134.84	1135.52	1131.73	1048.15	1109.45	1122.62	1158.77	1137.00	1117.61	1122.58	1133.28	1118.96	1107.58	1096.76	1146.61	1139.30	1136.86	1208.23	1150.57	1174.85	1122.25	Anthropic	claude-2.1	12/1/2024	-	Proprietary	37704.00
136.00	Gemini Pro	1110.60	1111.16	1131.39	1131.32	1113.36	1091.57	1103.31	1102.96	1086.08	1142.66	1115.53	1109.76	1111.59	1125.24	1083.17	1080.21	1097.64	1151.79	1059.19	1017.39	1212.24	1294.65	1152.31	1086.43	Google	gemini-pro	12/1/2024	2023/4	Proprietary	6563.00
136.00	Yi-1.5-34B-Chat	1157.20	1135.23	1120.30	1132.94	1135.70	1162.19	1144.64	1147.24	1149.55	1158.16	1160.27	1157.45	1178.93	1159.16	1159.90	1159.60	1163.14	1266.99	1111.65	1106.38	1179.31	1150.22	1119.26	1124.26	01 AI	yi-1.5-34b-chat	12/1/2024	2024/5	Apache-2.0	25155.00
136.00	Zephyr-ORPO-141b-A35b-v0.1	1126.86	1125.98	1117.36	1130.13	1119.26	1124.13	1114.23	1128.31	1118.61	1103.56	1128.83	1127.07	1136.59	1118.90	1116.89	1113.21	1118.59	1142.93	1140.03	1089.44	1186.48	1171.29	1141.27	1104.00	HuggingFace	zephyr-orpo-141b-A35b-v0.1	12/1/2024	2024/4	Apache 2.0	4861.00
137.00	Meta-Llama-3.1-8B-Instruct	1174.92	1144.31	1132.09	1131.32	1142.22	1185.55	1160.40	1171.00	1152.93	1172.98	1178.98	1175.27	1199.89	1196.47	1182.31	1182.11	1170.80	1210.43	1147.03	1139.77	1209.01	1200.06	1186.27	1176.02	Meta	llama-3.1-8b-instruct	12/1/2024	2023/12	Llama 3.1 Community	48770.00
138.00	Claude-Instant-1	1111.18	1130.11	1105.01	1126.90	1124.07	1108.73	1060.20	1107.01	1111.03	1146.59	1129.83	1110.75	1110.29	1133.48	1106.89	1100.09	1096.85	1145.32	1080.06	1104.49	1193.05	1139.52	1130.80	1099.79	Anthropic	claude-instant-1	12/1/2024	-	Proprietary	20625.00
138.00	Qwen1.5-32B-Chat	1125.45	1144.54	1087.95	1126.57	1131.01	1149.17	1088.79	1122.12	1124.92	1137.84	1128.34	1124.71	1130.92	1157.66	1135.65	1130.23	1109.62	1235.12	1059.62	1053.48	1188.12	1154.38	1097.16	1087.82	Alibaba	qwen1.5-32b-chat	12/1/2024	2024/2	Qianwen LICENSE	22767.00
146.00	DBRX-Instruct-Preview	1103.11	1123.76	1111.13	1113.30	1115.17	1117.84	1102.46	1114.16	1108.58	1102.05	1105.07	1103.11	1096.35	1124.88	1109.47	1110.24	1103.69	1121.19	1051.16	1061.40	1154.42	1136.30	1096.21	1066.09	Databricks	dbrx-instruct-preview	12/1/2024	2023/12	DBRX LICENSE	33753.00
146.00	Gemma-2-2b-it	1140.23	1087.60	1128.90	1113.41	1095.72	1104.22	1145.31	1125.17	1109.02	1118.13	1144.44	1140.16	1140.01	1141.87	1115.19	1111.60	1131.03	1187.20	1120.52	1103.82	1231.30	1199.80	1140.55	1143.95	Google	gemma-2-2b-it	12/1/2024	2024/7	Gemma license	34623.00
146.00	GPT-3.5-Turbo-1106	1067.74	1125.34	1109.19	1109.83	1117.86	1095.00	1043.76	1090.74	1104.22	1070.85	1081.28	1067.27	1046.15	1088.54	1090.77	1088.65	1052.31	1076.19	1021.43	1066.11	1209.78	1097.76	1106.56	1089.72	OpenAI	gpt-3.5-turbo-1106	12/1/2024	2021/9	Proprietary	17034.00
146.00	Granite-3.0-8B-Instruct	1094.27	1112.50	1103.48	1110.03	1119.98	1097.16	1089.86	1110.69	1126.26	1069.00	1097.82	1095.39	1066.73	1143.14	1109.62	1115.85	1109.90	1129.25	1026.80	983.90	1159.66	1117.63	1102.39	1034.03	IBM	granite-3.0-8b-instruct	12/1/2024	-	Apache 2.0	7072.00
146.00	InternLM2.5-20B-chat	1149.22	1135.99	1095.19	1115.86	1142.11	1158.19	1134.94	1152.80	1158.35	1139.30	1154.59	1149.57	1153.37	1170.92	1165.81	1175.75	1156.72	1260.84	1028.60	1059.74	1194.78	1166.36	1139.46	1123.13	InternLM	internlm2_5-20b-chat	12/1/2024	2024/8	Other	10685.00
146.00	Phi-3-Medium-4k-Instruct	1122.97	1115.35	1105.51	1117.95	1121.54	1125.13	1111.62	1123.08	1141.09	1095.08	1126.41	1123.33	1118.39	1133.17	1129.74	1127.12	1117.84	1164.83	1071.37	1100.48	1198.71	1110.86	1169.80	1096.02	Microsoft	phi-3-medium-4k-instruct	12/1/2024	2023/10	MIT	26135.00
147.00	Mixtral-8x7B-Instruct-v0.1	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	Mistral	mixtral-8x7b-instruct-v0.1	12/1/2024	2023/12	Apache 2.0	76167.00
148.00	Qwen1.5-14B-Chat	1108.92	1118.56	1092.24	1106.88	1109.78	1125.80	1095.26	1102.77	1090.91	1108.81	1111.22	1107.64	1105.90	1125.79	1116.62	1110.09	1095.58	1202.64	1069.48	1042.27	1189.84	1150.43	1072.62	1078.61	Alibaba	qwen1.5-14b-chat	12/1/2024	2024/2	Qianwen LICENSE	18682.00
151.00	OpenChat-3.5-0106	1091.44	1106.28	1103.04	1100.32	1088.58	1101.90	1098.64	1081.63	1071.78	1092.09	1090.69	1089.90	1081.46	1096.60	1083.99	1073.78	1080.54	1138.25	1047.64	1066.35	1128.25	1044.12	1107.37	1101.43	OpenChat	openchat-3.5-0106	12/1/2024	2024/1	Apache-2.0	12983.00
151.00	Snowflake Arctic Instruct	1090.11	1092.43	1095.82	1102.56	1088.73	1077.01	1085.28	1077.75	1080.35	1070.37	1092.11	1088.92	1072.90	1018.33	1073.84	1066.35	1077.83	1129.10	1087.51	1077.79	1136.08	1091.18	1126.92	1089.84	Snowflake	snowflake-arctic-instruct	12/1/2024	2024/4	Apache 2.0	34183.00
151.00	WizardLM-70B-v1.0	1106.17	1070.74	1149.67	1104.60	1075.02	1070.97	1152.27	1102.46	1075.70	1108.81	1103.11	1105.49	1105.67	1104.58	1077.62	1072.96	1097.86	1113.24	1034.75	1084.10	1168.63	1065.40	1166.50	1083.49	Microsoft	wizardlm-70b	12/1/2024	2023/8	Llama 2 Community	8386.00
151.00	Yi-34B-Chat	1111.28	1090.76	1108.05	1101.08	1090.31	1106.08	1110.76	1094.14	1079.14	1110.28	1115.50	1110.97	1112.17	1105.41	1102.01	1097.40	1106.17	1231.67	1046.90	1038.34	1175.04	1099.25	1079.57	1070.19	01 AI	yi-34b-chat	12/1/2024	2023/6	Yi License	15919.00
153.00	Gemma-1.1-7B-it	1083.48	1106.57	1104.51	1098.25	1095.60	1084.40	1070.13	1071.27	1078.77	1043.58	1086.38	1081.28	1061.41	1072.12	1076.86	1077.19	1078.61	1118.70	1020.93	1049.78	1133.90	1139.18	1076.46	1051.04	Google	gemma-1.1-7b-it	12/1/2024	2024/2	Gemma license	25092.00
153.00	OpenChat-3.5	1076.42	1066.85	1133.87	1094.53	1076.51	1053.56	1126.87	1074.56	1034.51	1087.39	1070.04	1076.49	1062.57	1108.22	1065.14	1055.36	1064.67	1125.66	1065.06	1038.80	1109.14	1096.01	1127.84	1080.92	OpenChat	openchat-3.5	12/1/2024	2023/11	Apache-2.0	8113.00
153.00	Phi-3-Small-8k-Instruct	1101.70	1099.32	1088.39	1098.26	1101.16	1107.10	1087.56	1101.97	1120.17	1071.07	1106.16	1101.89	1085.30	1101.39	1107.35	1111.46	1106.00	1122.65	1093.01	1075.24	1127.23	1055.68	1138.71	1110.04	Microsoft	phi-3-small-8k-instruct	12/1/2024	2023/10	MIT	18506.00
154.00	DeepSeek-LLM-67B-Chat	1076.94	1086.65	1083.69	1091.03	1072.76	1079.22	1066.41	1082.54	1070.34	1077.42	1078.29	1076.86	1065.84	1099.83	1065.32	1059.96	1063.90	1180.48	1000.81	1005.43	1165.46	1171.27	1158.75	1062.15	DeepSeek AI	deepseek-llm-67b-chat	12/1/2024	2023/11	DeepSeek License	4988.00
154.00	Meta-Llama-3.2-3B-Instruct	1102.99	1048.02	1101.51	1093.40	1084.65	1080.34	1100.52	1106.48	1097.63	1111.15	1106.46	1102.73	1083.71	1120.14	1103.03	1129.90	1141.39	1085.50	1031.74	1052.80	1083.16	1005.18	983.22	1095.35	Meta	llama-3.2-3b-instruct	12/1/2024	2023/12	Llama 3.2	8434.00
154.00	Tulu-2-DPO-70B	1099.10	1082.07	1099.75	1092.09	1088.54	1093.10	1109.75	1106.21	1073.72	1082.00	1100.16	1098.87	1093.25	1116.14	1098.08	1099.14	1091.79	1060.11	1088.71	1066.69	1133.36	892.48	1156.25	1119.86	AllenAI/UW	tulu-2-dpo-70b	12/1/2024	2023/11	AI2 ImpACT Low-risk	6664.00
156.00	Starling-LM-7B-beta	1119.04	1111.30	1058.63	1091.55	1103.95	1129.47	1097.35	1104.47	1093.71	1106.74	1120.66	1118.89	1124.19	1120.84	1119.59	1112.22	1107.69	1178.98	1064.90	1076.61	1162.71	1090.17	1123.48	1143.73	Nexusflow	starling-lm-7b-beta	12/1/2024	2024/3	Apache-2.0	16674.00
157.00	OpenHermes-2.5-Mistral-7B	1074.39	1066.36	1111.43	1089.80	1077.99	1057.66	1103.15	1073.82	1061.56	1063.32	1069.39	1072.55	1059.68	1069.72	1068.58	1064.38	1071.99	1081.69	1027.83	995.76	1149.55	1174.06	1082.88	1050.12	NousResearch	openhermes-2.5-mistral-7b	12/1/2024	2023/11	Apache-2.0	5090.00
158.00	Vicuna-33B	1090.71	1068.47	1132.00	1091.45	1066.64	1067.10	1136.50	1073.69	1036.34	1086.67	1087.25	1090.10	1082.70	1043.86	1066.08	1061.01	1086.38	1093.59	1055.62	1055.00	1148.55	978.06	1100.55	1085.23	LMSYS	vicuna-33b	12/1/2024	2023/8	Non-commercial	22956.00
161.00	Granite-3.0-2B-Instruct	1074.46	1095.39	1064.38	1081.93	1094.46	1088.06	1062.38	1081.92	1102.24	1064.33	1076.85	1074.65	1029.41	1103.18	1089.43	1084.24	1080.28	1130.21	1003.07	987.48	1142.45	1076.12	1081.16	1036.77	IBM	granite-3.0-2b-instruct	12/1/2024	-	Apache 2.0	7247.00
161.00	Starling-LM-7B-alpha	1088.35	1076.19	1089.64	1083.11	1070.35	1079.75	1102.49	1073.40	1047.56	1082.50	1084.92	1088.44	1079.35	1092.33	1072.97	1070.33	1083.23	1106.39	1039.68	1028.70	1129.68	1117.31	1110.34	1111.73	UC Berkeley	starling-lm-7b-alpha	12/1/2024	2023/11	CC-BY-NC-4.0	10419.00
164.00	Llama-2-70B-chat	1093.01	1061.53	1065.41	1081.41	1063.11	1072.03	1079.00	1074.77	1057.67	1081.06	1094.51	1091.87	1083.38	1071.37	1070.26	1070.34	1096.37	1056.95	1047.69	1027.24	1110.24	1112.42	1106.45	1137.33	Meta	llama-2-70b-chat	12/1/2024	2023/7	Llama 2 Community	39648.00
164.00	NV-Llama2-70B-SteerLM-Chat	1080.54	1025.73	1076.83	1074.04	1048.62	1022.71	1096.30	1063.37	1036.52	1059.62	1076.51	1079.70	1071.96	1011.71	1045.84	1035.30	1069.28	1086.48	1050.74	1081.55	1115.21	984.40	1139.19	1035.47	Nvidia	llama2-70b-steerlm-chat	12/1/2024	2023/11	Llama 2 Community	3638.00
166.00	pplx-70B-online	1077.78	1034.78	1054.49	1075.78	1029.96	1028.22	1050.03	1032.02	1041.59	986.46	1075.81	1076.91	1065.46	1016.22	1027.69	1024.79	1066.35	1127.49	1046.90	1038.87	1208.54	1194.32	1074.46	1063.47	Perplexity AI	pplx-70b-online	12/1/2024	Online	Proprietary	6894.00
167.00	Dolphin-2.2.1-Mistral-7B	1062.47	1034.08	1090.46	1068.95	1053.99	1023.87	1091.00	1056.29	1041.46	1017.46	1057.75	1061.70	1039.63	1031.77	1049.95	1044.21	1059.80	1103.12	990.50	939.03	1134.94	958.04	1107.61	988.54	Cognitive Computations	dolphin-2.2.1-mistral-7b	12/1/2024	2023/10	Apache-2.0	1712.00
167.00	Nous-Hermes-2-Mixtral-8x7B-DPO	1084.20	1066.85	1090.09	1071.63	1036.39	1079.48	1104.92	1054.43	1028.12	1079.76	1085.54	1083.78	1074.50	1060.37	1052.13	1045.26	1078.03	1074.62	1078.63	1027.98	1159.03	1173.31	1083.93	1024.12	NousResearch	nous-hermes-2-mixtral-8x7b-dpo	12/1/2024	2024/1	Apache-2.0	3835.00
169.00	Phi-3-Mini-4K-Instruct-June-24	1070.69	1073.65	1059.35	1067.93	1088.82	1081.97	1058.10	1074.97	1123.29	1054.99	1074.36	1071.19	1020.61	1055.66	1095.57	1100.92	1082.15	1094.23	1052.53	1030.63	1124.53	1032.65	1048.78	1134.85	Microsoft	phi-3-mini-4k-instruct-june-2024	12/1/2024	2023/10	MIT	12855.00
169.00	Qwen1.5-7B-Chat	1070.37	1082.30	1036.26	1065.35	1058.78	1088.94	1040.05	1063.90	1049.16	1061.00	1070.05	1068.22	1048.03	1102.12	1067.31	1056.74	1054.59	1196.25	1018.03	1022.21	1177.32	1044.92	1034.49	1017.24	Alibaba	qwen1.5-7b-chat	12/1/2024	2024/2	Qianwen LICENSE	4871.00
170.00	falcon-180b-chat	1033.89	1041.26	1108.41	1058.86	1019.46	1016.33	1094.98	1053.63	1012.95	1011.40	1030.75	1034.39	1002.57	1055.95	1002.07	1009.79	1026.27	997.82	950.16	1145.66	1165.85	460.27	860.04	1101.19	TII	falcon-180b-chat	12/1/2024	2023/9	Falcon-180B TII License	1325.00
170.00	Mistral-7B-Instruct-v0.2	1072.27	1066.61	1063.35	1067.22	1063.52	1073.59	1075.64	1067.32	1056.53	1070.15	1072.17	1071.19	1050.22	1071.69	1068.51	1070.85	1081.69	1068.31	984.33	979.19	1042.82	1063.38	1045.57	1025.21	Mistral	mistral-7b-instruct-v0.2	12/1/2024	2023/12	Apache-2.0	20072.00
170.00	MPT-30B-chat	1045.63	1044.14	1085.40	1059.78	1055.35	1030.35	1077.19	1056.77	1013.47	1052.09	1040.22	1043.94	1022.66	1067.27	1046.94	1058.60	1043.24	1024.12	999.05	993.58	1094.33	1015.62	959.91	1062.61	MosaicML	mpt-30b-chat	12/1/2024	2023/6	CC-BY-NC-SA-4.0	2650.00
170.00	SOLAR-10.7B-Instruct-v1.0	1062.02	1053.21	1088.30	1065.73	1056.22	1047.02	1089.26	1057.91	1028.11	1041.55	1058.09	1061.93	1039.04	1134.03	1056.43	1050.37	1060.52	1069.57	1001.89	1012.99	1140.26	933.20	1061.75	1031.32	Upstage AI	solar-10.7b-instruct-v1.0	12/1/2024	2023/11	CC-BY-NC-4.0	4289.00
170.00	WizardLM-13b-v1.2	1058.55	1030.31	1092.14	1063.05	1014.50	1025.80	1093.15	1050.76	987.06	1042.83	1057.74	1055.99	1039.56	1066.68	1013.35	1010.53	1050.32	1074.78	1026.92	1030.93	1076.53	1038.53	1082.86	1072.36	Microsoft	wizardlm-13b	12/1/2024	2023/7	Llama 2 Community	7183.00
171.00	Qwen-14B-Chat	1035.11	1068.36	1057.54	1056.60	1038.31	1056.11	1035.05	1034.26	1033.01	1019.20	1036.75	1033.27	1000.15	1038.06	1023.91	1017.90	1017.08	1135.30	1026.72	1014.34	1172.77	953.53	1081.21	1082.51	Alibaba	qwen-14b-chat	12/1/2024	2023/8	Qianwen LICENSE	5070.00
175.00	Llama-2-13b-chat	1063.16	1042.04	1044.20	1053.63	1043.16	1051.23	1050.04	1046.60	1032.28	1045.89	1068.45	1061.72	1036.89	1077.45	1049.50	1048.61	1060.92	1055.45	990.66	997.65	1062.85	1093.90	1075.72	1075.56	Meta	llama-2-13b-chat	12/1/2024	2023/7	Llama 2 Community	19743.00
175.00	Phi-3-Mini-4k-Instruct	1065.99	1069.30	1029.45	1055.52	1066.18	1085.71	1043.15	1067.36	1084.29	1025.78	1069.99	1064.99	1021.34	1052.55	1078.88	1084.43	1072.50	1081.49	1032.22	1038.24	1100.74	1059.72	1056.75	1093.89	Microsoft	phi-3-mini-4k-instruct	12/1/2024	2023/10	MIT	21114.00
175.00	Vicuna-13B	1042.12	1042.29	1081.03	1058.45	1035.03	1032.16	1063.85	1040.54	999.36	1032.65	1041.25	1040.43	1011.00	1061.71	1025.13	1017.70	1028.37	1097.70	993.73	992.18	1127.50	1047.33	1073.00	1067.94	LMSYS	vicuna-13b	12/1/2024	2023/7	Llama 2 Community	19795.00
179.00	Zephyr-7B-alpha	1041.49	1039.71	1059.28	1046.49	1025.00	1033.78	1076.01	1041.32	1006.36	1013.86	1033.12	1038.77	1012.81	1011.06	1022.72	1018.53	1039.67	1042.98	1004.83	911.79	1078.85	1303.97	1049.51	1000.77	HuggingFace	zephyr-7b-alpha	12/1/2024	2023/10	MIT	1815.00
179.00	Zephyr-7B-beta	1053.38	1027.91	1096.65	1049.41	1022.57	1029.95	1112.87	1038.55	1010.65	1031.82	1048.51	1052.00	1027.63	1053.79	1026.54	1027.53	1053.30	1018.09	994.47	975.31	1042.03	1025.97	1068.81	1041.36	HuggingFace	zephyr-7b-beta	12/1/2024	2023/10	MIT	11332.00
180.00	CodeLlama-70B-instruct	1040.98	1055.49	1004.94	1037.90	1059.77	1047.08	1015.50	1033.40	1033.48	1032.94	1051.17	1040.04	1006.71	998.48	1051.94	1054.54	1044.86	1089.73	865.22	915.99	1117.59	1400.53	1036.44	1013.94	Meta	codellama-70b-instruct	12/1/2024	2024/1	Llama 2 Community	1193.00
181.00	CodeLlama-34B-instruct	1042.77	1042.58	1037.93	1047.07	1032.13	1041.88	1034.73	1029.21	1022.14	1012.51	1042.40	1040.75	1012.77	1025.88	1027.87	1022.37	1034.68	1032.91	1007.28	988.43	1031.26	1033.73	1106.10	1118.83	Meta	codellama-34b-instruct	12/1/2024	2023/7	Llama 2 Community	7515.00
181.00	Phi-3-Mini-128k-Instruct	1036.96	1032.42	1044.05	1048.67	1039.94	1029.09	1034.16	1036.08	1063.61	991.46	1039.92	1035.08	983.56	1015.02	1035.48	1036.19	1034.18	1076.76	994.53	1009.01	1078.99	1024.18	1039.28	1055.59	Microsoft	phi-3-mini-128k-instruct	12/1/2024	2023/10	MIT	21639.00
182.00	Gemma-7B-it	1037.33	1057.03	1053.66	1047.46	1055.33	1046.53	1029.14	1023.16	1032.46	958.92	1040.24	1034.85	999.57	1036.27	1045.07	1045.26	1032.02	1095.43	980.45	978.96	1079.57	1110.28	1014.83	982.78	Google	gemma-7b-it	12/1/2024	2024/2	Gemma license	9176.00
183.00	Guanaco-33B	1032.55	968.43	1086.52	1039.36	1004.59	965.42	1081.22	993.31	993.64	1004.94	1035.16	1030.89	1003.94	973.62	1000.44	996.78	1028.45	1014.61	1060.95	1020.79	982.45	590.67	1052.66	1052.63	UW	guanaco-33b	12/1/2024	2023/5	Non-commercial	3000.00
183.00	Meta-Llama-3.2-1B-Instruct	1053.54	1009.32	1044.66	1044.38	1039.53	1046.54	1044.39	1052.77	1064.87	1039.07	1057.33	1052.01	982.41	1070.32	1059.61	1078.90	1081.11	1022.88	1022.36	1009.97	1074.71	1012.17	972.87	1030.03	Meta	llama-3.2-1b-instruct	12/1/2024	2023/12	Llama 3.2	8545.00
184.00	pplx-7B-online	1044.58	1018.09	1010.39	1041.63	1017.17	1015.04	1007.61	997.63	1013.07	990.53	1039.80	1043.63	1017.82	994.66	1016.05	1013.28	1039.16	1083.91	929.52	947.82	1159.13	1110.77	1056.99	1041.26	Perplexity AI	pplx-7b-online	12/1/2024	Online	Proprietary	6334.00
185.00	PaLM-Chat-Bison-001	1003.70	1027.87	1043.35	1042.26	1036.18	990.03	998.32	1014.23	1014.91	992.87	997.37	1000.36	960.98	1014.01	1000.73	1010.37	1006.12	931.69	884.30	866.59	1067.60	1008.82	1021.48	893.99	Google	palm-2	12/1/2024	2021/6	Proprietary	8745.00
186.00	Gemma-1.1-2b-it	1020.68	1062.12	1051.11	1039.47	1042.33	1036.00	1010.95	1006.37	1021.59	963.04	1023.05	1017.11	955.80	1019.42	1015.72	1016.77	1013.58	1076.60	966.66	947.84	1071.44	1049.46	1020.74	992.35	Google	gemma-1.1-2b-it	12/1/2024	2024/2	Gemma license	11350.00
187.00	StripedHyena-Nous-7B	1017.56	1012.71	1046.67	1034.06	1006.96	999.51	1036.17	1012.04	999.85	1011.56	1016.11	1016.15	971.95	994.18	995.91	993.94	1013.67	1029.88	971.09	933.22	1059.20	1058.51	1022.05	989.76	Together AI	stripedhyena-nous-7b	12/1/2024	2023/12	Apache 2.0	5272.00
194.00	Mistral-7B-Instruct-v0.1	1008.12	1021.41	1048.26	1026.77	1015.82	1007.86	1036.80	1012.76	996.32	1011.17	999.28	1006.84	956.28	1019.95	1002.29	1003.86	1008.43	992.73	897.81	924.48	1037.55	1027.62	1035.00	975.35	Mistral	mistral-7b-instruct	12/1/2024	2023/9	Apache 2.0	9144.00
195.00	Llama-2-7B-chat	1036.73	992.53	1029.59	1024.29	1003.41	1002.29	1040.35	1012.33	1009.90	1027.75	1042.69	1034.64	997.63	1011.95	1009.88	1011.22	1040.97	1032.13	924.80	955.82	1061.43	1054.14	1015.49	989.44	Meta	llama-2-7b-chat	12/1/2024	2023/7	Llama 2 Community	14558.00
195.00	Vicuna-7B	1005.16	991.61	1040.45	1021.44	1001.51	981.36	1023.76	995.66	963.78	986.93	1004.14	1002.65	964.60	1047.28	989.61	979.12	989.16	1028.66	1007.14	962.43	1130.12	940.27	1046.32	1065.79	LMSYS	vicuna-7b	12/1/2024	2023/7	Llama 2 Community	7018.00
198.00	Qwen1.5-4B-Chat	988.36	1005.24	1004.61	1014.85	995.07	990.16	974.85	983.78	993.29	977.87	989.03	985.00	911.86	1004.56	977.83	965.42	966.80	1084.02	927.59	904.84	1030.10	989.94	976.01	1013.13	Alibaba	qwen1.5-4b-chat	12/1/2024	2024/2	Qianwen LICENSE	7813.00
200.00	Gemma-2B-it	989.52	1016.09	1027.06	1007.97	1008.62	1000.49	989.36	975.89	979.54	936.64	992.10	986.42	923.44	997.59	987.61	977.03	981.69	1049.22	856.64	909.93	1019.89	1045.00	965.54	985.20	Google	gemma-2b-it	12/1/2024	2024/2	Gemma license	4920.00
202.00	OLMo-7B-instruct	1015.41	998.66	960.84	993.54	978.77	1017.02	996.16	987.55	988.77	1005.27	1013.38	1013.95	964.75	1057.24	994.74	993.50	1018.26	1071.68	880.41	885.63	993.68	926.89	971.86	975.21	Allen AI	olmo-7b-instruct	12/1/2024	2024/2	Apache-2.0	6509.00
203.00	GPT4All-13B-Snoozy	931.92	943.64	1011.36	971.58	956.89	909.11	971.99	947.93	903.23	921.39	928.43	930.55	858.07	950.60	931.52	931.43	930.82	932.74	719.10	811.60	923.97	962.30	975.54	880.91	Nomic AI	gpt4all-13b-snoozy	12/1/2024	2023/3	Non-commercial	1787.00
203.00	Koala-13B	964.39	944.12	992.80	979.30	931.60	937.09	971.71	941.18	897.76	917.79	963.72	961.61	906.12	885.75	924.66	919.47	960.93	926.69	876.25	908.14	1026.23	911.72	924.49	932.45	UC Berkeley	koala-13b	12/1/2024	2023/4	Non-commercial	7037.00
204.00	Alpaca-13B	901.63	868.00	1035.89	966.65	886.85	789.20	965.40	888.69	872.66	881.44	888.87	895.57	816.29	923.68	818.30	814.11	892.48	829.24	806.39	849.40	899.28	940.44	1030.12	930.25	Stanford	alpaca-13b	12/1/2024	2023/3	Non-commercial	5875.00
204.00	ChatGLM3-6B	955.10	966.22	993.87	974.46	962.66	952.93	973.61	960.73	954.04	957.80	947.19	952.72	875.79	969.71	952.82	954.89	949.13	1123.03	788.20	820.89	1041.97	936.99	925.08	923.64	Tsinghua	chatglm3-6b	12/1/2024	2023/10	Apache-2.0	4765.00
204.00	MPT-7B-Chat	928.01	937.49	999.73	966.63	924.10	899.52	957.14	909.72	886.14	900.10	925.81	924.99	850.99	803.91	891.07	885.94	915.88	1004.84	880.58	905.35	962.74	1030.39	833.48	894.27	MosaicML	mpt-7b-chat	12/1/2024	2023/5	CC-BY-NC-SA-4.0	4013.00
209.00	RWKV-4-Raven-14B	921.70	916.10	953.99	948.47	911.62	896.33	933.74	885.72	888.17	892.10	914.56	918.50	845.73	841.35	890.80	877.99	906.22	953.02	878.32	873.34	1026.74	870.15	1002.68	911.61	RWKV	RWKV-4-Raven-14B	12/1/2024	2023/4	Apache 2.0	4934.00
209.00	ChatGLM2-6B	924.46	903.23	961.04	942.35	927.66	892.39	948.40	908.51	893.68	901.80	911.01	920.10	832.21	891.55	914.54	916.17	924.78	1046.70	764.84	660.21	924.02	922.43	852.78	851.85	Tsinghua	chatglm2-6b	12/1/2024	2023/6	Apache-2.0	2710.00
209.00	OpenAssistant-Pythia-12B	893.46	904.20	958.89	930.93	913.37	872.87	920.90	889.18	858.50	864.99	885.07	890.41	802.54	866.26	880.29	874.47	887.65	860.41	874.92	836.87	864.02	917.11	839.73	927.87	OpenAssistant	oasst-pythia-12b	12/1/2024	2023/4	Apache 2.0	6381.00
212.00	ChatGLM-6B	879.40	890.54	903.13	888.17	897.81	883.52	902.42	899.24	891.47	853.74	866.84	874.48	775.99	939.30	893.61	870.65	858.30	1131.74	721.97	688.23	976.39	809.00	725.99	709.33	Tsinghua	chatglm-6b	12/1/2024	2023/3	Non-commercial	4994.00
212.00	Dolly-V2-12B	822.28	815.17	918.00	881.01	855.64	745.60	864.24	812.67	837.52	738.33	807.06	817.80	691.94	859.53	797.40	785.98	804.36	876.35	808.26	744.94	934.32	853.61	787.02	822.04	Databricks	dolly-v2-12b	12/1/2024	2023/4	MIT	3485.00
212.00	FastChat-T5-3B	868.04	789.26	937.99	895.88	832.12	758.93	900.57	857.41	828.27	851.75	858.19	863.62	757.78	951.16	808.60	805.96	870.81	755.89	814.70	772.20	744.14	808.53	727.12	820.12	LMSYS	fastchat-t5-3b	12/1/2024	2023/4	Apache 2.0	4302.00
213.00	LLaMA-13B	799.74	745.61	880.50	866.99	797.76	668.80	796.09	778.59	803.58	751.96	788.46	797.32	649.98	803.88	723.10	711.45	779.21	853.02	744.74	698.01	956.35	635.23	804.95	816.49	Meta	llama-13b	12/1/2024	2023/2	Non-commercial	2445.00
215.00	StableLM-Tuned-Alpha-7B	840.42	865.49	882.18	858.77	841.73	858.01	868.73	830.94	804.36	819.56	829.79	834.74	713.05	880.66	830.07	825.36	830.55	893.72	708.78	722.57	860.70	798.45	745.37	826.98	Stability AI	stablelm-tuned-alpha-7b	12/1/2024	2023/4	CC-BY-NC-SA-4.0	3341.00

Back to Leaderboard History