Model Leaderboard

Viewing: October 28, 2024

LLM Model Performance Comparison
Rank	Model	Overall Score	Coding Style	Creative Writing Style	Full Style	Hard-6 Style	Coding	Creative Writing	Instruction Following	Math	Multi-turn	No Refusal	No Short	No Tie	Long User	Hard-6	Hard English-6	English	Chinese	French	German	Japanese	Korean	Russian	Spanish	Organization	Model Slug	Date	Cutoff Date	License	Battles
1.00	ChatGPT-4o-latest (2024-09-03)	1340.16	1296.93	1342.11	1299.57	1284.22	1338.79	1367.82	1337.52	1276.84	1379.58	1344.82	1342.00	1473.64	1366.22	1334.32	1320.66	1319.93	1421.71	1301.74	1327.09	1445.93	1405.62	1349.05	1325.49	OpenAI	chatgpt-4o-latest-20240903	10/28/2024	2023/10	Proprietary	5004.00
2.00	ChatGPT-4o-latest (2024-08-08)	1316.13	1293.30	1319.54	1290.20	1278.13	1323.60	1327.60	1320.15	1273.09	1346.30	1320.55	1318.20	1432.97	1344.11	1315.33	1305.18	1295.68	1372.25	1286.42	1318.75	1418.70	1400.40	1336.65	1310.91	OpenAI	chatgpt-4o-latest-20240808	10/28/2024	2023/10	Proprietary	5870.00
2.00	Gemini-1.5-Pro-002	1303.09	1251.67	1305.99	1268.71	1267.00	1288.79	1330.20	1302.93	1284.52	1307.46	1307.89	1304.54	1410.84	1315.78	1300.65	1288.00	1273.17	1395.06	1220.87	1280.83	1436.22	1408.62	1333.15	1317.35	Google	gemini-1.5-pro-002	10/28/2024	-	Proprietary	2288.00
2.00	Gemini-1.5-Pro-Exp-0801	1297.52	1251.85	1309.18	1268.17	1253.88	1276.71	1327.43	1289.44	1260.88	1304.85	1301.47	1298.88	1401.18	1299.18	1277.58	1260.61	1267.21	1368.67	1295.95	1291.40	1424.50	1397.66	1333.90	1296.90	Google	gemini-1.5-pro-exp-0801	10/28/2024	2023/11	Proprietary	4338.00
2.00	Gemini-1.5-Pro-Exp-0827	1299.06	1266.03	1297.90	1267.75	1261.49	1287.33	1319.95	1293.71	1273.15	1306.43	1303.77	1300.45	1407.94	1322.11	1288.40	1274.62	1268.33	1384.81	1276.67	1303.03	1422.55	1400.67	1341.12	1306.52	Google	gemini-1.5-pro-exp-0827	10/28/2024	2023/11	Proprietary	5058.00
2.00	o1-preview	1335.14	1307.84	1319.82	1301.58	1308.01	1353.70	1323.27	1349.04	1345.75	1370.57	1346.67	1337.04	1456.52	1355.27	1352.75	1352.92	1328.08	1385.34	1297.16	1308.87	1437.74	1403.04	1335.40	1297.81	OpenAI	o1-preview	10/28/2024	2023/10	Proprietary	3126.00
10.00	Claude 3.5 Sonnet (20241022)	1286.47	1320.85	1314.95	1287.38	1300.72	1336.70	1286.38	1301.61	1284.05	1336.00	1292.81	1287.23	1381.52	1323.77	1305.05	1300.71	1262.72	1326.66	1238.28	1286.28	1396.41	1374.31	1329.30	1286.25	Anthropic	claude-3-5-sonnet-20241022	10/28/2024	2024/4	Proprietary	885.00
10.00	Gemini-1.5-Flash-002	1272.01	1206.62	1249.83	1227.18	1208.79	1252.99	1289.00	1266.21	1236.87	1258.23	1278.19	1273.55	1361.05	1295.78	1250.99	1242.66	1240.14	1348.34	1221.16	1258.36	1408.68	1342.67	1307.23	1234.40	Google	gemini-1.5-flash-002	10/28/2024	-	Proprietary	1802.00
11.00	GPT-4o-2024-05-13	1284.78	1263.53	1285.55	1261.56	1251.06	1292.49	1289.56	1287.70	1255.46	1302.32	1289.23	1286.50	1378.53	1301.80	1284.70	1275.29	1262.64	1335.67	1258.21	1278.05	1401.88	1365.00	1305.49	1281.86	OpenAI	gpt-4o-2024-05-13	10/28/2024	2023/10	Proprietary	15414.00
11.00	Grok-2-08-13	1289.99	1255.87	1262.66	1248.09	1240.20	1286.66	1284.03	1278.88	1252.72	1295.29	1294.66	1291.68	1388.85	1289.85	1277.05	1267.26	1272.49	1351.32	1264.12	1282.99	1390.10	1370.86	1305.77	1279.62	xAI	grok-2-2024-08-13	10/28/2024	2024/3	Proprietary	6199.00
11.00	Yi-Lightning	1285.17	1256.78	1241.21	1241.35	1247.11	1300.27	1275.55	1283.10	1269.18	1310.29	1289.50	1286.88	1383.10	1299.93	1297.81	1298.44	1277.38	1368.81	1248.04	1259.70	1368.45	1327.65	1272.49	1316.91	01 AI	yi-lightning	10/28/2024	-	Proprietary	3054.00
12.00	Gemini-1.5-Flash-Exp-0827	1268.85	1238.96	1247.67	1237.05	1235.79	1257.88	1273.81	1265.22	1242.98	1285.23	1273.21	1270.22	1358.02	1310.39	1263.43	1249.97	1236.75	1352.35	1258.36	1266.27	1381.81	1366.96	1309.65	1274.96	Google	gemini-1.5-flash-exp-0827	10/28/2024	2023/11	Proprietary	3928.00
12.00	Gemini Advanced App (2024-05-14)	1266.47	1238.01	1281.56	1252.51	1236.87	1254.71	1275.12	1259.24	1238.39	1273.27	1270.09	1267.53	1348.77	1263.23	1253.31	1235.00	1234.37	1332.14	1257.02	1269.10	1382.18	1370.82	1304.30	1239.51	Google	gemini-advanced-0514	10/28/2024	Online	Proprietary	7370.00
13.00	Gemini-1.5-Pro-Preview-0409	1257.37	1204.40	1254.36	1215.59	1198.99	1231.38	1274.47	1248.81	1213.29	1254.83	1260.93	1259.47	1330.06	1247.89	1232.73	1220.13	1233.46	1315.36	1256.63	1253.81	1347.39	1414.81	1302.40	1264.87	Google	gemini-1.5-pro-api-0409-preview	10/28/2024	2023/11	Proprietary	8493.00
14.00	Gemini-1.5-Pro-001	1259.58	1243.05	1271.55	1238.71	1237.77	1262.30	1274.65	1261.90	1237.59	1267.09	1266.28	1260.68	1338.95	1293.78	1258.26	1243.39	1231.15	1329.54	1229.75	1245.20	1381.47	1359.12	1296.53	1237.93	Google	gemini-1.5-pro-001	10/28/2024	2023/11	Proprietary	12535.00
14.00	GLM-4-Plus	1275.44	1246.71	1240.82	1233.63	1231.70	1285.47	1267.03	1275.62	1245.00	1284.43	1281.07	1276.76	1366.67	1294.68	1275.32	1261.59	1250.48	1350.32	1252.78	1266.70	1365.94	1371.91	1294.17	1305.64	Zhipu AI	glm-4-plus	10/28/2024	-	Proprietary	3057.00
14.00	GPT-4o-2024-08-06	1264.01	1249.16	1272.94	1247.79	1238.06	1273.24	1271.79	1269.84	1252.51	1275.20	1269.09	1265.17	1346.25	1288.40	1267.30	1257.97	1244.72	1307.63	1219.41	1254.85	1372.61	1356.79	1286.37	1263.88	OpenAI	gpt-4o-2024-08-06	10/28/2024	2023/10	Proprietary	5413.00
14.00	GPT-4o-mini-2024-07-18	1272.93	1244.14	1241.87	1231.46	1221.16	1284.73	1267.55	1265.88	1231.47	1292.26	1277.79	1274.04	1363.03	1294.53	1268.59	1258.13	1253.55	1320.59	1253.54	1270.56	1358.74	1330.29	1293.46	1273.66	OpenAI	gpt-4o-mini-2024-07-18	10/28/2024	2023/10	Proprietary	6698.00
14.00	Llama-3.1-Nemotron-70b-Instruct	1270.74	1235.27	1220.09	1214.73	1219.66	1278.04	1263.37	1263.50	1246.33	1279.59	1275.06	1272.53	1359.75	1247.20	1263.62	1268.27	1266.94	1318.99	1269.06	1329.70	1341.87	1277.66	1248.44	1286.43	Nvidia	llama-3.1-nemotron-70b-instruct	10/28/2024	2023/12	Llama 3.1	938.00
15.00	GPT-4-Turbo-2024-04-09	1256.44	1239.22	1269.83	1240.92	1226.87	1263.13	1266.54	1260.72	1242.52	1267.42	1260.71	1258.20	1332.16	1264.76	1254.76	1248.57	1241.47	1301.02	1225.48	1254.49	1336.45	1319.09	1272.96	1253.86	OpenAI	gpt-4-turbo-2024-04-09	10/28/2024	2023/12	Proprietary	14734.00
16.00	Meta-Llama-3.1-405b-Instruct-fp8	1266.74	1256.24	1255.16	1251.46	1248.47	1277.48	1263.19	1269.94	1248.13	1293.68	1270.55	1268.09	1351.43	1271.87	1267.46	1266.95	1260.50	1286.54	1245.55	1246.23	1310.99	1318.22	1284.50	1254.38	Meta	llama-3.1-405b-instruct-fp8	10/28/2024	2023/12	Llama 3.1 Community	6790.00
16.00	Yi-Lightning-lite	1264.66	1236.72	1248.26	1236.70	1234.32	1267.34	1260.25	1268.47	1246.76	1292.46	1270.62	1266.32	1348.12	1288.79	1272.09	1261.48	1247.72	1320.10	1266.25	1265.05	1365.08	1308.80	1269.75	1273.43	01 AI	yi-lightning-lite	10/28/2024	-	Proprietary	2684.00
17.00	Meta-Llama-3.1-405b-Instruct-bf16	1265.71	1262.45	1247.40	1251.06	1253.87	1283.44	1255.49	1265.40	1255.28	1288.83	1269.66	1266.55	1350.68	1276.34	1272.55	1275.70	1260.20	1287.93	1216.88	1247.07	1346.60	1306.72	1273.19	1250.42	Meta	llama-3.1-405b-instruct-bf16	10/28/2024	2023/12	Llama 3.1 Community	2147.00
23.00	Qwen-Max-0919	1262.65	1241.15	1233.09	1228.30	1231.13	1276.84	1249.60	1271.27	1244.42	1279.58	1268.48	1264.37	1344.04	1297.65	1272.32	1260.93	1243.38	1306.21	1276.83	1248.22	1354.81	1287.86	1289.50	1276.77	Alibaba	qwen-max-0919	10/28/2024	-	Qwen	2255.00
26.00	Gemma-2-9b-it-SimPO	1215.25	1179.14	1235.19	1197.28	1185.97	1196.96	1241.95	1203.15	1145.12	1225.21	1218.43	1216.58	1268.62	1237.82	1203.45	1187.11	1195.71	1281.74	1181.97	1215.37	1290.84	1264.62	1247.16	1203.79	Princeton	gemma-2-9b-it-simpo	10/28/2024	2024/7	MIT	1806.00
26.00	Grok-2-Mini-08-13	1266.90	1228.22	1224.56	1221.63	1218.90	1261.85	1248.65	1257.72	1237.99	1269.01	1271.09	1268.18	1352.54	1273.67	1259.80	1253.78	1252.56	1314.88	1230.33	1267.64	1361.26	1335.63	1280.38	1258.34	xAI	grok-2-mini-2024-08-13	10/28/2024	2024/3	Proprietary	5308.00
28.00	GPT-4-1106-preview	1250.21	1231.61	1240.81	1234.10	1226.61	1253.13	1248.00	1250.01	1242.46	1260.32	1257.39	1251.51	1318.65	1248.82	1246.81	1238.81	1231.74	1299.00	1240.72	1247.42	1336.33	1319.69	1272.01	1260.61	OpenAI	gpt-4-1106-preview	10/28/2024	2023/4	Proprietary	16201.00
28.00	Mistral-Large-2407	1250.85	1242.50	1239.76	1229.46	1232.21	1268.49	1246.79	1257.08	1233.22	1262.45	1255.33	1252.42	1326.09	1271.25	1260.78	1253.07	1237.54	1299.02	1219.15	1245.30	1344.20	1314.07	1276.32	1233.75	Mistral	mistral-large-2407	10/28/2024	2024/7	Mistral Research	5998.00
28.00	o1-mini	1308.23	1304.17	1224.84	1256.47	1285.66	1367.04	1242.67	1315.57	1335.78	1327.35	1317.46	1309.73	1417.26	1332.99	1343.98	1341.04	1297.92	1370.92	1250.63	1280.26	1395.22	1383.46	1310.10	1292.84	OpenAI	o1-mini	10/28/2024	2023/10	Proprietary	3533.00
28.00	Reka-Core-20240722	1230.22	1190.75	1220.83	1202.99	1185.92	1208.27	1240.44	1212.63	1185.79	1237.30	1233.87	1230.67	1292.96	1232.77	1205.15	1191.06	1204.79	1300.27	1231.70	1209.87	1309.28	1330.59	1265.93	1221.56	Reka AI	reka-core-20240722	10/28/2024	-	Proprietary	2090.00
29.00	Athene-70b	1249.86	1233.16	1218.16	1220.64	1224.08	1253.48	1238.08	1233.98	1200.73	1255.10	1253.59	1250.30	1326.69	1241.29	1247.17	1241.02	1237.73	1293.62	1236.04	1245.35	1286.49	1296.77	1271.32	1246.69	NexusFlow	athene-70b-0725	10/28/2024	2024/7	CC-BY-NC-4.0	3289.00
29.00	Claude 3.5 Sonnet (20240620)	1268.33	1281.76	1254.95	1258.40	1270.22	1295.96	1241.40	1280.92	1273.20	1305.34	1276.58	1269.86	1352.46	1287.52	1280.01	1269.23	1241.39	1321.00	1247.10	1265.52	1369.81	1341.05	1302.19	1285.25	Anthropic	claude-3-5-sonnet-20240620	10/28/2024	2024/4	Proprietary	12582.00
29.00	Claude 3 Opus	1247.53	1235.22	1239.28	1237.91	1234.42	1250.41	1240.46	1257.42	1239.11	1278.18	1259.46	1249.26	1316.73	1269.90	1245.48	1227.97	1214.04	1312.25	1228.71	1251.54	1350.60	1323.12	1306.70	1243.91	Anthropic	claude-3-opus-20240229	10/28/2024	2023/8	Proprietary	26227.00
29.00	Command R+ (08-2024)	1214.94	1165.58	1214.83	1196.20	1171.12	1181.22	1235.68	1205.65	1163.42	1216.30	1222.24	1216.43	1265.81	1242.54	1188.78	1178.20	1189.22	1283.23	1159.83	1212.50	1312.20	1309.92	1248.88	1230.39	Cohere	command-r-plus-08-2024	10/28/2024	2024/8	CC-BY-NC-4.0	1599.00
29.00	Deepseek-v2.5	1255.74	1250.24	1212.04	1221.06	1234.79	1283.96	1237.08	1255.61	1240.60	1257.96	1260.36	1256.87	1333.99	1281.40	1274.63	1263.85	1236.06	1338.54	1230.43	1222.46	1321.12	1308.98	1276.15	1240.40	DeepSeek	deepseek-v2.5	10/28/2024	-	DeepSeek	2547.00
29.00	Gemma-2-27b-it	1219.17	1202.18	1238.59	1204.96	1192.06	1209.49	1240.96	1213.45	1186.25	1226.05	1224.13	1220.06	1274.72	1234.09	1203.72	1191.50	1194.10	1277.82	1183.81	1206.86	1320.40	1318.33	1255.21	1227.05	Google	gemma-2-27b-it	10/28/2024	2024/6	Gemma license	7802.00
29.00	Yi-Large-preview	1239.53	1208.47	1205.03	1205.22	1204.85	1244.91	1240.29	1236.21	1218.77	1235.08	1243.74	1241.42	1309.16	1246.85	1239.63	1228.76	1216.37	1315.88	1202.71	1225.48	1357.41	1285.51	1271.18	1244.09	01 AI	yi-large-preview	10/28/2024	Unknown	Proprietary	7458.00
30.00	GPT-4-0125-preview	1244.96	1220.87	1236.90	1229.95	1217.78	1243.58	1238.07	1244.75	1236.64	1255.35	1251.19	1246.50	1311.52	1249.11	1241.50	1234.49	1226.53	1295.75	1232.78	1237.76	1342.48	1310.33	1260.71	1244.39	OpenAI	gpt-4-0125-preview	10/28/2024	2023/12	Proprietary	14544.00
30.00	Meta-Llama-3.1-70b-Instruct	1246.94	1217.38	1211.85	1211.09	1208.66	1249.57	1236.31	1239.41	1220.48	1259.46	1250.52	1248.02	1321.16	1248.00	1242.23	1244.26	1246.18	1274.29	1204.16	1221.35	1280.51	1276.39	1251.36	1244.65	Meta	llama-3.1-70b-instruct	10/28/2024	2023/12	Llama 3.1 Community	5999.00
30.00	Qwen2.5-72b-Instruct	1258.35	1243.82	1212.11	1220.40	1223.69	1281.35	1231.99	1265.23	1249.26	1272.91	1263.22	1259.95	1337.26	1287.56	1267.20	1256.29	1239.39	1326.31	1235.51	1225.06	1313.99	1334.70	1277.65	1258.66	Alibaba	qwen2.5-72b-instruct	10/28/2024	2024/9	Qwen	2577.00
38.00	Gemini-1.5-Flash-001	1226.73	1207.18	1215.57	1202.00	1200.05	1231.62	1227.73	1222.34	1199.33	1232.10	1232.14	1227.36	1287.77	1263.01	1224.64	1210.72	1200.33	1290.93	1195.65	1211.50	1331.30	1332.92	1258.87	1222.74	Google	gemini-1.5-flash-001	10/28/2024	2023/11	Proprietary	9581.00
41.00	Jamba-1.5-Large	1220.90	1207.37	1214.08	1202.71	1192.54	1228.01	1217.16	1220.46	1189.85	1223.25	1224.69	1221.38	1277.77	1214.47	1219.58	1215.24	1217.31	1260.23	1198.06	1196.54	1267.88	1281.01	1214.28	1246.61	AI21 Labs	jamba-1.5-large	10/28/2024	2024/3	Jamba Open	1499.00
42.00	Gemini-1.5-Flash-8B-001	1211.15	1162.99	1189.08	1176.30	1171.03	1204.93	1218.94	1208.24	1183.28	1189.71	1216.80	1212.00	1260.67	1231.94	1209.20	1192.63	1179.44	1283.41	1188.25	1179.31	1283.55	1286.55	1259.41	1217.99	Google	gemini-1.5-flash-8b-001	10/28/2024	-	Proprietary	1928.00
44.00	Qwen-Plus-0828	1227.17	1215.88	1213.02	1204.26	1207.41	1245.24	1219.55	1234.73	1216.79	1248.62	1231.90	1228.88	1284.27	1266.82	1241.69	1234.89	1217.59	1312.42	1164.86	1180.87	1294.29	1267.06	1268.16	1243.22	Alibaba	qwen-plus-0828	10/28/2024	-	Proprietary	2244.00
48.00	Gemini-1.5-Flash-8b-Exp-0827	1205.06	1160.20	1183.10	1170.69	1161.61	1189.58	1213.49	1199.00	1172.48	1201.20	1209.39	1205.76	1251.53	1232.00	1196.17	1181.59	1176.26	1273.25	1190.55	1181.33	1303.43	1300.06	1250.62	1221.63	Google	gemini-1.5-flash-8b-exp-0827	10/28/2024	2023/11	Proprietary	3830.00
48.00	Llama-3.1-Nemotron-51b-Instruct	1218.48	1200.10	1193.85	1212.12	1188.70	1218.40	1193.53	1210.46	1185.27	1222.55	1223.97	1220.54	1273.09	1234.59	1201.85	1165.06	1221.42	1247.23	1183.39	1185.63	1190.14	1299.68	1225.46	1228.51	Nvidia	llama-3.1-nemotron-51b-instruct	10/28/2024	2023/12	Llama 3.1	250.00
52.00	Llama-3-70b-Instruct	1206.40	1190.60	1207.31	1193.97	1187.17	1199.55	1213.67	1199.26	1188.71	1224.70	1208.76	1206.78	1257.68	1185.48	1197.01	1211.60	1226.23	1175.88	1183.84	1166.32	1177.50	1168.91	1186.61	1240.98	Meta	llama-3-70b-instruct	10/28/2024	2023/12	Llama 3 Community	23930.00
53.00	Gemini App (2024-01-24)	1208.58	1161.53	1167.42	1178.85	1141.71	1171.19	1193.15	1158.55	1135.36	1198.21	1212.64	1208.04	1249.00	1133.52	1156.58	1141.90	1181.92	1274.91	1262.88	1243.27	1333.05	1406.69	1259.37	1226.12	Google	bard-jan-24-gemini-pro	10/28/2024	Online	Proprietary	1786.00
53.00	Deepseek-v2-API-0628	1219.36	1221.96	1198.80	1200.72	1210.41	1241.70	1207.38	1221.25	1216.78	1228.85	1223.21	1220.83	1274.97	1243.29	1233.79	1223.52	1198.48	1282.01	1201.15	1201.78	1303.94	1273.30	1258.19	1217.43	DeepSeek AI	deepseek-v2-api-0628	10/28/2024	-	DeepSeek	3203.00
53.00	Gemma-2-9b-it	1189.63	1163.36	1206.98	1176.08	1159.91	1167.91	1207.88	1182.33	1151.84	1192.68	1193.90	1190.04	1226.36	1205.86	1169.68	1157.12	1168.06	1242.91	1153.25	1184.05	1282.15	1276.51	1221.71	1199.66	Google	gemma-2-9b-it	10/28/2024	2024/6	Gemma license	5771.00
53.00	GLM-4-0520	1206.44	1191.57	1192.28	1187.06	1188.66	1216.03	1197.89	1209.16	1188.38	1221.09	1209.67	1207.56	1257.12	1217.48	1213.41	1201.35	1190.23	1289.15	1160.84	1177.97	1271.80	1190.63	1235.17	1220.42	Zhipu AI	glm-4-0520	10/28/2024	Unknown	Proprietary	1652.00
53.00	Nemotron-4-340B-Instruct	1209.11	1187.15	1192.37	1195.86	1188.82	1198.07	1207.26	1212.14	1186.23	1216.99	1213.28	1210.32	1261.40	1231.93	1202.31	1184.73	1186.66	1270.40	1148.87	1187.70	1278.96	1283.31	1243.57	1195.75	Nvidia	nemotron-4-340b-instruct	10/28/2024	2023/6	NVIDIA Open Model	3378.00
53.00	Reka-Flash-20240722	1200.64	1173.07	1177.63	1179.25	1164.53	1187.31	1196.97	1187.87	1160.68	1197.80	1204.67	1200.69	1244.76	1194.40	1178.27	1167.81	1173.96	1269.40	1197.11	1202.68	1288.42	1287.65	1246.96	1213.98	Reka AI	reka-flash-20240722	10/28/2024	-	Proprietary	2133.00
53.00	Yi-Large	1212.48	1194.29	1189.77	1193.74	1184.73	1219.54	1202.38	1207.94	1195.33	1219.56	1219.08	1213.36	1266.65	1218.38	1208.54	1197.61	1194.72	1267.59	1168.54	1198.04	1312.92	1264.76	1244.20	1208.75	01 AI	yi-large	10/28/2024	Unknown	Proprietary	2638.00
55.00	Command R+ (04-2024)	1189.80	1153.96	1185.97	1182.52	1159.72	1164.40	1199.32	1187.13	1136.88	1196.91	1194.23	1191.23	1231.62	1214.89	1168.85	1154.22	1163.05	1254.12	1159.71	1188.83	1304.74	1272.10	1224.33	1182.00	Cohere	command-r-plus	10/28/2024	2024/3	CC-BY-NC-4.0	11581.00
56.00	Deepseek-Coder-v2-0724	1213.89	1242.78	1185.72	1195.76	1209.64	1266.22	1189.52	1220.97	1210.13	1218.17	1221.04	1215.61	1266.02	1253.89	1235.05	1233.54	1194.76	1285.43	1184.20	1201.45	1293.61	1256.83	1240.67	1202.37	DeepSeek	deepseek-coder-v2-0724	10/28/2024	-	Proprietary	1945.00
57.00	Reka-Core-20240501	1199.49	1172.35	1180.68	1176.33	1167.59	1190.10	1195.78	1186.08	1159.46	1188.78	1203.79	1200.99	1246.13	1192.61	1186.84	1173.53	1176.02	1260.73	1178.84	1197.70	1283.36	1272.66	1229.31	1188.76	Reka AI	reka-core-20240501	10/28/2024	-	Proprietary	9262.00
60.00	GLM-4-0116	1183.20	1167.13	1169.37	1162.15	1164.27	1190.77	1180.24	1180.91	1162.31	1181.25	1186.35	1185.92	1221.06	1193.61	1186.78	1176.65	1177.11	1274.96	1129.80	1153.70	1244.95	1146.08	1181.98	1198.61	Zhipu AI	glm-4-0116	10/28/2024	Unknown	Proprietary	1025.00
60.00	GPT-4-0314	1186.20	1202.34	1203.26	1199.77	1203.08	1195.42	1189.63	1204.65	1194.21	1201.15	1189.22	1187.39	1222.99	1200.40	1195.95	1183.69	1164.43	1236.74	1178.31	1197.97	1275.94	1233.99	1218.85	1196.94	OpenAI	gpt-4-0314	10/28/2024	2021/9	Proprietary	8496.00
62.00	Claude 3 Sonnet	1200.98	1201.07	1197.44	1196.84	1190.16	1212.96	1187.56	1204.64	1181.65	1226.73	1209.23	1202.04	1246.28	1222.33	1198.99	1186.62	1175.29	1245.40	1180.76	1198.72	1287.02	1264.30	1247.17	1206.03	Anthropic	claude-3-sonnet-20240229	10/28/2024	2023/8	Proprietary	16233.00
62.00	GPT-4-0613	1163.06	1179.92	1211.58	1185.73	1182.25	1166.85	1187.23	1188.52	1178.12	1174.40	1168.54	1164.19	1187.46	1193.35	1168.00	1164.06	1147.96	1182.32	1122.25	1156.41	1268.10	1204.20	1195.07	1167.91	OpenAI	gpt-4-0613	10/28/2024	2021/9	Proprietary	14377.00
63.00	Command R (08-2024)	1179.38	1160.09	1168.49	1175.19	1164.99	1161.37	1179.17	1178.85	1129.64	1168.26	1184.70	1180.51	1203.54	1211.93	1169.39	1159.28	1154.46	1240.81	1137.27	1169.32	1296.25	1291.26	1200.68	1169.84	Cohere	command-r-08-2024	10/28/2024	2024/8	CC-BY-NC-4.0	1559.00
64.00	Qwen2-72B-Instruct	1187.03	1177.87	1176.58	1180.35	1177.98	1186.50	1183.28	1190.17	1202.56	1196.73	1192.25	1187.95	1225.26	1200.39	1189.17	1184.51	1171.09	1293.28	1127.65	1146.28	1265.83	1224.57	1194.77	1171.86	Alibaba	qwen2-72b-instruct	10/28/2024	2024/6	Qianwen LICENSE	5857.00
65.00	Jamba-1.5-Mini	1175.92	1164.12	1166.14	1158.10	1145.65	1181.18	1171.41	1158.51	1132.58	1162.63	1179.92	1176.51	1202.45	1170.70	1169.17	1166.14	1177.71	1195.92	1133.48	1159.18	1173.89	1181.18	1178.99	1222.13	AI21 Labs	jamba-1.5-mini	10/28/2024	2024/3	Jamba Open	1494.00
65.00	Qwen-Max-0428	1182.87	1174.48	1164.05	1170.78	1167.55	1189.40	1177.52	1180.19	1167.22	1175.01	1186.62	1183.76	1219.41	1197.98	1186.25	1177.78	1167.79	1292.97	1161.67	1130.21	1265.51	1219.00	1179.28	1155.06	Alibaba	qwen-max-0428	10/28/2024	-	Proprietary	3711.00
75.00	Claude 3 Haiku	1179.25	1183.15	1170.21	1176.84	1173.96	1189.36	1163.11	1181.75	1159.61	1191.53	1188.31	1179.57	1213.83	1199.31	1178.02	1167.90	1157.59	1211.24	1150.30	1169.21	1256.34	1249.85	1223.68	1169.67	Anthropic	claude-3-haiku-20240307	10/28/2024	2023/8	Proprietary	17387.00
76.00	Mistral Medium	1147.77	1141.53	1147.17	1140.93	1136.90	1152.52	1160.68	1153.67	1139.61	1145.35	1148.31	1148.20	1167.77	1162.70	1144.21	1132.12	1137.89	1164.72	1132.91	1149.49	1182.76	1165.76	1189.42	1144.07	Mistral	mistral-medium	10/28/2024	-	Proprietary	5718.00
77.00	Command R (04-2024)	1148.71	1124.69	1153.18	1147.83	1122.82	1122.91	1159.24	1132.32	1089.27	1148.59	1150.87	1148.46	1167.94	1166.96	1119.40	1105.67	1123.31	1208.82	1112.69	1123.20	1246.82	1238.46	1183.89	1151.09	Cohere	command-r	10/28/2024	2024/3	CC-BY-NC-4.0	8233.00
77.00	Llama-3-8b-Instruct	1151.86	1138.44	1150.58	1141.51	1128.89	1145.97	1154.74	1136.77	1119.03	1152.88	1154.25	1150.89	1170.77	1136.11	1137.08	1144.14	1163.59	1134.93	1113.59	1101.69	1138.32	1150.37	1138.18	1173.88	Meta	llama-3-8b-instruct	10/28/2024	2023/3	Llama 3 Community	16155.00
77.00	Meta-Llama-3.1-8b-Instruct	1173.33	1140.41	1126.78	1127.35	1138.33	1183.48	1157.25	1169.90	1146.47	1172.82	1177.55	1173.84	1198.70	1194.12	1180.27	1179.17	1169.21	1206.21	1129.11	1142.86	1212.78	1205.22	1178.11	1185.93	Meta	llama-3.1-8b-instruct	10/28/2024	2023/12	Llama 3.1 Community	5688.00
77.00	Mistral-Large-2402	1157.16	1170.11	1158.88	1157.51	1164.20	1169.57	1159.22	1172.50	1164.90	1165.66	1159.29	1158.48	1180.93	1176.97	1165.30	1157.15	1146.07	1178.43	1161.82	1173.84	1173.92	1158.95	1195.43	1193.40	Mistral	mistral-large-2402	10/28/2024	-	Proprietary	9459.00
77.00	Reka-Flash-Preview-20240611	1164.95	1145.90	1148.09	1150.94	1136.43	1155.22	1158.12	1146.43	1127.23	1148.61	1168.14	1165.36	1189.38	1147.02	1144.53	1130.75	1141.75	1218.58	1140.82	1161.65	1251.25	1249.44	1196.06	1175.69	Reka AI	reka-flash-preview-20240611	10/28/2024	-	Proprietary	3207.00
77.00	WizardLM-70B-v1.0	1106.13	1070.67	1149.21	1104.40	1074.62	1071.00	1151.89	1102.22	1076.33	1108.99	1103.10	1105.37	1105.64	1104.93	1077.30	1072.55	1097.85	1113.24	1034.11	1083.96	1168.81	1065.15	1166.07	1084.03	Microsoft	wizardlm-70b	10/28/2024	2023/8	Llama 2 Community	1800.00
80.00	Qwen1.5-110B-Chat	1161.40	1162.84	1146.61	1154.95	1154.14	1174.40	1149.90	1163.18	1150.63	1158.78	1164.65	1161.33	1184.63	1166.55	1168.77	1166.70	1150.48	1259.70	1106.38	1117.58	1227.72	1186.67	1144.66	1144.44	Alibaba	qwen1.5-110b-chat	10/28/2024	2024/4	Qianwen LICENSE	3857.00
81.00	Mixtral-8x22b-Instruct-v0.1	1147.49	1151.75	1147.01	1149.21	1146.59	1152.78	1146.81	1154.85	1152.40	1130.94	1150.60	1148.43	1163.62	1155.63	1148.63	1143.00	1136.49	1177.56	1121.13	1139.08	1194.57	1196.52	1179.53	1143.99	Mistral	mixtral-8x22b-instruct-v0.1	10/28/2024	2024/4	Apache 2.0	7871.00
81.00	Yi-1.5-34B-Chat	1157.12	1134.37	1119.22	1132.16	1135.05	1162.12	1144.25	1147.20	1150.23	1158.06	1160.17	1157.51	1178.89	1158.69	1159.96	1159.79	1163.27	1266.89	1110.94	1106.54	1179.39	1150.49	1118.74	1124.17	01 AI	yi-1.5-34b-chat	10/28/2024	2024/5	Apache-2.0	3807.00
83.00	Gemma-2-2b-it	1138.60	1081.21	1126.30	1110.37	1091.66	1098.70	1143.36	1121.32	1106.22	1114.03	1142.89	1138.64	1137.78	1139.83	1111.53	1108.22	1128.68	1182.93	1124.75	1112.15	1238.71	1210.26	1133.41	1132.61	Google	gemma-2-2b-it	10/28/2024	2024/7	Gemma license	4394.00
83.00	InternLM2.5-20b-chat	1149.69	1136.32	1094.73	1115.47	1141.68	1159.32	1134.99	1153.04	1158.78	1138.73	1155.18	1150.17	1153.89	1171.04	1166.01	1175.74	1157.36	1259.46	1034.10	1058.34	1194.25	1158.71	1139.43	1122.83	InternLM	internlm2_5-20b-chat	10/28/2024	2024/8	Other	1609.00
83.00	Vicuna-33B	1090.66	1068.37	1131.93	1091.27	1066.60	1067.06	1136.53	1073.60	1036.22	1086.81	1087.24	1090.08	1082.59	1044.12	1066.03	1060.94	1086.47	1093.46	1054.65	1055.10	1147.52	978.03	1100.20	1085.85	LMSYS	vicuna-33b	10/28/2024	2023/8	Non-commercial	4088.00
87.00	Claude-1	1148.78	1149.58	1164.36	1158.83	1135.25	1135.87	1134.31	1141.38	1114.71	1171.73	1165.96	1148.36	1167.69	1163.71	1125.75	1117.07	1129.35	1195.18	1115.26	1172.99	1230.43	1102.11	1193.11	1171.56	Anthropic	claude-1	10/28/2024	-	Proprietary	3470.00
87.00	DeepSeek-Coder-V2-Instruct	1178.32	1225.86	1158.65	1181.19	1196.94	1239.38	1128.01	1189.49	1211.35	1180.28	1204.85	1179.65	1211.97	1224.69	1211.30	1202.82	1150.23	1259.16	1138.67	1159.18	1283.72	1247.54	1210.51	1151.99	DeepSeek AI	deepseek-coder-v2	10/28/2024	2024/6	DeepSeek License	2444.00
87.00	Gemini-1.0-Pro-001	1131.42	1119.70	1152.84	1146.63	1125.36	1102.72	1133.73	1118.81	1099.28	1119.32	1133.48	1130.56	1144.66	1143.74	1105.76	1095.41	1108.45	1181.19	1101.56	1124.55	1200.18	1220.45	1207.95	1127.56	Google	gemini-pro-dev-api	10/28/2024	2023/4	Proprietary	3128.00
87.00	Mistral-Next	1124.37	1154.95	1165.07	1149.60	1148.93	1132.44	1135.42	1157.95	1140.22	1136.94	1126.36	1124.91	1130.71	1150.81	1129.18	1121.61	1110.18	1134.70	1111.15	1154.90	1138.36	1041.06	1171.97	1129.99	Mistral	mistral-next	10/28/2024	-	Proprietary	1871.00
87.00	OpenChat-3.5	1076.37	1067.09	1133.68	1094.51	1077.04	1053.66	1126.68	1074.38	1035.04	1087.59	1069.95	1076.44	1062.48	1108.64	1065.43	1055.68	1064.75	1124.77	1064.33	1038.95	1109.13	1095.76	1127.43	1081.23	OpenChat	openchat-3.5	10/28/2024	2023/11	Apache-2.0	1482.00
87.00	Qwen1.5-72B-Chat	1147.33	1156.62	1136.42	1147.64	1142.61	1160.00	1135.53	1144.21	1128.42	1153.73	1150.39	1147.29	1166.02	1165.75	1146.82	1140.88	1135.13	1240.60	1112.33	1077.81	1218.66	1188.93	1128.05	1111.73	Alibaba	qwen1.5-72b-chat	10/28/2024	2024/2	Qianwen LICENSE	6084.00
87.00	Reka-Flash-21B	1147.52	1138.42	1128.25	1141.20	1134.69	1141.09	1128.32	1129.67	1123.71	1142.09	1150.56	1147.17	1165.33	1151.10	1133.69	1126.76	1126.04	1193.73	1128.56	1150.47	1210.90	1217.28	1181.16	1140.88	Reka AI	reka-flash-21b-20240226	10/28/2024	2023/11	Proprietary	3657.00
87.00	Reka-Flash-21B-online	1155.76	1145.15	1130.45	1150.73	1144.02	1146.88	1131.04	1138.04	1140.45	1149.50	1157.93	1155.73	1179.14	1151.04	1142.87	1133.30	1136.03	1195.98	1111.72	1148.04	1231.57	1245.42	1188.94	1146.54	Reka AI	reka-flash-21b-20240226-online	10/28/2024	Online	Proprietary	2212.00
91.00	falcon-180b-chat	1034.01	1041.22	1108.65	1059.16	1019.59	1016.61	1094.98	1052.69	1012.93	1012.43	1031.14	1034.21	1002.64	1055.68	1000.45	1009.85	1026.25	1002.20	950.63	1148.07	1166.33	461.86	864.44	1102.02	TII	falcon-180b-chat	10/28/2024	2023/9	Falcon-180B TII License	275.00
91.00	Zephyr-ORPO-141b-A35b-v0.1	1127.48	1126.41	1117.14	1130.66	1119.44	1124.44	1114.03	1129.01	1118.43	1103.45	1129.47	1127.46	1137.56	1118.91	1116.97	1113.09	1119.37	1143.59	1138.95	1089.46	1186.43	1170.94	1141.47	1104.19	HuggingFace	zephyr-orpo-141b-A35b-v0.1	10/28/2024	2024/4	Apache 2.0	676.00
92.00	Nous-Hermes-2-Mixtral-8x7B-DPO	1084.22	1066.51	1089.80	1071.11	1035.89	1079.50	1104.96	1054.55	1028.27	1079.11	1085.55	1083.88	1074.51	1060.43	1052.19	1045.31	1078.08	1076.24	1077.94	1027.84	1159.21	1172.64	1083.08	1024.30	NousResearch	nous-hermes-2-mixtral-8x7b-dpo	10/28/2024	2024/1	Apache-2.0	626.00
93.00	Tulu-2-DPO-70B	1099.19	1081.86	1099.49	1092.02	1088.44	1093.08	1109.74	1106.42	1073.90	1082.20	1100.28	1098.95	1093.35	1116.34	1098.18	1099.25	1091.87	1060.19	1087.97	1066.73	1133.39	892.38	1156.19	1120.31	AllenAI/UW	tulu-2-dpo-70b	10/28/2024	2023/11	AI2 ImpACT Low-risk	1144.00
93.00	Zephyr-7b-beta	1053.37	1027.66	1096.80	1049.28	1022.47	1029.88	1113.11	1038.66	1010.74	1031.85	1048.56	1052.01	1027.61	1054.28	1026.53	1027.52	1053.40	1017.98	993.74	975.44	1042.16	1025.03	1068.38	1040.34	HuggingFace	zephyr-7b-beta	10/28/2024	2023/10	MIT	2024.00
95.00	Gemini Pro	1110.66	1111.49	1131.61	1131.10	1113.97	1091.53	1103.66	1103.14	1085.98	1143.24	1115.59	1109.95	1111.67	1125.62	1083.03	1080.01	1097.75	1152.03	1058.58	1017.69	1212.18	1292.88	1152.32	1086.84	Google	gemini-pro	10/28/2024	2023/4	Proprietary	971.00
95.00	OpenHermes-2.5-Mistral-7b	1074.58	1067.58	1111.65	1089.77	1078.22	1058.96	1103.50	1074.41	1061.82	1064.32	1069.52	1072.71	1059.94	1071.31	1068.68	1064.48	1072.24	1083.67	1027.28	995.62	1149.52	1173.32	1081.50	1050.29	NousResearch	openhermes-2.5-mistral-7b	10/28/2024	2023/11	Apache-2.0	826.00
95.00	Yi-34B-Chat	1111.19	1090.24	1107.67	1100.58	1089.91	1105.99	1110.61	1094.19	1079.31	1110.57	1115.41	1110.89	1112.03	1105.65	1101.93	1097.22	1106.14	1232.41	1046.24	1038.49	1174.13	1097.72	1078.97	1070.67	01 AI	yi-34b-chat	10/28/2024	2023/6	Yi License	2453.00
98.00	Dolphin-2.2.1-Mistral-7B	1062.26	1033.54	1090.36	1067.85	1054.35	1024.51	1090.96	1056.70	1041.35	1017.89	1057.80	1061.65	1039.30	1032.11	1050.45	1044.31	1059.76	1104.52	989.75	937.41	1135.04	961.88	1105.15	988.92	Cognitive Computations	dolphin-2.2.1-mistral-7b	10/28/2024	2023/10	Apache-2.0	295.00
98.00	GPT-3.5-Turbo-0613	1116.79	1147.15	1130.81	1136.90	1134.85	1134.78	1109.69	1128.58	1107.31	1117.36	1123.79	1116.72	1120.20	1125.55	1123.18	1115.94	1098.20	1156.88	1098.72	1121.17	1209.62	1200.01	1183.93	1120.63	OpenAI	gpt-3.5-turbo-0613	10/28/2024	2021/9	Proprietary	6746.00
98.00	NV-Llama2-70B-SteerLM-Chat	1080.26	1025.66	1075.99	1073.72	1049.12	1022.67	1096.30	1063.43	1036.78	1059.70	1076.20	1079.80	1071.39	1012.38	1045.94	1035.40	1068.98	1086.60	1050.01	1081.80	1115.18	983.84	1139.42	1035.73	Nvidia	llama2-70b-steerlm-chat	10/28/2024	2023/11	Llama 2 Community	619.00
98.00	Phi-3-Medium-4k-Instruct	1122.91	1115.17	1105.49	1117.74	1121.25	1125.31	1111.52	1123.07	1141.23	1094.98	1126.35	1123.41	1118.36	1132.90	1129.68	1126.73	1117.97	1164.73	1071.63	1101.59	1198.29	1108.76	1169.22	1097.22	Microsoft	phi-3-medium-4k-instruct	10/28/2024	2023/10	MIT	3940.00
100.00	Claude-2.0	1131.92	1152.84	1144.29	1145.76	1141.64	1135.13	1101.71	1130.50	1126.61	1161.32	1150.55	1131.83	1140.45	1146.83	1126.27	1119.48	1114.18	1189.38	1102.11	1152.40	1215.39	1149.58	1204.47	1138.40	Anthropic	claude-2.0	10/28/2024	-	Proprietary	2283.00
101.00	Meta-Llama-3.2-3b-Instruct	1103.12	1048.20	1098.36	1092.86	1084.99	1081.65	1098.14	1106.10	1098.21	1111.64	1106.72	1102.81	1084.26	1119.96	1103.66	1130.45	1141.37	1084.99	1025.01	1052.05	1081.47	1002.72	982.30	1101.46	Meta	llama-3.2-3b-instruct	10/28/2024	2023/12	Llama 3.2	1148.00
101.00	Mixtral-8x7b-Instruct-v0.1	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	Mistral	mixtral-8x7b-instruct-v0.1	10/28/2024	2023/12	Apache 2.0	11622.00
101.00	Starling-LM-7B-alpha	1088.29	1076.34	1088.90	1082.81	1070.30	1080.10	1102.06	1073.59	1047.60	1082.57	1084.93	1088.42	1079.26	1093.30	1073.01	1070.38	1083.30	1106.34	1038.91	1028.72	1129.59	1116.86	1109.93	1112.54	UC Berkeley	starling-lm-7b-alpha	10/28/2024	2023/11	CC-BY-NC-4.0	1730.00
102.00	OpenChat-3.5-0106	1091.32	1106.56	1102.94	1100.28	1088.43	1102.08	1098.55	1081.68	1071.35	1092.35	1090.61	1089.87	1081.31	1096.74	1083.67	1073.61	1080.56	1138.17	1046.94	1066.22	1128.24	1043.71	1107.67	1101.53	OpenChat	openchat-3.5-0106	10/28/2024	2024/1	Apache-2.0	1909.00
103.00	DBRX-Instruct-Preview	1103.06	1123.87	1111.14	1113.40	1115.12	1117.87	1102.38	1114.30	1108.33	1102.28	1105.00	1103.19	1096.25	1124.91	1109.31	1110.11	1103.66	1121.21	1049.62	1061.43	1154.66	1136.11	1096.33	1066.13	Databricks	dbrx-instruct-preview	10/28/2024	2023/12	DBRX LICENSE	5074.00
103.00	GPT-3.5-Turbo-0125	1105.70	1146.34	1145.69	1137.33	1131.09	1123.60	1099.11	1125.15	1109.58	1115.16	1111.80	1105.49	1100.00	1136.92	1111.93	1105.96	1086.80	1130.57	1072.39	1091.63	1204.36	1167.80	1147.25	1117.20	OpenAI	gpt-3.5-turbo-0125	10/28/2024	2021/9	Proprietary	10120.00
103.00	GPT-3.5-Turbo-0314	1106.48	1143.79	1135.70	1141.19	1139.03	1114.97	1089.20	1148.67	1140.02	1107.41	1114.31	1106.38	1096.61	1117.68	1116.99	1097.30	1081.55	1204.09	1149.14	1151.83	1284.45	1223.77	1166.82	1165.16	OpenAI	gpt-3.5-turbo-0314	10/28/2024	2021/9	Proprietary	908.00
103.00	Guanaco-33B	1032.38	968.45	1086.49	1039.82	1004.62	965.39	1081.15	993.55	993.57	1005.35	1035.27	1030.75	1003.84	973.84	1000.72	996.98	1028.64	1013.49	1060.71	1021.03	983.08	593.65	1054.51	1053.26	UW	guanaco-33b	10/28/2024	2023/5	Non-commercial	519.00
103.00	Qwen1.5-14B-Chat	1108.80	1118.54	1091.63	1106.51	1109.42	1125.85	1094.78	1102.81	1091.13	1108.73	1111.13	1107.60	1105.65	1125.78	1116.54	1110.09	1095.42	1202.42	1068.72	1041.74	1190.80	1149.79	1072.64	1078.76	Alibaba	qwen1.5-14b-chat	10/28/2024	2024/2	Qianwen LICENSE	2499.00
103.00	SOLAR-10.7B-Instruct-v1.0	1062.00	1052.20	1088.68	1065.64	1055.91	1046.08	1089.64	1058.35	1028.75	1041.76	1058.08	1062.03	1038.84	1134.49	1056.08	1050.00	1060.38	1070.26	1001.84	1015.89	1140.08	932.71	1062.80	1031.71	Upstage AI	solar-10.7b-instruct-v1.0	10/28/2024	2023/11	CC-BY-NC-4.0	725.00
103.00	Starling-LM-7B-beta	1118.97	1110.91	1058.14	1090.76	1103.44	1129.44	1097.44	1104.44	1093.77	1106.80	1120.56	1118.92	1124.02	1120.52	1119.62	1112.11	1107.76	1178.78	1064.16	1075.87	1162.49	1089.84	1123.24	1143.83	Nexusflow	starling-lm-7b-beta	10/28/2024	2024/3	Apache-2.0	2484.00
103.00	WizardLM-13b-v1.2	1058.55	1030.77	1092.03	1063.10	1014.86	1026.28	1093.18	1050.98	987.16	1043.02	1057.86	1056.08	1039.59	1067.16	1013.84	1011.07	1050.40	1075.08	1026.27	1031.06	1077.21	1046.95	1082.07	1072.85	Microsoft	wizardlm-13b	10/28/2024	2023/7	Llama 2 Community	1390.00
103.00	Zephyr-7b-alpha	1040.99	1039.32	1059.04	1045.21	1024.93	1034.04	1075.93	1041.63	1006.20	1014.19	1032.87	1038.59	1012.18	1011.24	1022.64	1018.53	1039.45	1042.52	1004.37	913.37	1079.48	1302.68	1047.26	1001.13	HuggingFace	zephyr-7b-alpha	10/28/2024	2023/10	MIT	401.00
106.00	MPT-30B-chat	1045.54	1044.09	1085.36	1059.99	1055.91	1030.56	1077.06	1057.43	1014.11	1052.44	1040.39	1043.90	1022.61	1067.50	1047.81	1059.42	1043.54	1024.19	998.59	993.08	1095.00	1016.81	958.89	1070.73	MosaicML	mpt-30b-chat	10/28/2024	2023/6	CC-BY-NC-SA-4.0	458.00
106.00	Qwen1.5-32B-Chat	1125.39	1144.38	1087.84	1126.53	1131.02	1149.22	1088.65	1122.23	1125.41	1138.13	1128.30	1124.75	1130.84	1157.68	1135.70	1130.45	1109.95	1234.83	1057.42	1053.47	1189.07	1150.34	1096.67	1088.21	Alibaba	qwen1.5-32b-chat	10/28/2024	2024/2	Qianwen LICENSE	3161.00
107.00	Phi-3-Small-8k-Instruct	1101.60	1099.01	1087.88	1097.95	1101.03	1107.09	1087.08	1101.92	1120.43	1071.00	1106.02	1101.96	1085.06	1101.56	1107.37	1111.61	1106.17	1122.98	1090.92	1075.37	1127.05	1052.86	1138.16	1108.62	Microsoft	phi-3-small-8k-instruct	10/28/2024	2023/10	MIT	2523.00
107.00	Snowflake Arctic Instruct	1089.97	1092.77	1095.90	1102.53	1089.03	1076.99	1085.26	1077.90	1080.47	1070.39	1091.95	1089.01	1072.54	1018.45	1073.82	1066.29	1077.74	1129.07	1085.39	1077.89	1135.34	1090.76	1126.43	1090.02	Snowflake	snowflake-arctic-instruct	10/28/2024	2024/4	Apache 2.0	5019.00
113.00	Llama-2-70b-chat	1093.12	1061.43	1065.05	1081.18	1063.08	1072.23	1078.94	1075.03	1058.32	1081.31	1094.65	1092.01	1083.50	1071.85	1070.43	1070.58	1096.66	1056.85	1046.94	1027.28	1110.25	1109.95	1106.47	1137.94	Meta	llama-2-70b-chat	10/28/2024	2023/7	Llama 2 Community	6549.00
116.00	Mistral-7B-Instruct-v0.2	1072.24	1066.59	1063.08	1067.02	1063.39	1073.77	1075.47	1067.46	1056.80	1070.22	1072.15	1071.24	1050.13	1071.77	1068.55	1071.08	1081.78	1068.40	983.38	979.23	1042.80	1061.57	1045.21	1025.14	Mistral	mistral-7b-instruct-v0.2	10/28/2024	2023/12	Apache-2.0	3038.00
118.00	DeepSeek-LLM-67B-Chat	1076.77	1086.67	1083.23	1090.85	1072.74	1079.12	1065.84	1082.23	1070.05	1077.64	1078.14	1076.77	1065.60	1100.02	1065.19	1060.05	1063.96	1179.39	1000.17	1005.60	1162.52	1170.40	1158.35	1062.47	DeepSeek AI	deepseek-llm-67b-chat	10/28/2024	2023/11	DeepSeek License	797.00
120.00	Gemma-1.1-7b-it	1083.57	1106.87	1103.70	1097.66	1096.19	1084.52	1069.92	1071.56	1079.20	1043.66	1086.49	1081.35	1061.49	1072.29	1077.10	1077.46	1078.79	1118.43	1019.45	1050.19	1133.88	1137.77	1075.98	1054.43	Google	gemma-1.1-7b-it	10/28/2024	2024/2	Gemma license	3588.00
122.00	Vicuna-13B	1042.01	1042.33	1081.07	1058.58	1035.51	1032.17	1063.75	1040.85	999.61	1032.78	1041.25	1040.42	1010.84	1061.63	1025.40	1018.00	1028.35	1097.46	994.74	992.14	1127.82	1047.61	1071.85	1068.62	LMSYS	vicuna-13b	10/28/2024	2023/7	Llama 2 Community	3429.00
124.00	Claude-Instant-1	1111.16	1130.58	1105.34	1126.77	1124.47	1108.86	1060.24	1107.20	1111.12	1146.93	1129.85	1110.75	1110.25	1133.79	1107.04	1100.25	1096.93	1145.27	1079.43	1104.62	1192.95	1139.45	1131.56	1100.36	Anthropic	claude-instant-1	10/28/2024	-	Proprietary	3628.00
125.00	Phi-3-Mini-4k-Instruct-June-24	1070.73	1073.73	1059.08	1067.75	1088.69	1082.37	1057.89	1074.91	1123.69	1054.55	1074.36	1071.28	1020.30	1055.85	1095.79	1101.00	1082.19	1094.09	1052.24	1029.61	1123.64	1033.25	1049.67	1134.71	Microsoft	phi-3-mini-4k-instruct-june-2024	10/28/2024	2023/10	MIT	2115.00
129.00	pplx-70b-online	1077.88	1034.75	1053.74	1075.35	1030.30	1028.25	1050.01	1032.51	1042.85	986.36	1075.93	1077.03	1065.56	1016.54	1028.09	1025.26	1066.55	1127.58	1046.22	1039.07	1208.40	1193.63	1074.51	1064.00	Perplexity AI	pplx-70b-online	10/28/2024	Online	Proprietary	1219.00
130.00	Meta-Llama-3.2-1b-Instruct	1053.26	1008.50	1045.22	1043.46	1039.68	1046.75	1045.04	1052.95	1065.20	1038.89	1057.17	1052.04	981.82	1072.70	1060.41	1079.29	1080.58	1023.36	1018.50	1012.51	1078.23	1009.48	971.88	1030.84	Meta	llama-3.2-1b-instruct	10/28/2024	2023/12	Llama 3.2	1178.00
130.00	Qwen1.5-7B-Chat	1070.03	1081.53	1035.71	1064.69	1057.96	1088.52	1039.75	1063.96	1048.23	1061.14	1069.68	1068.32	1047.41	1102.43	1066.71	1056.04	1054.87	1196.24	1017.21	1022.58	1177.33	1045.42	1034.15	1015.86	Alibaba	qwen1.5-7b-chat	10/28/2024	2024/2	Qianwen LICENSE	731.00
131.00	Llama-2-13b-chat	1063.20	1041.71	1044.13	1053.26	1042.98	1051.16	1050.11	1046.68	1032.32	1045.99	1068.55	1061.76	1036.94	1077.78	1049.61	1048.74	1061.09	1055.46	989.47	997.69	1063.11	1091.71	1075.30	1075.93	Meta	llama-2-13b-chat	10/28/2024	2023/7	Llama 2 Community	3387.00
133.00	Claude-2.1	1118.21	1152.32	1097.54	1134.72	1135.78	1131.73	1048.15	1109.69	1122.77	1158.96	1137.03	1117.68	1122.59	1133.28	1119.00	1107.74	1096.88	1146.83	1138.71	1136.91	1208.32	1149.69	1174.40	1122.86	Anthropic	claude-2.1	10/28/2024	-	Proprietary	5812.00
133.00	GPT-3.5-Turbo-1106	1067.73	1125.98	1109.77	1110.37	1118.56	1094.89	1043.71	1090.83	1104.55	1070.96	1081.31	1067.34	1046.10	1088.93	1090.91	1088.65	1052.39	1076.07	1020.67	1066.35	1208.47	1097.72	1104.59	1091.02	OpenAI	gpt-3.5-turbo-1106	10/28/2024	2021/9	Proprietary	2902.00
133.00	StripedHyena-Nous-7B	1017.40	1013.04	1046.44	1034.01	1007.11	999.69	1035.96	1012.09	999.91	1011.80	1015.87	1016.17	971.71	994.66	995.79	993.85	1013.46	1029.76	970.33	933.47	1059.62	1057.48	1020.72	990.13	Together AI	stripedhyena-nous-7b	10/28/2024	2023/12	Apache 2.0	884.00
134.00	CodeLlama-70B-instruct	1042.01	1054.98	1004.84	1037.25	1059.73	1047.43	1015.38	1030.91	1032.22	1031.62	1052.69	1040.18	1007.98	998.82	1051.21	1054.44	1046.21	1091.15	864.72	914.07	1116.75	1399.49	1038.66	1015.40	Meta	codellama-70b-instruct	10/28/2024	2024/1	Llama 2 Community	153.00
134.00	Llama-2-7b-chat	1036.77	992.24	1029.60	1023.89	1003.25	1002.37	1040.60	1012.41	1009.78	1027.92	1042.80	1034.63	997.63	1012.55	1009.95	1011.35	1041.07	1032.11	924.01	955.92	1063.36	1049.35	1014.98	989.80	Meta	llama-2-7b-chat	10/28/2024	2023/7	Llama 2 Community	2403.00
134.00	Phi-3-Mini-4k-Instruct	1066.07	1068.82	1028.98	1055.23	1065.79	1085.67	1042.93	1067.37	1084.90	1025.92	1070.10	1065.01	1021.41	1052.39	1078.90	1084.49	1072.54	1081.69	1031.46	1038.54	1100.03	1059.53	1056.32	1093.19	Microsoft	phi-3-mini-4k-instruct	10/28/2024	2023/10	MIT	2985.00
135.00	CodeLlama-34B-instruct	1042.76	1042.57	1037.89	1046.92	1032.06	1041.91	1034.94	1029.27	1022.10	1012.66	1042.39	1040.75	1012.75	1026.29	1027.83	1022.32	1034.82	1033.06	1006.61	988.66	1031.37	1034.16	1105.83	1122.07	Meta	codellama-34b-instruct	10/28/2024	2023/7	Llama 2 Community	1536.00
135.00	Mistral-7B-Instruct-v0.1	1008.20	1021.79	1048.25	1027.03	1016.09	1007.91	1036.81	1012.92	996.33	1011.28	999.42	1006.85	956.36	1020.39	1002.31	1003.86	1008.62	992.53	896.97	924.69	1037.81	1026.46	1034.48	975.61	Mistral	mistral-7b-instruct	10/28/2024	2023/9	Apache 2.0	1727.00
135.00	Qwen-14B-Chat	1035.00	1068.16	1057.58	1056.61	1038.68	1055.68	1034.97	1034.41	1033.11	1019.07	1036.75	1033.23	1000.03	1038.70	1023.75	1017.72	1017.27	1134.93	1026.32	1015.26	1172.83	953.28	1080.42	1082.99	Alibaba	qwen-14b-chat	10/28/2024	2023/8	Qianwen LICENSE	920.00
138.00	Phi-3-Mini-128k-Instruct	1036.89	1032.70	1044.21	1048.56	1040.29	1029.28	1034.26	1036.36	1063.69	991.35	1039.84	1035.13	983.29	1015.34	1035.75	1036.34	1033.95	1076.86	993.74	1009.40	1080.09	1026.49	1038.16	1057.33	Microsoft	phi-3-mini-128k-instruct	10/28/2024	2023/10	MIT	3137.00
140.00	Gemma-7b-it	1037.42	1057.19	1053.09	1046.93	1055.64	1046.87	1029.07	1023.37	1032.44	959.04	1040.33	1035.03	999.69	1036.45	1045.05	1045.49	1032.22	1095.41	979.76	978.97	1079.67	1109.63	1014.88	983.16	Google	gemma-7b-it	10/28/2024	2024/2	Gemma license	1389.00
140.00	Vicuna-7B	1005.05	991.76	1040.16	1021.54	1001.85	981.43	1023.44	995.76	963.88	987.23	1004.18	1002.44	964.46	1048.05	989.81	979.30	989.14	1028.38	1006.53	962.37	1135.03	943.66	1046.66	1066.50	LMSYS	vicuna-7b	10/28/2024	2023/7	Llama 2 Community	1336.00
146.00	Gemma-1.1-2b-it	1020.55	1062.48	1050.28	1038.73	1042.74	1035.97	1010.36	1006.36	1022.91	963.01	1022.81	1017.08	955.54	1019.76	1015.83	1016.88	1013.61	1076.36	967.63	947.87	1070.25	1047.97	1020.10	992.59	Google	gemma-1.1-2b-it	10/28/2024	2024/2	Gemma license	1568.00
150.00	pplx-7b-online	1044.53	1017.94	1009.33	1041.00	1017.45	1015.08	1007.38	997.93	1013.99	990.49	1039.77	1043.68	1017.74	994.97	1016.27	1013.57	1039.23	1083.97	928.82	947.04	1159.09	1109.51	1056.67	1041.77	Perplexity AI	pplx-7b-online	10/28/2024	Online	Proprietary	1128.00
152.00	OLMo-7B-instruct	1015.18	998.27	960.21	993.22	977.57	1017.07	995.89	987.52	987.70	1005.34	1013.06	1013.89	964.39	1057.64	993.86	993.09	1018.19	1072.15	879.66	885.38	993.79	926.15	970.75	975.42	Allen AI	olmo-7b-instruct	10/28/2024	2024/2	Apache-2.0	1042.00
152.00	PaLM-Chat-Bison-001	1003.45	1028.63	1043.52	1042.44	1037.18	990.10	998.30	1014.32	1015.06	993.11	997.23	1000.25	960.65	1014.43	1000.89	1010.54	1006.03	931.53	883.87	866.67	1068.06	1010.61	1021.20	894.55	Google	palm-2	10/28/2024	2021/6	Proprietary	1613.00
155.00	Gemma-2b-it	989.65	1016.32	1026.99	1007.42	1008.44	1000.48	989.48	975.98	978.70	936.95	992.28	986.41	923.49	997.89	987.29	976.39	981.80	1050.38	855.81	909.84	1019.93	1044.49	965.15	985.39	Google	gemma-2b-it	10/28/2024	2024/2	Gemma license	712.00
155.00	GPT4All-13B-Snoozy	931.64	944.17	1012.11	972.49	957.40	909.48	972.31	947.45	903.23	921.91	928.44	930.20	857.80	951.43	931.43	931.88	930.17	932.12	714.87	812.26	924.92	969.48	978.76	880.24	Nomic AI	gpt4all-13b-snoozy	10/28/2024	2023/3	Non-commercial	259.00
157.00	ChatGLM3-6B	955.26	966.33	993.99	974.85	963.42	952.79	973.57	961.26	954.54	957.93	947.44	952.83	876.00	970.57	953.13	955.17	949.39	1122.73	789.96	822.13	1041.84	937.27	924.23	924.13	Tsinghua	chatglm3-6b	10/28/2024	2023/10	Apache-2.0	833.00
157.00	Qwen1.5-4B-Chat	988.34	1005.69	1005.02	1015.13	995.01	990.16	975.04	983.87	992.81	977.91	989.03	985.10	911.90	1004.68	977.53	965.32	966.82	1084.06	926.81	904.94	1030.64	990.39	977.52	1012.83	Alibaba	qwen1.5-4b-chat	10/28/2024	2024/2	Qianwen LICENSE	1116.00
158.00	Alpaca-13B	901.52	869.33	1036.39	967.59	888.85	789.26	965.36	889.00	873.38	881.89	889.05	895.42	816.16	923.96	819.09	814.90	892.48	828.24	806.60	848.80	899.94	945.10	1032.51	930.96	Stanford	alpaca-13b	10/28/2024	2023/3	Non-commercial	971.00
158.00	Koala-13B	964.32	944.08	993.28	979.60	931.63	937.15	972.09	941.51	897.63	918.20	963.91	961.46	906.06	886.32	924.87	919.61	960.95	926.40	876.46	907.52	1026.58	915.05	926.23	932.88	UC Berkeley	koala-13b	10/28/2024	2023/4	Non-commercial	1211.00
159.00	MPT-7B-Chat	927.60	938.04	999.00	967.10	924.91	899.64	956.27	910.00	886.27	900.57	925.63	924.64	850.34	804.61	891.38	886.22	915.67	1003.89	880.44	905.12	963.40	1033.74	836.34	886.52	MosaicML	mpt-7b-chat	10/28/2024	2023/5	CC-BY-NC-SA-4.0	697.00
160.00	ChatGLM2-6B	924.18	903.79	961.40	942.68	928.63	892.28	948.72	909.31	893.15	902.17	910.94	920.13	831.49	892.30	915.20	916.42	924.98	1047.27	764.25	662.23	924.80	925.29	848.76	852.49	Tsinghua	chatglm2-6b	10/28/2024	2023/6	Apache-2.0	575.00
165.00	RWKV-4-Raven-14B	921.67	916.31	953.97	949.08	912.07	896.41	933.71	886.01	888.28	892.58	914.82	918.36	845.78	841.78	891.09	878.25	906.18	952.31	878.55	872.84	1027.40	873.80	998.82	912.63	RWKV	RWKV-4-Raven-14B	10/28/2024	2023/4	Apache 2.0	895.00
166.00	OpenAssistant-Pythia-12B	893.35	904.61	959.16	931.52	914.12	872.96	920.92	889.52	858.58	865.39	885.24	890.18	802.36	866.74	880.57	874.68	887.59	860.06	875.04	836.14	864.67	921.45	841.55	932.96	OpenAssistant	oasst-pythia-12b	10/28/2024	2023/4	Apache 2.0	1104.00
169.00	ChatGLM-6B	879.04	890.46	902.33	888.42	897.83	883.61	901.82	899.56	891.48	854.21	866.75	874.09	775.33	939.75	893.90	870.88	858.08	1131.63	722.81	686.97	976.91	812.35	729.29	708.14	Tsinghua	chatglm-6b	10/28/2024	2023/3	Non-commercial	778.00
169.00	FastChat-T5-3B	867.98	789.35	938.08	896.33	832.43	759.10	900.49	857.79	828.14	852.23	858.45	863.48	757.78	951.55	808.92	806.13	870.88	756.45	814.61	771.67	745.18	811.53	730.33	820.76	LMSYS	fastchat-t5-3b	10/28/2024	2023/4	Apache 2.0	755.00
171.00	Dolly-V2-12B	821.97	815.94	918.20	881.71	856.50	745.53	864.11	813.08	837.05	738.87	807.10	817.23	691.59	860.92	797.61	785.96	804.05	875.78	808.98	743.77	935.09	858.45	792.69	822.75	Databricks	dolly-v2-12b	10/28/2024	2023/4	MIT	575.00
171.00	StableLM-Tuned-Alpha-7B	839.94	865.19	882.67	858.63	841.63	858.12	869.36	831.40	804.07	820.07	829.58	834.14	712.24	881.98	830.39	825.53	830.31	892.52	709.68	721.34	861.39	804.10	750.60	827.78	Stability AI	stablelm-tuned-alpha-7b	10/28/2024	2023/4	CC-BY-NC-SA-4.0	545.00
175.00	LLaMA-13B	799.08	746.86	880.98	867.43	797.33	668.56	796.14	778.80	801.26	752.45	788.21	796.56	649.05	805.17	721.97	710.00	778.55	852.29	745.50	693.35	956.66	636.13	807.59	817.31	Meta	llama-13b	10/28/2024	2023/2	Non-commercial	432.00

Back to Leaderboard History