Model Leaderboard

Viewing: October 15, 2024

LLM Model Performance Comparison
Rank	Model	Overall Score	Coding Style	Full Style	Hard-6 Style	Coding	Instruction Following	Math	Multi-turn	No Refusal	No Short	No Tie	Long User	Hard-6	Hard English-6	English	Chinese	French	German	Japanese	Korean	Russian	Spanish	Organization	Model Slug	Date	Cutoff Date	License	Battles
1.00	ChatGPT-4o-latest (2024-09-03)	1339.08	1295.63	1297.44	1284.34	1337.67	1337.08	1276.88	1373.58	1343.91	1340.83	1473.30	1364.73	1334.37	1319.23	1317.87	1422.70	1307.04	1325.35	1455.17	1401.75	1348.39	1321.62	OpenAI	chatgpt-4o-latest-20240903	10/15/2024	2023/10	Proprietary	28488.00
1.00	o1-preview	1334.73	1307.26	1300.47	1312.86	1353.91	1351.44	1347.05	1370.46	1346.06	1336.47	1456.09	1354.92	1357.00	1357.15	1327.52	1389.69	1293.46	1302.39	1436.97	1408.02	1333.30	1301.26	OpenAI	o1-preview	10/15/2024	2023/10	Proprietary	17562.00
3.00	ChatGPT-4o-latest (2024-08-08)	1316.17	1293.42	1289.98	1277.98	1323.54	1320.00	1273.02	1346.05	1320.60	1318.15	1433.26	1343.80	1315.15	1304.85	1295.56	1372.63	1285.76	1319.20	1419.15	1400.44	1336.52	1309.45	OpenAI	chatgpt-4o-latest-20240808	10/15/2024	2023/10	Proprietary	35686.00
4.00	Gemini-1.5-Pro-002	1304.61	1248.76	1270.95	1263.21	1287.00	1300.47	1283.02	1307.87	1309.05	1305.86	1413.79	1316.72	1297.68	1284.03	1274.45	1399.93	1205.29	1282.84	1429.87	1428.17	1337.89	1300.35	Google	gemini-1.5-pro-002	10/15/2024	-	Proprietary	11430.00
4.00	Gemini-1.5-Pro-Exp-0801	1297.75	1252.11	1267.48	1254.09	1276.71	1289.32	1260.81	1304.80	1301.74	1298.98	1401.80	1299.08	1277.51	1260.51	1267.48	1368.99	1295.46	1291.75	1424.86	1398.37	1334.16	1296.81	Google	gemini-1.5-pro-exp-0801	10/15/2024	2023/11	Proprietary	26074.00
4.00	Gemini-1.5-Pro-Exp-0827	1299.16	1265.79	1266.98	1261.60	1287.24	1293.41	1272.86	1306.07	1303.86	1300.44	1408.36	1321.95	1288.02	1274.03	1268.32	1384.88	1274.20	1303.31	1423.75	1400.29	1341.11	1305.40	Google	gemini-1.5-pro-exp-0827	10/15/2024	2023/11	Proprietary	32437.00
4.00	o1-mini	1312.71	1308.69	1260.44	1288.89	1372.86	1319.95	1341.64	1331.21	1321.95	1314.21	1425.19	1335.29	1347.13	1341.48	1300.92	1375.17	1255.68	1285.25	1408.74	1380.00	1315.87	1297.57	OpenAI	o1-mini	10/15/2024	2023/10	Proprietary	17919.00
7.00	GPT-4o-2024-05-13	1284.76	1263.68	1261.53	1250.56	1292.58	1287.60	1255.92	1302.49	1289.12	1286.40	1378.53	1302.24	1284.24	1274.61	1262.56	1336.02	1258.15	1277.50	1400.32	1364.56	1305.82	1281.43	OpenAI	gpt-4o-2024-05-13	10/15/2024	2023/10	Proprietary	99251.00
8.00	Claude 3.5 Sonnet	1268.31	1281.36	1258.67	1268.91	1295.21	1279.93	1272.93	1305.37	1276.36	1269.64	1352.42	1285.59	1278.83	1268.14	1241.62	1320.15	1245.44	1268.48	1371.22	1340.95	1301.17	1284.68	Anthropic	claude-3-5-sonnet-20240620	10/15/2024	2024/4	Proprietary	75957.00
10.00	Meta-Llama-3.1-405b-Instruct-bf16	1266.07	1264.85	1250.69	1254.88	1285.35	1265.48	1254.99	1288.65	1270.02	1266.84	1351.58	1278.85	1272.46	1275.60	1260.11	1289.29	1213.53	1250.35	1347.33	1308.30	1272.10	1247.35	Meta	llama-3.1-405b-instruct-bf16	10/15/2024	2023/12	Llama 3.1 Community	14496.00
11.00	Gemini Advanced App (2024-05-14)	1266.55	1237.80	1252.12	1237.28	1254.71	1259.26	1238.38	1273.29	1270.16	1267.50	1348.88	1263.37	1253.22	1234.92	1234.42	1332.39	1256.98	1269.25	1382.00	1371.93	1304.40	1239.26	Google	gemini-advanced-0514	10/15/2024	Online	Proprietary	52235.00
12.00	GPT-4o-2024-08-06	1264.14	1249.37	1247.47	1239.06	1273.21	1270.04	1252.75	1273.55	1269.30	1265.17	1346.71	1286.78	1267.84	1257.59	1244.86	1305.83	1216.14	1251.31	1376.79	1362.96	1285.45	1261.76	OpenAI	gpt-4o-2024-08-06	10/15/2024	2023/10	Proprietary	30976.00
12.00	Grok-2-08-13	1291.30	1255.66	1248.71	1242.13	1286.83	1280.90	1252.81	1296.13	1295.97	1292.96	1391.19	1292.59	1278.90	1268.63	1273.44	1352.57	1262.90	1286.53	1393.88	1375.88	1306.68	1279.61	xAI	grok-2-2024-08-13	10/15/2024	2024/3	Proprietary	35661.00
12.00	Meta-Llama-3.1-405b-Instruct-fp8	1266.68	1257.17	1251.70	1250.17	1278.47	1269.79	1246.88	1292.90	1270.47	1268.00	1351.71	1273.04	1268.84	1269.62	1260.59	1288.58	1247.17	1244.10	1306.47	1311.56	1287.18	1248.12	Meta	llama-3.1-405b-instruct-fp8	10/15/2024	2023/12	Llama 3.1 Community	39428.00
13.00	Yi-Lightning	1286.66	1255.31	1243.17	1247.48	1300.19	1283.67	1277.80	1313.44	1290.77	1287.95	1385.89	1303.45	1298.26	1295.17	1276.29	1373.43	1246.34	1257.07	1384.06	1334.85	1274.21	1323.18	01 AI	yi-lightning	10/15/2024	-	Proprietary	13262.00
17.00	GPT-4-Turbo-2024-04-09	1256.59	1239.31	1241.10	1226.86	1263.14	1260.90	1242.86	1267.53	1260.86	1258.23	1332.39	1265.05	1254.79	1248.60	1241.47	1301.19	1227.54	1253.64	1337.23	1320.73	1273.25	1255.67	OpenAI	gpt-4-turbo-2024-04-09	10/15/2024	2023/12	Proprietary	97256.00
18.00	Claude 3 Opus	1247.72	1235.03	1238.14	1234.51	1250.25	1257.57	1239.51	1278.15	1259.69	1249.37	1316.96	1269.90	1245.45	1228.26	1214.23	1311.94	1229.97	1251.62	1351.33	1325.00	1307.46	1245.20	Anthropic	claude-3-opus-20240229	10/15/2024	2023/8	Proprietary	174238.00
18.00	Gemini-1.5-Flash-Exp-0827	1268.76	1239.45	1236.59	1236.35	1257.95	1264.86	1242.65	1284.83	1273.13	1270.05	1358.16	1309.98	1263.29	1249.68	1236.62	1352.72	1256.42	1265.85	1382.43	1366.80	1309.49	1275.51	Google	gemini-1.5-flash-exp-0827	10/15/2024	2023/11	Proprietary	25555.00
18.00	Gemini-1.5-Pro-001	1259.86	1243.02	1238.75	1238.19	1262.29	1262.14	1236.85	1267.80	1266.55	1260.88	1339.66	1295.44	1258.59	1243.60	1230.98	1330.53	1232.51	1244.89	1380.78	1362.50	1297.81	1240.25	Google	gemini-1.5-pro-api-0514	10/15/2024	2023/11	Proprietary	89220.00
18.00	Yi-Lightning-lite	1265.03	1233.87	1237.28	1233.46	1266.89	1268.12	1245.10	1295.70	1271.33	1266.53	1348.52	1287.59	1271.44	1260.83	1247.71	1316.68	1283.32	1270.32	1370.11	1320.28	1270.55	1265.36	01 AI	yi-lightning-lite	10/15/2024	-	Proprietary	13294.00
20.00	GLM-4-Plus	1273.81	1244.83	1232.18	1229.24	1284.39	1272.23	1244.52	1287.09	1279.61	1275.02	1364.15	1292.31	1273.10	1259.50	1248.98	1345.36	1254.55	1257.20	1354.01	1379.73	1291.49	1297.00	Zhipu AI	glm-4-plus	10/15/2024	-	Proprietary	13674.00
20.00	GPT-4-1106-preview	1250.40	1232.01	1234.21	1227.31	1253.74	1250.28	1242.97	1260.46	1257.61	1251.65	1318.91	1249.22	1247.49	1239.05	1231.71	1300.41	1240.61	1248.23	1338.08	1321.00	1272.59	1259.30	OpenAI	gpt-4-1106-preview	10/15/2024	2023/4	Proprietary	101579.00
22.00	GPT-4o-mini-2024-07-18	1273.54	1243.95	1231.79	1220.61	1284.28	1265.82	1229.91	1293.91	1278.35	1274.51	1364.30	1295.30	1268.16	1257.21	1253.35	1322.38	1248.50	1275.18	1356.85	1332.89	1294.43	1278.49	OpenAI	gpt-4o-mini-2024-07-18	10/15/2024	2023/10	Proprietary	38831.00
22.00	Mistral-Large-2407	1251.50	1243.78	1229.51	1232.23	1269.61	1257.89	1234.49	1263.25	1255.89	1253.05	1327.23	1270.45	1260.31	1251.70	1238.26	1299.18	1223.38	1248.87	1347.52	1312.46	1275.13	1233.73	Mistral	mistral-large-2407	10/15/2024	2024/7	Mistral Research	35788.00
24.00	GPT-4-0125-preview	1245.06	1221.40	1230.08	1218.25	1244.09	1244.89	1237.62	1255.51	1251.31	1246.52	1311.60	1249.14	1241.90	1235.18	1226.78	1295.51	1232.74	1235.54	1343.13	1309.96	1261.29	1246.15	OpenAI	gpt-4-0125-preview	10/15/2024	2023/12	Proprietary	94862.00
24.00	Qwen-Max-0919	1261.31	1240.56	1227.80	1229.94	1277.24	1269.61	1242.70	1278.99	1267.34	1262.92	1342.37	1297.35	1271.10	1261.90	1242.26	1305.89	1269.69	1253.25	1355.21	1285.30	1286.65	1286.99	Alibaba	qwen-max-0919	10/15/2024	-	Qwen	12205.00
25.00	Gemini-1.5-Flash-002	1268.56	1202.44	1224.88	1208.03	1249.30	1261.82	1238.57	1256.48	1275.06	1269.98	1355.69	1301.26	1248.78	1241.14	1237.86	1341.35	1219.68	1223.62	1386.09	1337.75	1301.06	1246.27	Google	gemini-1.5-flash-002	10/15/2024	-	Proprietary	8957.00
28.00	Deepseek-v2.5	1255.46	1248.04	1221.72	1232.41	1282.93	1255.92	1239.05	1255.08	1259.95	1256.57	1333.86	1280.96	1273.25	1264.93	1236.77	1337.50	1228.91	1216.36	1319.53	1312.26	1272.34	1236.76	DeepSeek	deepseek-v2.5	10/15/2024	-	DeepSeek	13969.00
30.00	Athene-70b	1250.05	1233.26	1220.26	1224.56	1253.47	1233.91	1200.58	1254.83	1253.80	1250.39	1327.17	1241.22	1247.17	1240.94	1237.77	1294.18	1235.33	1245.64	1286.54	1298.07	1271.93	1246.09	NexusFlow	athene-70b-0725	10/15/2024	2024/7	CC-BY-NC-4.0	20703.00
30.00	Grok-2-Mini-08-13	1267.43	1228.84	1221.39	1218.53	1262.32	1256.68	1235.79	1268.78	1271.76	1268.53	1353.79	1271.72	1259.71	1253.45	1253.04	1315.89	1227.85	1264.81	1360.60	1332.50	1280.50	1260.44	xAI	grok-2-mini-2024-08-13	10/15/2024	2024/3	Proprietary	30597.00
30.00	Qwen2.5-72b-Instruct	1258.05	1243.44	1220.94	1218.98	1282.01	1264.19	1247.51	1270.87	1262.78	1259.69	1337.46	1286.42	1264.10	1252.37	1237.23	1327.57	1216.63	1231.80	1319.54	1338.61	1276.93	1251.87	Alibaba	qwen2.5-72b-instruct	10/15/2024	2024/9	Qwen	13896.00
32.00	Gemini-1.5-Pro-Preview-0409	1257.44	1204.99	1215.69	1199.05	1231.38	1248.88	1213.51	1254.89	1261.01	1259.46	1330.18	1248.01	1232.75	1220.19	1233.44	1315.63	1257.05	1253.59	1347.78	1416.44	1302.78	1267.28	Google	gemini-1.5-pro-api-0409-preview	10/15/2024	2023/11	Proprietary	55605.00
37.00	Meta-Llama-3.1-70b-Instruct	1247.15	1215.99	1210.31	1208.66	1248.52	1238.82	1220.06	1258.43	1250.84	1248.01	1321.74	1246.32	1242.06	1244.12	1246.24	1274.76	1201.92	1220.80	1280.66	1269.31	1251.41	1236.68	Meta	llama-3.1-70b-instruct	10/15/2024	2023/12	Llama 3.1 Community	34744.00
38.00	Gemma-2-27b-it	1218.82	1202.84	1205.24	1191.28	1209.24	1212.42	1185.34	1223.84	1223.78	1219.56	1274.43	1232.24	1202.82	1189.98	1193.92	1278.18	1183.15	1209.77	1317.70	1319.34	1252.60	1229.28	Google	gemma-2-27b-it	10/15/2024	2024/6	Gemma license	46053.00
38.00	Jamba-1.5-Large	1220.88	1207.76	1202.19	1193.60	1227.98	1220.06	1189.41	1223.02	1224.69	1221.38	1277.95	1214.15	1219.40	1214.94	1217.09	1260.61	1197.67	1196.98	1268.14	1282.67	1214.38	1245.39	AI21 Labs	jamba-1.5-large	10/15/2024	2024/3	Jamba Open	9189.00
38.00	Qwen-Plus-0828	1227.23	1215.86	1204.81	1206.50	1245.62	1234.12	1216.24	1249.08	1231.97	1228.86	1284.52	1266.68	1241.29	1234.20	1217.15	1311.71	1160.91	1180.50	1294.29	1270.25	1268.43	1238.25	Alibaba	qwen-plus-0828	10/15/2024	-	Proprietary	14985.00
38.00	Yi-Large-preview	1239.65	1207.69	1205.27	1205.30	1244.93	1236.24	1218.62	1235.15	1243.84	1241.42	1309.37	1247.02	1239.57	1228.67	1216.38	1316.37	1201.22	1225.52	1357.11	1287.03	1271.52	1244.47	01 AI	yi-large-preview	10/15/2024	Unknown	Proprietary	51736.00
39.00	Deepseek-v2-API-0628	1219.43	1221.73	1200.53	1210.84	1241.60	1221.12	1216.49	1228.76	1223.33	1220.82	1275.22	1243.17	1233.69	1223.42	1198.63	1282.09	1200.67	1202.05	1303.00	1274.12	1258.56	1215.70	DeepSeek AI	deepseek-v2-api-0628	10/15/2024	-	DeepSeek	19608.00
39.00	Gemini-1.5-Flash-001	1227.06	1207.75	1201.95	1200.24	1232.17	1223.27	1198.84	1232.64	1232.50	1227.61	1288.19	1263.70	1224.74	1210.63	1200.45	1291.23	1192.02	1211.84	1331.17	1335.20	1260.23	1222.99	Google	gemini-1.5-flash-api-0514	10/15/2024	2023/11	Proprietary	69151.00
39.00	Gemma-2-9b-it-SimPO	1215.57	1180.29	1197.91	1186.84	1196.84	1202.92	1144.75	1224.97	1218.72	1216.61	1269.35	1237.50	1203.23	1186.81	1195.77	1282.87	1180.96	1215.66	1292.66	1265.15	1247.03	1204.80	Princeton	gemma-2-9b-it-simpo	10/15/2024	2024/7	MIT	10621.00
39.00	GPT-4-0314	1186.36	1201.90	1199.57	1204.07	1195.48	1204.65	1194.33	1201.16	1189.38	1187.40	1223.20	1200.36	1195.96	1183.68	1164.53	1236.85	1177.72	1197.86	1275.96	1234.95	1219.52	1197.48	OpenAI	gpt-4-0314	10/15/2024	2021/9	Proprietary	55979.00
39.00	Reka-Core-20240722	1230.36	1190.82	1202.57	1185.89	1208.03	1212.29	1185.39	1237.14	1234.02	1230.63	1293.34	1232.45	1204.85	1190.61	1204.68	1300.46	1230.99	1210.24	1308.11	1330.82	1265.99	1220.75	Reka AI	reka-core-20240722	10/15/2024	-	Proprietary	13338.00
41.00	Command R+ (08-2024)	1213.69	1163.97	1195.81	1171.08	1179.66	1204.32	1164.37	1213.37	1221.27	1214.96	1263.90	1241.02	1187.83	1176.97	1187.52	1282.61	1157.28	1213.24	1311.92	1311.22	1248.84	1223.17	Cohere	command-r-plus-08-2024	10/15/2024	2024/8	CC-BY-NC-4.0	10523.00
41.00	Deepseek-Coder-v2-0724	1214.05	1242.82	1196.13	1209.71	1266.28	1220.83	1209.74	1218.05	1221.21	1215.67	1266.51	1253.55	1234.97	1233.26	1194.76	1286.25	1183.43	1201.70	1294.57	1256.72	1240.69	1201.56	DeepSeek	deepseek-coder-v2-0724	10/15/2024	-	Proprietary	11777.00
41.00	Nemotron-4-340B-Instruct	1209.17	1186.94	1196.49	1188.46	1198.02	1212.08	1186.25	1217.02	1213.31	1210.31	1261.49	1232.00	1202.18	1184.50	1186.65	1270.43	1148.60	1187.98	1278.86	1284.86	1243.97	1196.29	Nvidia	nemotron-4-340b-instruct	10/15/2024	2023/6	NVIDIA Open Model	20656.00
42.00	Claude 3 Sonnet	1201.02	1201.17	1197.06	1190.46	1212.98	1204.70	1181.78	1226.73	1209.25	1202.03	1246.31	1222.30	1199.01	1186.68	1175.32	1245.40	1180.98	1198.65	1287.54	1266.05	1247.48	1206.39	Anthropic	claude-3-sonnet-20240229	10/15/2024	2023/8	Proprietary	113073.00
44.00	Yi-Large	1212.55	1194.67	1193.26	1185.36	1219.48	1207.91	1195.26	1219.57	1219.12	1213.29	1266.78	1218.38	1208.46	1197.47	1194.78	1267.54	1168.28	1198.40	1313.12	1265.82	1244.51	1209.67	01 AI	yi-large	10/15/2024	Unknown	Proprietary	16671.00
47.00	Llama-3-70b-Instruct	1206.47	1190.73	1194.15	1187.29	1199.55	1199.27	1188.70	1224.72	1208.88	1206.75	1257.83	1185.53	1196.96	1211.53	1226.24	1176.12	1183.86	1166.33	1177.11	1170.57	1186.90	1241.53	Meta	llama-3-70b-instruct	10/15/2024	2023/12	Llama 3 Community	163997.00
49.00	GLM-4-0520	1206.60	1191.31	1187.77	1188.58	1215.96	1209.08	1188.30	1221.16	1209.80	1207.55	1257.39	1217.40	1213.23	1201.08	1190.25	1289.53	1160.59	1178.22	1271.56	1191.92	1235.40	1221.06	Zhipu AI	glm-4-0520	10/15/2024	Unknown	Proprietary	10229.00
55.00	GPT-4-0613	1163.17	1180.14	1185.99	1182.73	1166.92	1188.55	1178.17	1174.37	1168.64	1164.19	1187.60	1193.39	1168.04	1164.08	1147.98	1182.41	1122.28	1156.30	1268.55	1205.79	1195.67	1168.10	OpenAI	gpt-4-0613	10/15/2024	2021/9	Proprietary	91686.00
56.00	Gemini App (2024-01-24)	1208.68	1161.11	1179.13	1141.15	1171.45	1158.62	1135.58	1197.91	1212.73	1208.09	1249.22	1133.72	1156.76	1142.02	1182.05	1275.23	1263.22	1243.27	1333.21	1205.23	1259.54	1226.21	Google	bard-jan-24-gemini-pro	10/15/2024	Online	Proprietary	11824.00
56.00	Command R+ (04-2024)	1189.87	1153.91	1182.81	1160.00	1164.41	1187.15	1136.98	1196.92	1194.29	1191.23	1231.72	1214.94	1168.81	1154.18	1162.99	1254.10	1160.35	1188.77	1305.37	1272.87	1224.66	1182.25	Cohere	command-r-plus	10/15/2024	2024/3	CC-BY-NC-4.0	80926.00
56.00	DeepSeek-Coder-V2-Instruct	1178.39	1226.58	1180.49	1197.73	1239.29	1189.41	1211.33	1180.19	1204.92	1179.58	1212.14	1224.61	1211.19	1202.62	1150.23	1259.30	1138.33	1159.66	1283.21	1248.86	1210.79	1153.69	DeepSeek AI	deepseek-coder-v2	10/15/2024	2024/6	DeepSeek License	15799.00
56.00	Reka-Flash-20240722	1200.76	1173.24	1179.27	1164.67	1187.35	1187.75	1160.24	1197.61	1204.78	1200.65	1245.09	1194.12	1178.13	1167.61	1173.86	1270.27	1196.46	1202.93	1289.20	1287.69	1247.17	1213.22	Reka AI	reka-flash-20240722	10/15/2024	-	Proprietary	13779.00
57.00	Qwen2-72B-Instruct	1187.13	1178.10	1181.48	1177.27	1186.48	1190.10	1202.34	1196.69	1192.35	1187.94	1225.46	1200.42	1189.08	1184.33	1171.06	1293.51	1128.24	1146.46	1265.45	1226.10	1195.13	1172.11	Alibaba	qwen2-72b-instruct	10/15/2024	2024/6	Qianwen LICENSE	38986.00
58.00	Command R (08-2024)	1178.73	1159.09	1175.09	1164.71	1160.83	1178.67	1127.91	1165.95	1184.20	1179.79	1202.72	1212.01	1168.71	1158.33	1153.56	1236.09	1130.59	1171.13	1296.19	1294.60	1199.64	1168.68	Cohere	command-r-08-2024	10/15/2024	2024/8	CC-BY-NC-4.0	10907.00
59.00	Gemini-1.5-Flash-8B-001	1210.39	1158.97	1176.71	1169.54	1202.39	1204.96	1181.90	1190.72	1215.72	1211.00	1259.88	1228.14	1206.08	1184.79	1175.66	1285.40	1196.55	1187.38	1276.69	1286.37	1259.14	1241.04	Google	gemini-1.5-flash-8b-001	10/15/2024	-	Proprietary	10389.00
60.00	Claude 3 Haiku	1179.09	1182.87	1176.79	1174.01	1189.02	1181.53	1159.11	1191.41	1188.16	1179.34	1213.57	1198.62	1177.77	1167.72	1157.36	1211.26	1149.91	1169.33	1255.80	1252.03	1223.60	1169.18	Anthropic	claude-3-haiku-20240307	10/15/2024	2023/8	Proprietary	119440.00
60.00	Gemma-2-9b-it	1189.42	1163.11	1175.26	1159.54	1167.39	1181.26	1149.53	1192.51	1193.66	1189.78	1226.08	1206.50	1168.69	1155.35	1167.70	1242.39	1149.05	1185.09	1278.29	1280.22	1221.00	1199.92	Google	gemma-2-9b-it	10/15/2024	2024/6	Gemma license	34626.00
60.00	Reka-Core-20240501	1199.57	1172.35	1176.33	1167.52	1190.05	1186.07	1159.30	1188.82	1203.86	1200.96	1246.26	1192.72	1186.75	1173.44	1176.07	1261.14	1178.91	1197.71	1283.47	1273.04	1229.60	1190.39	Reka AI	reka-core-20240501	10/15/2024	-	Proprietary	62639.00
63.00	Gemini-1.5-Flash-8b-Exp-0827	1205.05	1159.89	1171.25	1160.84	1189.64	1198.75	1171.38	1200.98	1209.38	1205.76	1251.69	1231.92	1195.79	1181.01	1176.13	1273.56	1190.33	1181.38	1305.25	1301.52	1250.65	1220.46	Google	gemini-1.5-flash-8b-exp-0827	10/15/2024	2023/11	Proprietary	25557.00
64.00	Qwen-Max-0428	1182.94	1174.38	1171.32	1166.94	1189.42	1180.34	1167.52	1175.05	1186.68	1183.74	1219.57	1198.10	1186.23	1177.76	1168.00	1293.07	1162.45	1130.10	1265.60	1219.71	1179.44	1154.18	Alibaba	qwen-max-0428	10/15/2024	-	Proprietary	25719.00
71.00	Claude-1	1149.03	1151.11	1160.32	1136.16	1136.06	1141.43	1115.08	1171.74	1166.17	1148.46	1167.99	1163.67	1125.89	1117.10	1129.47	1195.36	1115.08	1172.81	1233.20	1081.67	1193.15	1172.17	Anthropic	claude-1	10/15/2024	-	Proprietary	21168.00
71.00	GLM-4-0116	1183.22	1167.42	1161.74	1165.02	1190.79	1180.94	1162.36	1181.34	1186.38	1185.85	1221.07	1193.67	1186.70	1176.60	1177.02	1275.24	1129.94	1153.51	1244.97	1146.42	1182.35	1200.66	Zhipu AI	glm-4-0116	10/15/2024	Unknown	Proprietary	7584.00
71.00	Jamba-1.5-Mini	1175.99	1165.45	1156.16	1145.98	1181.05	1158.32	1132.12	1162.28	1180.06	1176.53	1202.77	1170.29	1169.14	1166.02	1177.75	1196.32	1132.83	1159.37	1173.48	1180.53	1179.06	1221.70	AI21 Labs	jamba-1.5-mini	10/15/2024	2024/3	Jamba Open	9300.00
71.00	Mistral-Large-2402	1157.24	1170.36	1157.67	1164.21	1169.67	1172.53	1164.87	1165.69	1159.37	1158.49	1181.03	1177.01	1165.31	1157.19	1146.20	1178.35	1162.28	1173.75	1173.78	1160.22	1196.01	1194.11	Mistral	mistral-large-2402	10/15/2024	-	Proprietary	64952.00
71.00	Qwen1.5-110B-Chat	1161.48	1162.87	1155.21	1153.99	1174.49	1163.23	1150.97	1158.89	1164.69	1161.36	1184.85	1166.67	1168.74	1166.68	1150.58	1259.94	1105.10	1117.53	1227.07	1188.15	1144.77	1144.33	Alibaba	qwen1.5-110b-chat	10/15/2024	2024/4	Qianwen LICENSE	27476.00
72.00	Reka-Flash-21B-online	1155.83	1143.44	1151.19	1144.34	1146.80	1138.11	1140.76	1149.39	1158.01	1155.67	1179.32	1151.11	1142.85	1133.34	1136.01	1196.45	1112.14	1147.91	1232.72	1245.63	1189.70	1144.21	Reka AI	reka-flash-21b-20240226-online	10/15/2024	Online	Proprietary	16026.00
73.00	Mistral-Next	1124.48	1154.81	1149.30	1148.70	1132.58	1158.00	1140.41	1136.99	1126.47	1124.91	1130.86	1150.83	1129.28	1121.71	1110.18	1134.88	1112.39	1154.81	1135.29	1029.25	1173.79	1130.11	Mistral	mistral-next	10/15/2024	-	Proprietary	12381.00
73.00	Reka-Flash-Preview-20240611	1165.11	1145.92	1150.90	1137.09	1155.17	1146.36	1127.49	1148.60	1168.33	1165.35	1189.67	1147.08	1144.37	1130.51	1141.81	1218.75	1140.61	1162.28	1250.96	1251.11	1196.33	1176.19	Reka AI	reka-flash-preview-20240611	10/15/2024	-	Proprietary	20474.00
75.00	Mixtral-8x22b-Instruct-v0.1	1147.65	1152.32	1149.97	1147.60	1152.77	1154.83	1152.42	1130.91	1150.77	1148.44	1163.88	1155.65	1148.58	1142.94	1136.51	1177.68	1121.46	1139.05	1194.82	1198.24	1179.77	1144.71	Mistral	mixtral-8x22b-instruct-v0.1	10/15/2024	2024/4	Apache 2.0	53836.00
77.00	Claude-2.0	1132.01	1151.69	1143.87	1140.45	1135.36	1130.56	1126.82	1161.46	1150.60	1131.87	1140.55	1147.05	1126.43	1119.54	1114.14	1189.83	1101.35	1152.16	1215.89	1161.03	1205.66	1138.89	Anthropic	claude-2.0	10/15/2024	-	Proprietary	12767.00
77.00	Command R (04-2024)	1148.73	1124.77	1147.78	1124.21	1122.92	1132.35	1089.34	1148.58	1150.89	1148.46	1167.94	1166.93	1119.39	1105.68	1123.29	1208.96	1112.83	1123.23	1247.42	1239.98	1184.30	1150.37	Cohere	command-r	10/15/2024	2024/3	CC-BY-NC-4.0	56425.00
77.00	Gemini-1.0-Pro-001	1131.58	1119.54	1146.69	1125.46	1102.78	1118.85	1099.44	1119.39	1133.64	1130.55	1144.91	1143.64	1105.82	1095.49	1108.59	1181.32	1101.51	1124.51	1199.43	1212.84	1208.15	1127.58	Google	gemini-pro-dev-api	10/15/2024	2023/4	Proprietary	18790.00
77.00	GPT-3.5-Turbo-0314	1106.76	1137.89	1138.53	1136.26	1115.39	1148.73	1140.38	1107.59	1114.58	1106.46	1096.88	1110.11	1117.17	1097.22	1081.64	1204.35	1143.29	1151.42	1282.01	1205.23	1146.39	1165.33	OpenAI	gpt-3.5-turbo-0314	10/15/2024	2021/9	Proprietary	5647.00
77.00	Qwen1.5-72B-Chat	1147.52	1156.79	1148.39	1142.07	1160.04	1144.27	1128.61	1153.74	1150.58	1147.29	1166.30	1165.74	1146.85	1140.93	1135.17	1240.79	1112.90	1077.72	1219.26	1190.39	1128.16	1110.90	Alibaba	qwen1.5-72b-chat	10/15/2024	2024/2	Qianwen LICENSE	40642.00
82.00	Llama-3-8b-Instruct	1152.05	1138.60	1141.79	1129.26	1145.97	1136.79	1118.96	1152.85	1154.46	1150.92	1171.06	1136.15	1137.05	1144.11	1163.65	1135.26	1113.75	1101.68	1138.30	1152.27	1138.51	1174.60	Meta	llama-3-8b-instruct	10/15/2024	2023/3	Llama 3 Community	109414.00
82.00	Mistral Medium	1147.82	1141.33	1140.49	1137.41	1152.64	1153.74	1139.92	1145.38	1148.37	1148.20	1167.79	1162.74	1144.35	1132.26	1137.88	1164.90	1133.59	1149.41	1182.41	1170.73	1189.67	1144.13	Mistral	mistral-medium	10/15/2024	-	Proprietary	35562.00
82.00	Reka-Flash-21B	1147.69	1138.17	1142.01	1134.74	1141.10	1129.77	1123.80	1142.11	1150.72	1147.20	1165.61	1151.16	1133.74	1126.79	1126.08	1193.98	1128.81	1150.36	1212.00	1218.71	1181.82	1140.67	Reka AI	reka-flash-21b-20240226	10/15/2024	2023/11	Proprietary	25798.00
84.00	Gemini Pro	1110.78	1112.34	1130.04	1113.75	1091.75	1103.21	1086.19	1143.19	1115.73	1109.98	1111.82	1125.77	1083.22	1080.11	1097.84	1152.34	1058.74	1017.73	1208.33	1290.88	1153.02	1085.95	Google	gemini-pro	10/15/2024	2023/4	Proprietary	6560.00
84.00	GPT-3.5-Turbo-0125	1105.84	1146.84	1137.58	1131.45	1123.64	1125.15	1109.56	1115.18	1111.95	1105.47	1100.22	1136.96	1111.92	1105.95	1086.83	1130.79	1072.94	1091.61	1204.05	1168.72	1147.38	1117.58	OpenAI	gpt-3.5-turbo-0125	10/15/2024	2021/9	Proprietary	68912.00
84.00	GPT-3.5-Turbo-0613	1116.96	1147.46	1137.05	1135.33	1134.97	1128.63	1107.48	1117.39	1123.97	1116.76	1120.39	1125.54	1123.34	1116.02	1098.25	1157.20	1098.96	1120.91	1209.99	1198.53	1184.11	1120.96	OpenAI	gpt-3.5-turbo-0613	10/15/2024	2021/9	Proprietary	38949.00
85.00	Claude-2.1	1118.39	1152.63	1135.32	1136.16	1131.87	1109.77	1122.99	1158.96	1137.20	1117.75	1122.81	1133.28	1119.13	1107.81	1096.96	1146.98	1138.52	1136.88	1209.83	1144.05	1174.83	1123.42	Anthropic	claude-2.1	10/15/2024	-	Proprietary	37694.00
86.00	Zephyr-ORPO-141b-A35b-v0.1	1127.60	1126.65	1131.23	1120.15	1124.51	1129.04	1119.16	1103.52	1129.60	1127.43	1137.77	1119.11	1117.01	1113.12	1119.42	1143.15	1139.45	1089.30	1187.06	1171.51	1141.56	1102.48	HuggingFace	zephyr-orpo-141b-A35b-v0.1	10/15/2024	2024/4	Apache 2.0	4862.00
88.00	Yi-1.5-34B-Chat	1157.18	1133.41	1133.02	1133.89	1162.10	1147.24	1150.21	1158.10	1160.21	1157.45	1178.97	1158.83	1159.89	1159.63	1163.29	1266.93	1110.93	1106.70	1178.89	1151.76	1119.04	1125.20	01 AI	yi-1.5-34b-chat	10/15/2024	2024/5	Apache-2.0	25147.00
90.00	Claude-Instant-1	1111.31	1131.28	1126.93	1124.91	1109.05	1107.24	1111.33	1146.93	1129.99	1110.78	1110.44	1133.51	1107.16	1100.30	1096.98	1145.57	1079.14	1104.59	1192.88	1122.17	1131.30	1101.36	Anthropic	claude-instant-1	10/15/2024	-	Proprietary	20626.00
92.00	Meta-Llama-3.1-8b-Instruct	1172.51	1138.08	1125.27	1136.38	1182.42	1167.44	1143.09	1172.02	1176.71	1172.81	1197.32	1191.45	1178.71	1177.51	1167.85	1207.81	1124.04	1143.37	1213.00	1209.97	1175.52	1182.81	Meta	llama-3.1-8b-instruct	10/15/2024	2023/12	Llama 3.1 Community	32937.00
92.00	Qwen1.5-32B-Chat	1125.50	1143.33	1127.49	1129.91	1149.22	1122.26	1125.51	1138.13	1128.43	1124.72	1130.99	1157.68	1135.73	1130.47	1109.97	1234.89	1059.33	1053.36	1189.19	1150.63	1096.84	1089.87	Alibaba	qwen1.5-32b-chat	10/15/2024	2024/2	Qianwen LICENSE	22763.00
97.00	Phi-3-Medium-4k-Instruct	1123.00	1115.02	1118.54	1120.96	1125.33	1123.11	1141.10	1094.86	1126.43	1123.45	1118.47	1132.90	1129.67	1126.67	1117.89	1165.13	1071.39	1101.72	1198.53	1110.12	1169.48	1096.34	Microsoft	phi-3-medium-4k-instruct	10/15/2024	2023/10	MIT	26163.00
98.00	DBRX-Instruct-Preview	1103.20	1124.09	1113.51	1115.07	1117.89	1114.34	1108.37	1102.31	1105.14	1103.20	1096.42	1124.89	1109.31	1110.15	1103.73	1121.44	1049.86	1061.49	1154.85	1137.81	1096.66	1066.41	Databricks	dbrx-instruct-preview	10/15/2024	2023/12	DBRX LICENSE	33735.00
98.00	InternLM2.5-20b-chat	1148.93	1136.23	1111.63	1144.38	1159.01	1149.52	1158.63	1134.89	1154.05	1149.06	1152.98	1168.99	1168.05	1176.33	1156.97	1256.43	1012.58	1058.64	1208.55	1165.71	1139.23	1109.86	InternLM	internlm2_5-20b-chat	10/15/2024	2024/8	Other	9176.00
99.00	GPT-3.5-Turbo-1106	1067.88	1126.09	1109.29	1118.42	1095.09	1090.89	1104.76	1070.83	1081.48	1067.36	1046.33	1088.94	1091.06	1088.71	1052.48	1076.48	1020.89	1066.42	1209.00	1098.92	1104.96	1090.11	OpenAI	gpt-3.5-turbo-1106	10/15/2024	2021/9	Proprietary	17026.00
99.00	Mixtral-8x7b-Instruct-v0.1	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	Mistral	mixtral-8x7b-instruct-v0.1	10/15/2024	2023/12	Apache 2.0	76163.00
100.00	Gemma-2-2b-it	1137.70	1082.03	1109.71	1092.16	1098.02	1119.22	1105.51	1112.62	1141.93	1137.48	1136.80	1138.89	1109.91	1106.29	1127.57	1181.14	1125.73	1109.92	1236.12	1208.26	1134.17	1125.53	Google	gemma-2-2b-it	10/15/2024	2024/7	Gemma license	26098.00
100.00	Qwen1.5-14B-Chat	1108.89	1117.86	1106.93	1109.31	1125.93	1102.83	1090.76	1108.72	1111.27	1107.56	1105.78	1125.74	1116.51	1110.12	1095.43	1202.74	1068.38	1041.66	1190.60	1146.88	1073.77	1079.29	Alibaba	qwen1.5-14b-chat	10/15/2024	2024/2	Qianwen LICENSE	18681.00
100.00	WizardLM-70B-v1.0	1106.39	1071.03	1105.30	1074.86	1071.18	1102.28	1076.53	1109.02	1103.40	1105.48	1105.92	1104.93	1077.43	1072.59	1097.96	1113.55	1038.96	1086.87	1168.95	1063.17	1169.05	1084.27	Microsoft	wizardlm-70b	10/15/2024	2023/8	Llama 2 Community	8385.00
102.00	Snowflake Arctic Instruct	1090.09	1093.24	1102.76	1089.26	1077.00	1077.95	1080.58	1070.37	1092.07	1089.01	1072.67	1018.58	1073.80	1066.30	1077.73	1129.21	1085.61	1077.83	1135.90	1091.87	1127.15	1090.42	Snowflake	snowflake-arctic-instruct	10/15/2024	2024/4	Apache 2.0	34179.00
104.00	OpenChat-3.5-0106	1091.53	1106.82	1100.87	1088.59	1102.12	1081.67	1071.46	1092.35	1090.83	1089.90	1081.60	1096.63	1083.74	1073.68	1080.66	1138.36	1047.28	1066.14	1128.13	1023.83	1107.75	1102.15	OpenChat	openchat-3.5-0106	10/15/2024	2024/1	Apache-2.0	12977.00
104.00	Yi-34B-Chat	1111.14	1089.11	1099.81	1088.92	1106.06	1094.23	1079.46	1110.58	1115.34	1110.89	1111.96	1105.63	1101.99	1097.27	1106.04	1232.34	1046.34	1038.15	1173.52	1098.71	1079.53	1071.69	01 AI	yi-34b-chat	10/15/2024	2023/6	Yi License	15930.00
105.00	Gemma-1.1-7b-it	1083.79	1108.19	1097.32	1097.64	1084.52	1071.57	1079.13	1043.75	1086.74	1081.42	1061.91	1072.37	1077.10	1077.44	1078.89	1118.63	1018.69	1050.22	1133.86	1140.50	1076.39	1054.16	Google	gemma-1.1-7b-it	10/15/2024	2024/2	Gemma license	25097.00
105.00	Phi-3-Small-8k-Instruct	1101.69	1100.06	1098.15	1101.58	1107.09	1101.92	1120.32	1071.07	1106.11	1101.91	1085.23	1101.61	1107.30	1111.48	1106.18	1122.86	1090.84	1075.47	1126.91	1054.19	1138.36	1110.68	Microsoft	phi-3-small-8k-instruct	10/15/2024	2023/10	MIT	18492.00
106.00	OpenChat-3.5	1076.52	1067.14	1094.42	1076.90	1053.85	1074.48	1035.31	1087.66	1070.13	1076.50	1062.60	1108.67	1065.57	1055.73	1064.75	1125.10	1063.39	1037.88	1109.07	1108.24	1128.81	1079.60	OpenChat	openchat-3.5	10/15/2024	2023/11	Apache-2.0	8115.00
107.00	DeepSeek-LLM-67B-Chat	1076.78	1086.67	1088.68	1071.31	1079.28	1082.30	1070.45	1077.63	1078.15	1076.82	1065.50	1100.25	1065.29	1060.09	1063.84	1179.66	1001.80	1005.58	1162.73	1205.23	1158.83	1063.22	DeepSeek AI	deepseek-llm-67b-chat	10/15/2024	2023/11	DeepSeek License	4982.00
107.00	Meta-Llama-3.2-3b-Instruct	1102.56	1045.59	1089.92	1079.57	1081.71	1105.47	1098.86	1109.69	1106.04	1102.04	1083.72	1118.05	1102.80	1129.63	1140.32	1086.40	1029.76	1052.40	1080.27	1003.87	981.27	1103.13	Meta	llama-3.2-3b-instruct	10/15/2024	2023/12	Llama 3.2	8620.00
107.00	OpenHermes-2.5-Mistral-7b	1074.71	1065.27	1086.38	1074.89	1059.17	1074.48	1062.00	1064.20	1069.65	1072.85	1060.04	1071.58	1068.77	1064.50	1072.11	1083.81	1027.36	995.81	1144.87	1159.64	1084.99	1053.30	NousResearch	openhermes-2.5-mistral-7b	10/15/2024	2023/11	Apache-2.0	5093.00
107.00	Tulu-2-DPO-70B	1099.29	1082.31	1091.00	1088.03	1093.27	1106.45	1074.05	1082.19	1100.38	1098.97	1093.50	1116.32	1098.27	1099.32	1091.91	1060.50	1088.38	1066.66	1133.64	896.81	1156.70	1120.33	AllenAI/UW	tulu-2-dpo-70b	10/15/2024	2023/11	AI2 ImpACT Low-risk	6666.00
107.00	Vicuna-33B	1090.73	1068.21	1091.56	1066.47	1067.19	1073.66	1036.42	1086.84	1087.31	1090.09	1082.67	1043.94	1066.16	1061.00	1086.39	1094.03	1056.18	1054.78	1148.22	974.55	1100.53	1085.25	LMSYS	vicuna-33b	10/15/2024	2023/8	Non-commercial	22950.00
109.00	Starling-LM-7B-beta	1119.01	1110.19	1091.30	1103.30	1129.43	1104.47	1093.71	1106.78	1120.62	1118.92	1124.09	1120.47	1119.59	1112.15	1107.84	1179.00	1064.40	1075.81	1161.27	1090.50	1123.56	1143.77	Nexusflow	starling-lm-7b-beta	10/15/2024	2024/3	Apache-2.0	16672.00
111.00	Starling-LM-7B-alpha	1088.43	1075.95	1082.62	1069.85	1080.22	1073.59	1047.77	1082.68	1085.09	1088.45	1079.37	1093.28	1073.01	1070.31	1083.25	1106.51	1039.22	1028.69	1129.71	1142.18	1110.42	1115.27	UC Berkeley	starling-lm-7b-alpha	10/15/2024	2023/11	CC-BY-NC-4.0	10417.00
114.00	Llama-2-70b-chat	1093.22	1061.01	1081.11	1062.78	1072.28	1075.07	1058.48	1081.32	1094.74	1092.04	1083.61	1071.84	1070.48	1070.63	1096.71	1057.02	1047.56	1027.41	1110.34	1113.83	1106.34	1137.68	Meta	llama-2-70b-chat	10/15/2024	2023/7	Llama 2 Community	39641.00
117.00	Dolphin-2.2.1-Mistral-7B	1062.59	1021.97	1062.45	1041.09	1025.39	1057.00	1041.64	1018.18	1058.05	1061.87	1039.56	1032.83	1050.67	1044.35	1059.43	1104.53	990.20	937.21	1214.10	1205.23	1106.67	1137.12	Cognitive Computations	dolphin-2.2.1-mistral-7b	10/15/2024	2023/10	Apache-2.0	1714.00
117.00	NV-Llama2-70B-SteerLM-Chat	1080.54	1022.81	1069.72	1042.36	1022.99	1063.61	1036.93	1059.81	1076.49	1079.81	1071.80	1012.42	1046.13	1035.51	1069.33	1086.97	1050.39	1081.85	1115.34	975.65	1139.97	1035.85	Nvidia	llama2-70b-steerlm-chat	10/15/2024	2023/11	Llama 2 Community	3638.00
117.00	pplx-70b-online	1078.04	1033.23	1074.27	1027.92	1028.41	1032.57	1042.83	986.44	1076.10	1077.06	1065.77	1016.47	1028.10	1025.16	1066.69	1127.81	1046.60	1039.10	1209.32	1197.21	1074.84	1061.82	Perplexity AI	pplx-70b-online	10/15/2024	Online	Proprietary	6892.00
120.00	falcon-180b-chat	1034.38	1044.94	1064.92	1025.21	1017.30	1053.42	1013.19	1012.70	1031.59	1034.44	1003.13	1056.33	1001.05	1009.89	1026.21	1002.59	1107.21	1146.27	1166.95	0.00	867.48	1101.99	TII	falcon-180b-chat	10/15/2024	2023/9	Falcon-180B TII License	1327.00
120.00	Mistral-7B-Instruct-v0.2	1072.22	1066.60	1066.97	1063.48	1073.82	1067.54	1056.72	1070.22	1072.14	1071.28	1050.14	1071.79	1068.64	1071.21	1081.80	1068.57	984.10	979.14	1042.67	1064.62	1045.63	1024.54	Mistral	mistral-7b-instruct-v0.2	10/15/2024	2023/12	Apache-2.0	20059.00
120.00	MPT-30B-chat	1045.67	1046.02	1063.06	1062.59	1030.82	1057.39	1014.55	1052.40	1040.48	1043.90	1022.76	1073.17	1048.07	1059.40	1043.55	1024.54	999.88	992.97	1088.20	1205.23	956.56	1070.87	MosaicML	mpt-30b-chat	10/15/2024	2023/6	CC-BY-NC-SA-4.0	2649.00
120.00	Nous-Hermes-2-Mixtral-8x7B-DPO	1084.21	1067.25	1069.20	1036.77	1079.53	1054.60	1028.43	1079.18	1085.56	1083.94	1074.38	1060.74	1052.26	1045.40	1078.03	1076.11	1078.34	1027.86	1158.86	1205.23	1079.97	1026.17	NousResearch	nous-hermes-2-mixtral-8x7b-dpo	10/15/2024	2024/1	Apache-2.0	3840.00
120.00	Phi-3-Mini-4k-Instruct-June-24	1070.90	1074.43	1068.19	1090.35	1082.19	1074.48	1123.41	1054.51	1074.56	1071.24	1020.53	1055.49	1095.55	1100.77	1082.28	1094.07	1051.49	1029.93	1123.88	1033.18	1049.36	1131.79	Microsoft	phi-3-mini-4k-instruct-june-2024	10/15/2024	2023/10	MIT	12886.00
120.00	Qwen1.5-7B-Chat	1070.16	1081.44	1067.23	1058.29	1088.64	1064.01	1048.29	1061.06	1069.84	1068.26	1047.50	1102.38	1066.81	1056.14	1054.75	1196.22	1015.35	1022.41	1177.56	1043.55	1036.95	1016.27	Alibaba	qwen1.5-7b-chat	10/15/2024	2024/2	Qianwen LICENSE	4869.00
120.00	SOLAR-10.7B-Instruct-v1.0	1061.99	1049.72	1063.60	1052.55	1046.35	1058.20	1029.00	1041.76	1058.06	1061.93	1038.74	1133.97	1056.26	1050.06	1060.24	1070.52	1001.80	1015.92	1140.40	936.63	1063.57	1031.89	Upstage AI	solar-10.7b-instruct-v1.0	10/15/2024	2023/11	CC-BY-NC-4.0	4286.00
120.00	WizardLM-13b-v1.2	1058.63	1031.58	1064.48	1015.31	1026.42	1050.94	987.45	1043.09	1057.93	1056.12	1039.65	1066.39	1013.92	1011.05	1050.45	1075.47	1023.80	1035.68	1077.04	1092.48	1082.36	1072.89	Microsoft	wizardlm-13b	10/15/2024	2023/7	Llama 2 Community	7184.00
122.00	Qwen-14B-Chat	1035.24	1064.36	1054.09	1033.01	1055.90	1034.50	1033.47	1019.04	1036.91	1033.27	1000.29	1038.73	1023.91	1017.76	1017.18	1135.34	1025.60	1016.91	1173.07	962.79	1081.55	1082.77	Alibaba	qwen-14b-chat	10/15/2024	2023/8	Qianwen LICENSE	5070.00
122.00	Vicuna-13B	1042.25	1042.93	1060.52	1036.98	1032.32	1040.85	999.84	1032.80	1041.48	1040.45	1011.18	1062.49	1025.50	1017.99	1028.42	1097.77	991.59	991.21	1126.38	1064.49	1075.31	1068.69	LMSYS	vicuna-13b	10/15/2024	2023/7	Llama 2 Community	19798.00
126.00	Phi-3-Mini-4k-Instruct	1066.15	1069.87	1054.84	1066.64	1085.66	1067.44	1084.94	1025.95	1070.19	1065.04	1021.63	1052.52	1078.88	1084.47	1072.57	1081.64	1032.75	1038.54	1099.87	1061.75	1056.70	1094.23	Microsoft	phi-3-mini-4k-instruct	10/15/2024	2023/10	MIT	21122.00
127.00	Llama-2-13b-chat	1063.40	1040.17	1052.92	1041.81	1051.24	1046.71	1032.59	1046.02	1068.75	1061.75	1037.21	1078.11	1049.66	1048.77	1061.09	1055.95	991.64	997.80	1063.90	1094.72	1076.43	1076.06	Meta	llama-2-13b-chat	10/15/2024	2023/7	Llama 2 Community	19737.00
128.00	Gemma-7b-it	1037.56	1057.74	1046.83	1054.83	1046.95	1023.42	1032.75	959.00	1040.49	1035.02	999.92	1036.36	1045.21	1045.62	1032.33	1095.53	980.79	978.92	1079.77	1095.01	1014.71	982.81	Google	gemma-7b-it	10/15/2024	2024/2	Gemma license	9182.00
128.00	Guanaco-33B	1032.48	969.24	1044.50	1011.67	965.60	993.44	993.94	1005.40	1035.34	1030.71	1004.02	965.89	1000.87	996.83	1028.77	1013.99	1057.90	1020.85	982.62	1205.23	1040.24	1053.30	UW	guanaco-33b	10/15/2024	2023/5	Non-commercial	2998.00
128.00	Zephyr-7b-alpha	1041.35	1027.58	1042.05	1016.14	1034.35	1041.87	1006.58	1013.99	1033.23	1038.82	1012.42	1012.10	1023.17	1018.58	1039.16	1043.26	1005.53	920.81	1079.15	1205.23	1047.95	1001.09	HuggingFace	zephyr-7b-alpha	10/15/2024	2023/10	MIT	1814.00
128.00	Zephyr-7b-beta	1053.44	1025.81	1048.34	1020.12	1030.00	1038.70	1010.99	1032.09	1048.62	1052.00	1027.66	1054.34	1026.64	1027.55	1053.34	1018.30	991.23	976.95	1042.49	1054.25	1069.81	1040.30	HuggingFace	zephyr-7b-beta	10/15/2024	2023/10	MIT	11328.00
129.00	CodeLlama-34B-instruct	1042.84	1041.04	1045.49	1029.89	1042.06	1029.32	1022.34	1012.72	1042.46	1040.77	1012.82	1026.35	1027.96	1022.35	1034.86	1033.28	1011.13	988.43	1031.37	1037.40	1105.41	1122.14	Meta	codellama-34b-instruct	10/15/2024	2023/7	Llama 2 Community	7508.00
129.00	CodeLlama-70B-instruct	1042.21	1040.94	1034.57	1046.88	1047.94	1031.75	1032.43	1032.23	1052.93	1040.53	1008.30	998.60	1051.15	1053.84	1045.77	1091.31	1107.21	913.72	1214.10	1205.23	1039.99	1137.12	Meta	codellama-70b-instruct	10/15/2024	2024/1	Llama 2 Community	1190.00
129.00	Phi-3-Mini-128k-Instruct	1036.93	1033.77	1048.48	1041.16	1029.29	1036.39	1063.88	991.46	1039.87	1035.13	983.47	1015.37	1035.73	1036.37	1033.98	1076.84	994.00	1009.28	1079.17	1026.93	1038.48	1056.11	Microsoft	phi-3-mini-128k-instruct	10/15/2024	2023/10	MIT	21618.00
130.00	Meta-Llama-3.2-1b-Instruct	1053.84	1003.74	1043.39	1030.78	1046.20	1052.72	1064.47	1037.36	1057.74	1052.56	982.43	1072.28	1059.44	1078.37	1081.15	1025.87	1014.80	1007.72	1214.10	1002.84	971.99	1028.03	Meta	llama-3.2-1b-instruct	10/15/2024	2023/12	Llama 3.2	8703.00
130.00	PaLM-Chat-Bison-001	1003.74	1030.62	1044.68	1039.92	990.27	1014.31	1015.30	993.17	997.53	1000.34	961.00	1014.56	1001.01	1010.53	1006.23	931.89	885.77	863.83	1072.88	1046.52	1020.88	894.68	Google	palm-2	10/15/2024	2021/6	Proprietary	8746.00
133.00	pplx-7b-online	1044.60	1016.25	1039.86	1015.49	1015.27	998.06	1014.22	990.59	1039.85	1043.68	1017.75	994.87	1016.44	1013.64	1039.22	1084.14	929.22	947.11	1159.72	1108.96	1057.15	1039.90	Perplexity AI	pplx-7b-online	10/15/2024	Online	Proprietary	6337.00
135.00	Gemma-1.1-2b-it	1020.79	1064.21	1036.35	1044.85	1035.95	1006.53	1023.05	962.89	1023.10	1017.01	955.87	1019.88	1015.78	1016.97	1013.47	1076.18	967.82	947.85	1071.48	1050.67	1020.13	995.02	Google	gemma-1.1-2b-it	10/15/2024	2024/2	Gemma license	11352.00
137.00	StripedHyena-Nous-7B	1017.66	1013.00	1033.73	1005.53	999.92	1012.23	1000.18	1011.80	1016.16	1016.24	971.97	994.69	995.95	993.96	1013.62	1030.27	970.81	933.59	1059.20	1043.39	1021.31	990.38	Together AI	stripedhyena-nous-7b	10/15/2024	2023/12	Apache 2.0	5271.00
144.00	Llama-2-7b-chat	1036.96	991.09	1025.16	1002.80	1002.48	1012.54	1009.99	1027.90	1043.00	1034.66	997.93	1012.68	1010.10	1011.50	1041.19	1032.29	926.05	957.32	1062.42	1059.07	1016.07	988.33	Meta	llama-2-7b-chat	10/15/2024	2023/7	Llama 2 Community	14558.00
144.00	Mistral-7B-Instruct-v0.1	1008.26	1018.75	1024.79	1012.72	1008.01	1012.82	996.51	1011.36	999.46	1006.81	956.43	1020.56	1002.35	1003.85	1008.54	992.96	896.69	924.64	1037.99	1030.86	1033.98	975.43	Mistral	mistral-7b-instruct	10/15/2024	2023/9	Apache 2.0	9141.00
144.00	Vicuna-7B	1005.23	991.66	1022.96	1002.60	981.57	995.71	964.15	987.22	1004.35	1002.48	964.63	1051.02	989.89	979.26	989.24	1028.75	1027.05	962.53	1129.15	1205.23	1040.06	1068.20	LMSYS	vicuna-7b	10/15/2024	2023/7	Llama 2 Community	7020.00
146.00	Gemma-2b-it	989.58	1019.56	1012.48	1012.64	1000.52	975.91	978.83	936.82	992.23	986.45	923.63	997.63	987.22	976.46	981.72	1050.53	856.26	909.88	1019.88	1044.12	964.61	985.47	Google	gemma-2b-it	10/15/2024	2024/2	Gemma license	4916.00
146.00	Qwen1.5-4B-Chat	988.53	1001.02	1015.85	990.76	990.10	983.94	993.05	978.01	989.28	985.24	912.23	1004.60	977.53	965.38	966.87	1084.67	927.43	904.98	1030.62	1205.23	977.84	1013.50	Alibaba	qwen1.5-4b-chat	10/15/2024	2024/2	Qianwen LICENSE	7811.00
151.00	GPT4All-13B-Snoozy	931.84	967.64	992.87	982.32	909.83	947.50	903.69	922.17	928.64	930.28	858.24	951.05	931.74	931.79	930.57	932.70	1107.21	812.02	928.65	1205.23	964.84	880.70	Nomic AI	gpt4all-13b-snoozy	10/15/2024	2023/3	Non-commercial	1786.00
151.00	OLMo-7B-instruct	1015.36	998.86	997.95	979.33	1017.24	987.71	988.31	1005.33	1013.28	1014.00	964.58	1057.45	994.17	993.52	1018.53	1072.25	880.23	885.29	993.90	1205.23	971.32	975.42	Allen AI	olmo-7b-instruct	10/15/2024	2024/2	Apache-2.0	6496.00
152.00	Koala-13B	964.52	948.67	984.31	938.40	937.36	941.33	897.92	918.22	964.09	961.56	906.38	880.90	924.96	919.45	961.03	926.76	884.84	907.27	1023.69	949.92	922.49	933.06	UC Berkeley	koala-13b	10/15/2024	2023/4	Non-commercial	7035.00
153.00	Alpaca-13B	901.73	876.59	973.26	897.95	789.45	888.86	873.62	881.91	889.25	895.48	816.47	924.44	819.15	814.76	892.60	828.72	805.15	848.54	889.34	1065.48	1036.02	931.06	Stanford	alpaca-13b	10/15/2024	2023/3	Non-commercial	5873.00
153.00	ChatGLM3-6B	955.36	960.08	972.21	956.00	953.11	961.38	954.77	957.94	947.47	952.86	875.93	970.31	953.29	955.26	949.34	1123.13	797.37	818.43	1042.22	1205.23	925.39	922.49	Tsinghua	chatglm3-6b	10/15/2024	2023/10	Apache-2.0	4764.00
153.00	MPT-7B-Chat	927.88	942.23	972.40	931.17	899.84	909.84	886.48	900.58	925.89	924.66	850.81	811.50	891.46	886.06	915.81	1004.37	879.65	904.97	963.04	1010.13	787.96	886.80	MosaicML	mpt-7b-chat	10/15/2024	2023/5	CC-BY-NC-SA-4.0	4014.00
157.00	RWKV-4-Raven-14B	921.86	920.35	954.66	919.26	896.63	885.84	888.51	892.59	914.98	918.40	846.06	1149.10	891.18	878.10	906.33	952.78	877.55	872.48	1033.41	864.86	1000.61	912.72	RWKV	RWKV-4-Raven-14B	10/15/2024	2023/4	Apache 2.0	4934.00
158.00	OpenAssistant-Pythia-12B	893.50	909.16	937.13	921.54	873.20	889.43	858.80	865.44	885.37	890.18	802.55	868.16	880.68	874.55	887.62	860.51	872.22	835.80	864.86	1205.23	835.25	932.94	OpenAssistant	oasst-pythia-12b	10/15/2024	2023/4	Apache 2.0	6380.00
159.00	ChatGLM2-6B	924.06	877.27	930.15	902.22	891.97	908.69	893.88	901.91	910.71	919.94	831.47	891.72	914.85	916.16	925.02	1047.34	1107.21	1109.45	924.51	1205.23	1160.33	852.06	Tsinghua	chatglm2-6b	10/15/2024	2023/6	Apache-2.0	2707.00
161.00	ChatGLM-6B	879.38	895.79	897.42	905.77	883.87	899.41	891.77	854.23	867.11	874.11	775.89	944.26	894.01	870.70	858.21	1132.00	1107.21	686.60	981.09	1205.23	711.24	709.47	Tsinghua	chatglm-6b	10/15/2024	2023/3	Non-commercial	4997.00
161.00	Dolly-V2-12B	822.43	826.62	891.78	869.35	745.89	812.95	837.45	738.92	807.61	817.35	692.29	874.64	797.78	785.72	804.15	876.17	811.98	743.51	926.97	1205.23	753.69	822.42	Databricks	dolly-v2-12b	10/15/2024	2023/4	MIT	3487.00
161.00	FastChat-T5-3B	868.06	796.67	904.99	843.04	759.43	857.63	828.53	852.26	858.51	863.52	758.02	954.26	809.05	805.92	870.93	756.70	810.33	771.30	1214.10	1205.23	1160.33	820.83	LMSYS	fastchat-t5-3b	10/15/2024	2023/4	Apache 2.0	4303.00
161.00	LLaMA-13B	799.41	774.55	883.17	828.24	668.83	778.69	801.98	752.51	788.58	796.75	649.36	806.01	722.18	709.70	778.79	852.69	747.07	693.80	952.67	1205.23	817.37	817.07	Meta	llama-13b	10/15/2024	2023/2	Non-commercial	2445.00
164.00	StableLM-Tuned-Alpha-7B	839.89	873.22	868.34	854.74	858.36	831.31	804.57	820.11	829.52	834.25	712.06	885.93	830.60	825.27	830.44	893.01	693.92	720.90	837.55	1205.23	1160.33	823.50	Stability AI	stablelm-tuned-alpha-7b	10/15/2024	2023/4	CC-BY-NC-SA-4.0	3337.00

Back to Leaderboard History