Model Leaderboard
Last updated: December 5, 2024
View Past Leaderboards| Rank | Model | Overall Score | Coding Style | Creative Writing Style | Full Style | Hard-6 Style | Coding | Creative Writing | Instruction Following | Math | Multi-turn | No Refusal | No Short | No Tie | Long User | Hard-6 | Hard English-6 | English | Chinese | French | German | Japanese | Korean | Russian | Spanish | Organization | Model Slug | Date | Cutoff Date | License | Battles |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.00 | ChatGPT-4o-latest (2024-11-20) | 1365.99 | 1305.69 | 1378.40 | 1317.22 | 1282.31 | 1352.60 | 1408.09 | 1356.35 | 1288.26 | 1402.19 | 1371.38 | 1367.85 | 1512.13 | 1378.76 | 1337.55 | 1324.64 | 1339.22 | 1443.43 | 1340.98 | 1365.48 | 1477.05 | 1546.16 | 1381.23 | 1337.48 | OpenAI | chatgpt-4o-latest-20241120 | 12/5/2024 | - | Proprietary | 21929.00 |
| 1.00 | Gemini-Exp-1206 | 1379.38 | 1328.80 | 1367.72 | 1326.39 | 1328.25 | 1385.47 | 1413.22 | 1388.73 | 1333.46 | 1414.75 | 1384.81 | 1380.53 | 1529.48 | 1405.05 | 1381.38 | 1369.92 | 1350.82 | 1450.97 | 1361.09 | 1422.00 | 1515.73 | 1526.31 | 1394.93 | 1480.14 | gemini-exp-1206 | 12/5/2024 | - | Proprietary | 5052.00 | |
| 3.00 | ChatGPT-4o-latest (2024-09-03) | 1339.23 | 1297.16 | 1341.29 | 1299.74 | 1282.73 | 1338.30 | 1366.90 | 1338.39 | 1273.85 | 1377.22 | 1343.87 | 1341.03 | 1471.16 | 1364.09 | 1331.45 | 1320.22 | 1319.07 | 1422.15 | 1305.30 | 1321.38 | 1446.99 | 1425.46 | 1347.39 | 1320.55 | OpenAI | chatgpt-4o-latest-20240903 | 12/5/2024 | 2023/10 | Proprietary | 48958.00 |
| 3.00 | o1-preview | 1334.33 | 1310.43 | 1315.43 | 1301.92 | 1308.88 | 1354.62 | 1319.18 | 1346.14 | 1340.31 | 1366.39 | 1345.55 | 1336.13 | 1454.98 | 1351.60 | 1352.13 | 1354.15 | 1328.40 | 1380.84 | 1292.37 | 1308.56 | 1454.99 | 1408.83 | 1335.33 | 1295.22 | OpenAI | o1-preview | 12/5/2024 | 2023/10 | Proprietary | 30448.00 |
| 4.00 | Gemini-Exp-1121 | 1364.17 | 1274.60 | 1324.39 | 1291.91 | 1282.35 | 1340.52 | 1392.94 | 1354.04 | 1306.68 | 1382.78 | 1368.27 | 1366.00 | 1502.63 | 1361.84 | 1342.92 | 1327.07 | 1332.07 | 1444.36 | 1354.23 | 1354.17 | 1483.34 | 1541.67 | 1383.00 | 1365.43 | gemini-exp-1121 | 12/5/2024 | - | Proprietary | 15004.00 | |
| 5.00 | ChatGPT-4o-latest (2024-08-08) | 1316.40 | 1295.21 | 1320.85 | 1291.90 | 1280.21 | 1324.43 | 1328.31 | 1320.59 | 1273.09 | 1346.52 | 1320.78 | 1318.34 | 1433.05 | 1343.99 | 1315.77 | 1305.97 | 1295.98 | 1373.04 | 1286.98 | 1317.64 | 1418.79 | 1400.79 | 1337.56 | 1309.85 | OpenAI | chatgpt-4o-latest-20240808 | 12/5/2024 | 2023/10 | Proprietary | 35573.00 |
| 9.00 | Claude 3.5 Sonnet (20241022) | 1283.04 | 1308.18 | 1315.27 | 1284.16 | 1299.66 | 1321.56 | 1288.89 | 1301.98 | 1280.30 | 1328.04 | 1289.00 | 1284.52 | 1376.33 | 1314.26 | 1303.61 | 1292.20 | 1256.72 | 1332.30 | 1247.11 | 1300.69 | 1392.85 | 1329.20 | 1323.75 | 1274.32 | Anthropic | claude-3-5-sonnet-20241022 | 12/5/2024 | 2024/4 | Proprietary | 34846.00 |
| 14.00 | Gemini-1.5-Pro-Exp-0801 | 1297.97 | 1253.00 | 1310.93 | 1270.13 | 1255.43 | 1277.07 | 1328.12 | 1290.05 | 1261.83 | 1305.48 | 1301.90 | 1299.21 | 1401.72 | 1299.32 | 1278.33 | 1261.53 | 1267.72 | 1369.57 | 1295.57 | 1290.74 | 1424.74 | 1398.92 | 1334.89 | 1297.37 | gemini-1.5-pro-exp-0801 | 12/5/2024 | 2023/11 | Proprietary | 26025.00 | |
| 14.00 | Gemini-Exp-1114 | 1346.71 | 1266.46 | 1307.29 | 1271.94 | 1276.54 | 1325.77 | 1375.10 | 1341.71 | 1309.00 | 1367.67 | 1351.53 | 1348.80 | 1476.97 | 1350.63 | 1336.11 | 1321.35 | 1311.08 | 1451.06 | 1350.01 | 1372.37 | 1479.78 | 1499.93 | 1370.50 | 1286.20 | gemini-exp-1114 | 12/5/2024 | - | Proprietary | 16872.00 | |
| 15.00 | Gemini-1.5-Pro-002 | 1301.74 | 1254.25 | 1306.11 | 1267.82 | 1267.02 | 1290.61 | 1329.41 | 1302.47 | 1281.73 | 1299.56 | 1306.49 | 1303.09 | 1407.95 | 1316.79 | 1299.90 | 1283.18 | 1271.97 | 1390.62 | 1248.40 | 1283.35 | 1426.63 | 1418.59 | 1332.32 | 1298.17 | gemini-1.5-pro-002 | 12/5/2024 | - | Proprietary | 32758.00 | |
| 15.00 | Gemini-1.5-Pro-Exp-0827 | 1299.27 | 1266.74 | 1299.60 | 1269.47 | 1262.25 | 1287.19 | 1320.26 | 1293.94 | 1273.29 | 1306.61 | 1303.92 | 1300.52 | 1407.98 | 1321.99 | 1288.24 | 1274.43 | 1268.33 | 1384.95 | 1277.71 | 1302.67 | 1423.82 | 1400.65 | 1342.83 | 1307.33 | gemini-1.5-pro-exp-0827 | 12/5/2024 | 2023/11 | Proprietary | 32302.00 | |
| 20.00 | GPT-4o-2024-05-13 | 1284.91 | 1264.51 | 1285.15 | 1262.68 | 1252.05 | 1292.80 | 1289.16 | 1287.59 | 1254.74 | 1302.32 | 1289.41 | 1286.63 | 1378.96 | 1300.54 | 1284.63 | 1275.44 | 1262.82 | 1334.96 | 1256.33 | 1277.98 | 1397.20 | 1369.82 | 1305.97 | 1283.31 | OpenAI | gpt-4o-2024-05-13 | 12/5/2024 | 2023/10 | Proprietary | 116858.00 |
| 24.00 | Claude 3.5 Sonnet (20240620) | 1268.08 | 1280.93 | 1255.65 | 1258.87 | 1270.06 | 1294.63 | 1242.09 | 1280.46 | 1271.61 | 1305.70 | 1276.16 | 1269.51 | 1352.00 | 1286.77 | 1279.39 | 1268.64 | 1241.23 | 1321.27 | 1244.83 | 1263.71 | 1369.93 | 1337.58 | 1303.29 | 1280.44 | Anthropic | claude-3-5-sonnet-20240620 | 12/5/2024 | 2024/4 | Proprietary | 86439.00 |
| 24.00 | o1-mini | 1307.20 | 1301.39 | 1231.84 | 1258.04 | 1283.26 | 1362.48 | 1246.51 | 1314.95 | 1327.37 | 1325.72 | 1315.97 | 1308.45 | 1415.85 | 1331.75 | 1339.92 | 1340.63 | 1297.29 | 1372.47 | 1260.03 | 1285.22 | 1383.33 | 1365.32 | 1308.90 | 1298.32 | OpenAI | o1-mini | 12/5/2024 | 2023/10 | Proprietary | 37176.00 |
| 25.00 | Gemini Advanced App (2024-05-14) | 1266.57 | 1238.63 | 1282.36 | 1253.66 | 1237.59 | 1254.77 | 1275.37 | 1259.30 | 1238.57 | 1273.29 | 1270.19 | 1267.57 | 1348.95 | 1263.39 | 1253.51 | 1235.11 | 1234.42 | 1332.29 | 1258.50 | 1268.59 | 1381.98 | 1371.00 | 1304.86 | 1237.53 | gemini-advanced-0514 | 12/5/2024 | Online | Proprietary | 52216.00 | |
| 25.00 | Meta-Llama-3.1-405B-Instruct-bf16 | 1265.96 | 1263.61 | 1248.01 | 1251.71 | 1254.41 | 1284.01 | 1256.03 | 1265.87 | 1255.47 | 1289.20 | 1269.80 | 1266.70 | 1350.82 | 1275.62 | 1272.63 | 1275.66 | 1260.54 | 1288.54 | 1221.30 | 1247.84 | 1346.94 | 1309.32 | 1274.54 | 1248.20 | Meta | llama-3.1-405b-instruct-bf16 | 12/5/2024 | 2023/12 | Llama 3.1 Community | 14541.00 |
| 27.00 | Meta-Llama-3.1-405B-Instruct-fp8 | 1267.25 | 1255.78 | 1257.01 | 1252.40 | 1248.43 | 1276.47 | 1264.93 | 1268.78 | 1248.88 | 1293.78 | 1271.12 | 1268.41 | 1352.50 | 1270.66 | 1266.96 | 1267.53 | 1260.73 | 1292.47 | 1217.43 | 1248.31 | 1318.21 | 1322.64 | 1286.14 | 1251.74 | Meta | llama-3.1-405b-instruct-fp8 | 12/5/2024 | 2023/12 | Llama 3.1 Community | 57468.00 |
| 32.00 | GPT-4o-2024-08-06 | 1264.87 | 1250.56 | 1274.24 | 1249.26 | 1238.79 | 1273.79 | 1273.77 | 1272.59 | 1253.17 | 1278.10 | 1270.00 | 1266.12 | 1347.69 | 1285.94 | 1267.22 | 1258.81 | 1244.57 | 1311.36 | 1222.45 | 1253.05 | 1373.29 | 1356.49 | 1289.94 | 1271.90 | OpenAI | gpt-4o-2024-08-06 | 12/5/2024 | 2023/10 | Proprietary | 47053.00 |
| 32.00 | Grok-2-08-13 | 1288.94 | 1255.68 | 1264.32 | 1249.27 | 1240.45 | 1285.05 | 1284.06 | 1277.25 | 1253.14 | 1295.89 | 1293.52 | 1290.48 | 1387.29 | 1287.93 | 1275.88 | 1265.88 | 1270.86 | 1348.07 | 1273.93 | 1284.10 | 1390.82 | 1369.74 | 1307.98 | 1274.95 | xAI | grok-2-2024-08-13 | 12/5/2024 | 2024/3 | Proprietary | 55616.00 |
| 33.00 | Yi-Lightning | 1287.08 | 1261.09 | 1247.31 | 1245.57 | 1251.54 | 1302.67 | 1281.04 | 1285.99 | 1269.46 | 1315.45 | 1291.07 | 1288.50 | 1385.65 | 1304.97 | 1299.85 | 1297.57 | 1278.33 | 1374.55 | 1251.93 | 1261.06 | 1371.56 | 1334.59 | 1277.80 | 1309.36 | 01 AI | yi-lightning | 12/5/2024 | - | Proprietary | 29193.00 |
| 38.00 | GPT-4-Turbo-2024-04-09 | 1256.42 | 1239.68 | 1270.03 | 1241.80 | 1227.59 | 1262.76 | 1266.41 | 1260.07 | 1241.98 | 1267.69 | 1260.66 | 1258.08 | 1332.09 | 1263.96 | 1254.28 | 1247.99 | 1241.20 | 1300.97 | 1228.16 | 1255.07 | 1338.75 | 1320.09 | 1274.07 | 1253.40 | OpenAI | gpt-4-turbo-2024-04-09 | 12/5/2024 | 2023/12 | Proprietary | 102256.00 |
| 40.00 | Gemini-1.5-Flash-Exp-0827 | 1269.09 | 1240.31 | 1249.95 | 1238.94 | 1237.24 | 1258.56 | 1274.44 | 1265.67 | 1243.25 | 1285.58 | 1273.42 | 1270.40 | 1358.12 | 1310.60 | 1263.93 | 1250.59 | 1236.99 | 1353.31 | 1260.54 | 1266.42 | 1381.78 | 1367.10 | 1311.19 | 1274.65 | gemini-1.5-flash-exp-0827 | 12/5/2024 | 2023/11 | Proprietary | 25431.00 | |
| 40.00 | Gemini-1.5-Pro-001 | 1259.75 | 1243.66 | 1272.98 | 1240.24 | 1238.45 | 1262.28 | 1275.06 | 1261.96 | 1237.37 | 1267.24 | 1266.43 | 1260.70 | 1339.15 | 1293.45 | 1258.25 | 1243.40 | 1231.25 | 1330.04 | 1228.61 | 1244.56 | 1381.00 | 1360.01 | 1297.37 | 1237.40 | gemini-1.5-pro-001 | 12/5/2024 | 2023/11 | Proprietary | 82557.00 | |
| 40.00 | Yi-Lightning-lite | 1264.18 | 1237.64 | 1248.79 | 1237.69 | 1235.82 | 1266.99 | 1259.91 | 1268.32 | 1246.72 | 1292.58 | 1269.98 | 1265.80 | 1347.21 | 1288.28 | 1272.05 | 1261.61 | 1247.07 | 1320.59 | 1264.58 | 1266.08 | 1365.49 | 1313.63 | 1270.37 | 1273.59 | 01 AI | yi-lightning-lite | 12/5/2024 | - | Proprietary | 17204.00 |
| 41.00 | Claude 3 Opus | 1247.53 | 1235.16 | 1239.72 | 1238.51 | 1234.98 | 1250.14 | 1240.27 | 1257.04 | 1239.59 | 1277.72 | 1259.57 | 1249.22 | 1316.98 | 1270.37 | 1245.62 | 1228.05 | 1214.07 | 1311.15 | 1228.67 | 1252.23 | 1350.51 | 1323.86 | 1305.72 | 1243.26 | Anthropic | claude-3-opus-20240229 | 12/5/2024 | 2023/8 | Proprietary | 192206.00 |
| 43.00 | GLM-4-Plus | 1273.99 | 1245.84 | 1238.88 | 1234.17 | 1232.48 | 1283.48 | 1264.07 | 1273.64 | 1245.01 | 1288.20 | 1279.12 | 1275.22 | 1363.98 | 1291.91 | 1274.47 | 1261.91 | 1247.85 | 1349.74 | 1258.71 | 1276.23 | 1353.09 | 1376.42 | 1296.02 | 1298.70 | Zhipu AI | glm-4-plus | 12/5/2024 | - | Proprietary | 28006.00 |
| 44.00 | Athene-v2-Chat-72B | 1277.80 | 1259.02 | 1203.73 | 1232.91 | 1252.30 | 1299.91 | 1236.80 | 1285.03 | 1280.71 | 1292.61 | 1281.51 | 1278.30 | 1370.48 | 1294.36 | 1298.85 | 1289.72 | 1258.00 | 1358.57 | 1266.91 | 1271.75 | 1340.04 | 1346.06 | 1307.46 | 1267.15 | NexusFlow | athene-v2-chat | 12/5/2024 | - | NexusFlow | 8700.00 |
| 45.00 | GPT-4-1106-preview | 1250.01 | 1231.81 | 1241.03 | 1234.40 | 1226.77 | 1252.84 | 1247.97 | 1249.63 | 1242.18 | 1260.03 | 1257.13 | 1251.24 | 1318.33 | 1248.02 | 1246.43 | 1238.64 | 1231.55 | 1299.12 | 1241.48 | 1246.95 | 1336.61 | 1320.11 | 1272.14 | 1259.86 | OpenAI | gpt-4-1106-preview | 12/5/2024 | 2023/4 | Proprietary | 103853.00 |
| 45.00 | GPT-4o-mini-2024-07-18 | 1272.75 | 1245.47 | 1242.57 | 1233.43 | 1223.23 | 1284.42 | 1267.50 | 1265.97 | 1231.46 | 1290.78 | 1277.47 | 1273.71 | 1362.28 | 1294.12 | 1268.53 | 1258.60 | 1253.90 | 1322.30 | 1247.90 | 1266.11 | 1361.25 | 1329.19 | 1292.64 | 1275.34 | OpenAI | gpt-4o-mini-2024-07-18 | 12/5/2024 | 2023/10 | Proprietary | 54539.00 |
| 47.00 | Mistral-Large-2407 | 1251.37 | 1243.87 | 1238.48 | 1230.86 | 1231.77 | 1269.24 | 1245.48 | 1256.32 | 1231.52 | 1262.71 | 1255.74 | 1252.68 | 1326.80 | 1269.37 | 1259.36 | 1253.39 | 1238.49 | 1298.34 | 1229.26 | 1248.70 | 1340.61 | 1317.33 | 1277.17 | 1233.70 | Mistral | mistral-large-2407 | 12/5/2024 | 2024/7 | Mistral Research | 48382.00 |
| 49.00 | Qwen-Max-0919 | 1263.51 | 1244.97 | 1234.34 | 1230.56 | 1233.69 | 1279.98 | 1249.93 | 1271.85 | 1244.49 | 1280.63 | 1268.97 | 1265.14 | 1345.15 | 1296.20 | 1273.39 | 1265.37 | 1244.20 | 1309.97 | 1273.56 | 1250.15 | 1353.87 | 1288.33 | 1292.11 | 1275.65 | Alibaba | qwen-max-0919 | 12/5/2024 | - | Qwen | 17587.00 |
| 50.00 | GPT-4-0125-preview | 1244.91 | 1221.51 | 1237.42 | 1230.69 | 1218.67 | 1243.54 | 1238.16 | 1244.53 | 1236.29 | 1255.01 | 1251.12 | 1246.40 | 1311.51 | 1249.08 | 1241.49 | 1234.46 | 1226.39 | 1295.86 | 1233.39 | 1237.62 | 1342.33 | 1311.27 | 1261.39 | 1244.18 | OpenAI | gpt-4-0125-preview | 12/5/2024 | 2023/12 | Proprietary | 97178.00 |
| 52.00 | Gemini-1.5-Flash-002 | 1271.39 | 1209.25 | 1248.16 | 1228.62 | 1216.44 | 1253.18 | 1285.60 | 1265.42 | 1237.08 | 1257.80 | 1276.87 | 1272.84 | 1359.63 | 1291.43 | 1256.61 | 1244.02 | 1239.68 | 1351.15 | 1226.22 | 1260.84 | 1400.01 | 1351.64 | 1307.38 | 1246.78 | gemini-1.5-flash-002 | 12/5/2024 | - | Proprietary | 26276.00 | |
| 53.00 | Mistral-Large-2411 | 1248.94 | 1235.76 | 1238.26 | 1222.62 | 1211.42 | 1264.74 | 1255.53 | 1260.66 | 1217.78 | 1263.39 | 1253.42 | 1251.06 | 1323.90 | 1285.27 | 1244.42 | 1240.62 | 1233.57 | 1293.39 | 1350.28 | 1176.81 | 1358.82 | 1266.35 | 1279.34 | 1281.34 | Mistral | mistral-large-2411 | 12/5/2024 | - | MRL | 2773.00 |
| 59.00 | Deepseek-v2.5 | 1257.80 | 1255.39 | 1214.04 | 1224.54 | 1234.46 | 1288.14 | 1238.10 | 1259.97 | 1242.77 | 1264.96 | 1262.21 | 1258.77 | 1336.91 | 1280.64 | 1272.99 | 1262.67 | 1238.35 | 1337.60 | 1237.52 | 1228.42 | 1341.38 | 1326.22 | 1275.11 | 1255.92 | DeepSeek | deepseek-v2.5 | 12/5/2024 | - | DeepSeek | 26517.00 |
| 60.00 | Athene-70B | 1250.20 | 1234.03 | 1220.16 | 1222.37 | 1224.97 | 1253.60 | 1238.99 | 1234.29 | 1200.69 | 1255.43 | 1253.91 | 1250.46 | 1327.09 | 1241.70 | 1247.31 | 1241.53 | 1238.03 | 1294.27 | 1237.97 | 1244.74 | 1286.85 | 1298.46 | 1272.36 | 1247.10 | NexusFlow | athene-70b-0725 | 12/5/2024 | 2024/7 | CC-BY-NC-4.0 | 20660.00 |
| 60.00 | Grok-2-Mini-08-13 | 1266.02 | 1229.73 | 1227.15 | 1223.24 | 1220.27 | 1261.84 | 1249.13 | 1255.73 | 1236.43 | 1267.86 | 1270.36 | 1267.17 | 1350.74 | 1274.58 | 1259.67 | 1252.81 | 1251.56 | 1318.59 | 1238.91 | 1267.06 | 1355.17 | 1326.31 | 1279.82 | 1258.87 | xAI | grok-2-mini-2024-08-13 | 12/5/2024 | 2024/3 | Proprietary | 47339.00 |
| 60.00 | Qwen2.5-72B-Instruct | 1258.74 | 1246.11 | 1213.52 | 1222.57 | 1228.97 | 1282.11 | 1232.00 | 1265.80 | 1253.22 | 1277.55 | 1263.51 | 1260.15 | 1338.21 | 1292.43 | 1270.69 | 1260.91 | 1238.10 | 1325.97 | 1241.12 | 1234.52 | 1325.44 | 1335.49 | 1282.54 | 1254.82 | Alibaba | qwen2.5-72b-instruct | 12/5/2024 | 2024/9 | Qwen | 31639.00 |
| 65.00 | Llama-3.1-Nemotron-70B-Instruct | 1268.51 | 1229.77 | 1227.55 | 1215.14 | 1223.22 | 1271.14 | 1269.06 | 1262.25 | 1242.79 | 1278.87 | 1272.69 | 1269.98 | 1355.82 | 1250.71 | 1266.06 | 1265.01 | 1263.52 | 1319.60 | 1271.54 | 1302.92 | 1352.26 | 1243.21 | 1250.30 | 1278.17 | Nvidia | llama-3.1-nemotron-70b-instruct | 12/5/2024 | 2023/12 | Llama 3.1 | 7676.00 |
| 66.00 | Gemini-1.5-Pro-Preview-0409 | 1257.29 | 1205.16 | 1256.28 | 1217.82 | 1200.24 | 1231.23 | 1274.34 | 1248.44 | 1212.96 | 1254.78 | 1260.86 | 1259.33 | 1330.02 | 1247.48 | 1232.47 | 1219.99 | 1233.37 | 1315.09 | 1257.05 | 1253.57 | 1347.12 | 1416.01 | 1302.19 | 1265.00 | gemini-1.5-pro-api-0409-preview | 12/5/2024 | 2023/11 | Proprietary | 55601.00 | |
| 71.00 | Meta-Llama-3.1-70B-Instruct | 1247.26 | 1220.57 | 1214.99 | 1213.16 | 1211.07 | 1251.40 | 1238.36 | 1241.01 | 1220.79 | 1259.56 | 1250.86 | 1248.21 | 1321.02 | 1249.25 | 1243.08 | 1243.03 | 1245.88 | 1274.40 | 1205.48 | 1222.10 | 1285.13 | 1284.01 | 1255.03 | 1246.55 | Meta | llama-3.1-70b-instruct | 12/5/2024 | 2023/12 | Llama 3.1 Community | 53577.00 |
| 73.00 | Llama-3.1-Nemotron-51B-Instruct | 1211.43 | 1192.74 | 1214.01 | 1203.82 | 1192.84 | 1210.82 | 1215.08 | 1209.82 | 1200.64 | 1230.11 | 1215.91 | 1212.50 | 1263.47 | 1216.65 | 1207.21 | 1188.73 | 1216.83 | 1238.86 | 1227.51 | 1171.12 | 1207.94 | 1242.63 | 1210.85 | 1222.08 | Nvidia | llama-3.1-nemotron-51b-instruct | 12/5/2024 | 2023/12 | Llama 3.1 | 3925.00 |
| 73.00 | Reka-Core-20240904 | 1234.95 | 1200.77 | 1221.46 | 1206.65 | 1192.79 | 1222.07 | 1239.22 | 1223.10 | 1194.24 | 1230.48 | 1239.37 | 1235.19 | 1299.28 | 1234.14 | 1215.65 | 1199.69 | 1208.60 | 1300.58 | 1144.06 | 1238.64 | 1336.39 | 1349.70 | 1270.62 | 1210.38 | Reka AI | reka-core-20240904 | 12/5/2024 | - | Proprietary | 7975.00 |
| 75.00 | Qwen-Plus-0828 | 1227.42 | 1217.22 | 1213.22 | 1205.89 | 1208.73 | 1245.57 | 1219.19 | 1234.82 | 1216.64 | 1248.91 | 1232.04 | 1228.95 | 1284.53 | 1265.82 | 1241.53 | 1234.92 | 1217.59 | 1313.78 | 1167.00 | 1182.24 | 1295.08 | 1267.88 | 1269.42 | 1242.61 | Alibaba | qwen-plus-0828 | 12/5/2024 | - | Proprietary | 14684.00 |
| 77.00 | Deepseek-v2-API-0628 | 1219.38 | 1222.85 | 1199.61 | 1201.67 | 1211.67 | 1241.93 | 1207.85 | 1221.48 | 1217.09 | 1229.28 | 1223.19 | 1220.86 | 1274.93 | 1243.50 | 1234.18 | 1224.31 | 1198.54 | 1282.63 | 1200.57 | 1199.88 | 1303.52 | 1272.54 | 1259.42 | 1216.58 | DeepSeek AI | deepseek-v2-api-0628 | 12/5/2024 | - | DeepSeek | 19569.00 |
| 77.00 | Gemini-1.5-Flash-001 | 1226.89 | 1208.13 | 1217.19 | 1203.65 | 1200.96 | 1231.79 | 1228.11 | 1222.40 | 1199.32 | 1232.28 | 1232.29 | 1227.43 | 1288.01 | 1262.92 | 1224.73 | 1210.65 | 1200.38 | 1291.12 | 1197.06 | 1211.71 | 1331.29 | 1333.87 | 1259.54 | 1222.10 | gemini-1.5-flash-001 | 12/5/2024 | 2023/11 | Proprietary | 65753.00 | |
| 77.00 | Gemma-2-27B-it | 1219.60 | 1202.93 | 1239.93 | 1206.42 | 1193.29 | 1209.92 | 1241.17 | 1214.53 | 1185.64 | 1226.45 | 1224.58 | 1220.41 | 1275.14 | 1237.46 | 1204.58 | 1192.61 | 1194.53 | 1278.08 | 1185.45 | 1205.88 | 1325.00 | 1310.68 | 1255.18 | 1224.63 | gemma-2-27b-it | 12/5/2024 | 2024/6 | Gemma license | 63043.00 | |
| 77.00 | Gemma-2-9B-it-SimPO | 1215.62 | 1179.73 | 1237.51 | 1198.88 | 1186.81 | 1196.69 | 1243.44 | 1203.29 | 1145.13 | 1225.59 | 1218.77 | 1216.72 | 1269.11 | 1238.02 | 1203.70 | 1187.52 | 1195.85 | 1283.85 | 1182.44 | 1214.97 | 1291.68 | 1264.52 | 1248.55 | 1202.85 | Princeton | gemma-2-9b-it-simpo | 12/5/2024 | 2024/7 | MIT | 10566.00 |
| 77.00 | Jamba-1.5-Large | 1221.04 | 1207.92 | 1215.21 | 1204.12 | 1193.43 | 1227.55 | 1217.50 | 1220.45 | 1191.17 | 1223.61 | 1224.80 | 1221.52 | 1277.84 | 1214.37 | 1219.22 | 1214.85 | 1217.52 | 1261.15 | 1199.38 | 1195.90 | 1268.14 | 1281.99 | 1215.65 | 1245.55 | AI21 Labs | jamba-1.5-large | 12/5/2024 | 2024/3 | Jamba Open | 9146.00 |
| 77.00 | Reka-Core-20240722 | 1230.27 | 1191.27 | 1222.17 | 1203.89 | 1186.59 | 1208.31 | 1241.08 | 1212.25 | 1186.65 | 1237.58 | 1233.90 | 1230.63 | 1292.93 | 1232.75 | 1205.21 | 1191.02 | 1204.58 | 1301.11 | 1231.66 | 1209.41 | 1309.77 | 1331.88 | 1267.37 | 1221.09 | Reka AI | reka-core-20240722 | 12/5/2024 | - | Proprietary | 13308.00 |
| 77.00 | Yi-Large-preview | 1239.67 | 1209.42 | 1205.99 | 1206.31 | 1206.00 | 1245.04 | 1240.42 | 1236.26 | 1218.59 | 1235.22 | 1243.89 | 1241.49 | 1309.39 | 1246.65 | 1239.73 | 1228.93 | 1216.48 | 1316.17 | 1203.23 | 1225.26 | 1357.51 | 1285.51 | 1271.91 | 1242.54 | 01 AI | yi-large-preview | 12/5/2024 | Unknown | Proprietary | 51713.00 |
| 80.00 | Command R+ (08-2024) | 1215.13 | 1166.46 | 1214.69 | 1196.93 | 1171.78 | 1181.51 | 1235.30 | 1205.90 | 1162.47 | 1216.79 | 1222.37 | 1216.45 | 1266.00 | 1242.19 | 1188.88 | 1178.25 | 1189.26 | 1284.30 | 1160.58 | 1212.71 | 1312.36 | 1312.35 | 1249.89 | 1228.01 | Cohere | command-r-plus-08-2024 | 12/5/2024 | 2024/8 | CC-BY-NC-4.0 | 10572.00 |
| 80.00 | Deepseek-Coder-v2-0724 | 1213.95 | 1244.00 | 1186.60 | 1196.88 | 1210.65 | 1266.46 | 1190.03 | 1221.09 | 1210.84 | 1218.57 | 1221.09 | 1215.59 | 1266.14 | 1254.25 | 1234.97 | 1233.62 | 1194.70 | 1286.49 | 1184.83 | 1200.84 | 1294.38 | 1255.59 | 1241.98 | 1201.80 | DeepSeek | deepseek-coder-v2-0724 | 12/5/2024 | - | Proprietary | 11747.00 |
| 80.00 | GPT-4-0314 | 1186.20 | 1202.28 | 1202.95 | 1199.70 | 1202.85 | 1195.52 | 1189.43 | 1204.46 | 1193.98 | 1201.13 | 1189.22 | 1187.30 | 1223.03 | 1200.48 | 1195.88 | 1183.63 | 1164.30 | 1236.71 | 1178.23 | 1197.93 | 1275.94 | 1235.54 | 1219.59 | 1196.53 | OpenAI | gpt-4-0314 | 12/5/2024 | 2021/9 | Proprietary | 55979.00 |
| 81.00 | Nemotron-4-340B-Instruct | 1209.05 | 1187.22 | 1192.86 | 1196.07 | 1189.01 | 1197.89 | 1207.57 | 1212.03 | 1185.78 | 1217.00 | 1213.21 | 1210.20 | 1261.33 | 1231.94 | 1202.23 | 1184.68 | 1186.55 | 1270.32 | 1148.94 | 1187.29 | 1279.13 | 1284.25 | 1243.93 | 1194.38 | Nvidia | nemotron-4-340b-instruct | 12/5/2024 | 2023/6 | NVIDIA Open Model | 20643.00 |
| 83.00 | Claude 3 Sonnet | 1200.94 | 1201.29 | 1197.35 | 1197.15 | 1190.46 | 1212.89 | 1187.56 | 1204.61 | 1181.57 | 1226.64 | 1209.19 | 1201.99 | 1246.24 | 1222.21 | 1199.01 | 1186.61 | 1175.25 | 1245.21 | 1180.86 | 1198.63 | 1287.21 | 1264.62 | 1247.47 | 1205.25 | Anthropic | claude-3-sonnet-20240229 | 12/5/2024 | 2023/8 | Proprietary | 113091.00 |
| 83.00 | Yi-Large | 1212.41 | 1194.93 | 1190.20 | 1194.31 | 1185.59 | 1219.57 | 1202.37 | 1207.88 | 1195.11 | 1219.81 | 1219.00 | 1213.13 | 1266.53 | 1218.41 | 1208.63 | 1197.63 | 1194.64 | 1267.77 | 1168.48 | 1196.84 | 1311.62 | 1265.32 | 1243.95 | 1208.39 | 01 AI | yi-large | 12/5/2024 | Unknown | Proprietary | 16671.00 |
| 88.00 | Llama-3-70B-Instruct | 1206.46 | 1190.91 | 1208.00 | 1194.76 | 1187.46 | 1199.60 | 1213.74 | 1199.16 | 1188.61 | 1224.90 | 1208.89 | 1206.76 | 1257.88 | 1185.52 | 1197.04 | 1211.69 | 1226.24 | 1175.86 | 1184.46 | 1166.27 | 1177.54 | 1170.14 | 1187.07 | 1241.00 | Meta | llama-3-70b-instruct | 12/5/2024 | 2023/12 | Llama 3 Community | 163890.00 |
| 88.00 | Reka-Flash-20240904 | 1205.13 | 1182.03 | 1197.57 | 1192.06 | 1176.41 | 1191.55 | 1207.03 | 1194.18 | 1168.80 | 1192.42 | 1208.95 | 1205.64 | 1245.48 | 1205.82 | 1185.45 | 1172.05 | 1176.75 | 1279.94 | 1184.63 | 1178.86 | 1297.62 | 1279.20 | 1236.71 | 1241.42 | Reka AI | reka-flash-20240904 | 12/5/2024 | - | Proprietary | 8159.00 |
| 89.00 | Qwen2.5-Coder-32B-Instruct | 1217.61 | 1226.69 | 1160.21 | 1189.50 | 1219.30 | 1260.93 | 1179.62 | 1233.76 | 1222.47 | 1226.67 | 1222.02 | 1218.12 | 1269.73 | 1262.20 | 1257.31 | 1254.99 | 1202.15 | 1277.15 | 1185.03 | 1191.70 | 1270.52 | 1251.49 | 1251.13 | 1219.65 | Alibaba | qwen2.5-coder-32b-instruct | 12/5/2024 | - | Apache 2.0 | 5755.00 |
| 91.00 | GLM-4-0520 | 1206.46 | 1192.13 | 1193.26 | 1187.97 | 1189.63 | 1215.93 | 1198.31 | 1209.12 | 1188.51 | 1221.54 | 1209.69 | 1207.47 | 1257.17 | 1217.23 | 1213.52 | 1201.51 | 1190.22 | 1289.15 | 1160.71 | 1177.57 | 1272.16 | 1189.71 | 1235.50 | 1219.51 | Zhipu AI | glm-4-0520 | 12/5/2024 | Unknown | Proprietary | 10227.00 |
| 97.00 | Gemini App (2024-01-24) | 1208.35 | 1161.90 | 1168.78 | 1180.20 | 1141.93 | 1171.13 | 1192.94 | 1158.22 | 1134.84 | 1197.92 | 1212.38 | 1207.88 | 1248.70 | 1133.17 | 1156.31 | 1141.61 | 1181.63 | 1274.86 | 1263.63 | 1243.17 | 1333.08 | 1407.99 | 1259.99 | 1225.46 | bard-jan-24-gemini-pro | 12/5/2024 | Online | Proprietary | 11828.00 | |
| 97.00 | Aya-Expanse-32B | 1207.48 | 1178.10 | 1175.12 | 1182.96 | 1183.14 | 1188.57 | 1199.24 | 1206.92 | 1174.69 | 1195.02 | 1212.86 | 1209.02 | 1253.11 | 1240.22 | 1199.31 | 1178.64 | 1178.10 | 1266.94 | 1193.11 | 1189.72 | 1305.05 | 1287.09 | 1246.22 | 1190.33 | Cohere | c4ai-aya-expanse-32b | 12/5/2024 | - | CC-BY-NC-4.0 | 18402.00 |
| 97.00 | DeepSeek-Coder-V2-Instruct | 1178.28 | 1225.91 | 1158.89 | 1181.72 | 1197.29 | 1238.97 | 1128.37 | 1189.33 | 1211.01 | 1180.36 | 1204.81 | 1179.51 | 1211.97 | 1224.70 | 1211.03 | 1202.65 | 1150.11 | 1259.18 | 1138.47 | 1159.36 | 1283.67 | 1247.79 | 1210.45 | 1152.20 | DeepSeek AI | deepseek-coder-v2 | 12/5/2024 | 2024/6 | DeepSeek License | 15786.00 |
| 97.00 | GPT-4-0613 | 1163.11 | 1179.71 | 1211.34 | 1185.56 | 1181.84 | 1166.92 | 1187.37 | 1188.39 | 1178.03 | 1174.38 | 1168.60 | 1164.16 | 1187.54 | 1193.36 | 1168.01 | 1164.06 | 1147.91 | 1182.28 | 1122.81 | 1156.15 | 1268.37 | 1206.47 | 1195.40 | 1167.36 | OpenAI | gpt-4-0613 | 12/5/2024 | 2021/9 | Proprietary | 91673.00 |
| 98.00 | Command R+ (04-2024) | 1189.88 | 1154.03 | 1186.33 | 1182.82 | 1159.95 | 1164.25 | 1199.46 | 1187.07 | 1136.73 | 1196.91 | 1194.34 | 1191.20 | 1231.78 | 1214.84 | 1168.79 | 1154.08 | 1163.06 | 1253.76 | 1160.55 | 1188.73 | 1305.26 | 1272.03 | 1224.93 | 1181.20 | Cohere | command-r-plus | 12/5/2024 | 2024/3 | CC-BY-NC-4.0 | 80924.00 |
| 98.00 | Qwen2-72B-Instruct | 1187.08 | 1178.33 | 1176.88 | 1180.64 | 1178.20 | 1186.72 | 1183.45 | 1189.97 | 1202.13 | 1196.96 | 1192.30 | 1187.91 | 1225.29 | 1200.36 | 1189.07 | 1184.42 | 1171.09 | 1293.10 | 1127.56 | 1146.07 | 1265.46 | 1225.77 | 1195.15 | 1170.85 | Alibaba | qwen2-72b-instruct | 12/5/2024 | 2024/6 | Qianwen LICENSE | 38960.00 |
| 98.00 | Reka-Flash-20240722 | 1200.83 | 1173.24 | 1178.67 | 1180.13 | 1165.07 | 1187.08 | 1197.67 | 1187.78 | 1161.00 | 1198.09 | 1204.81 | 1200.79 | 1244.89 | 1194.15 | 1178.39 | 1167.88 | 1173.98 | 1270.41 | 1195.35 | 1202.08 | 1289.58 | 1286.87 | 1248.73 | 1213.32 | Reka AI | reka-flash-20240722 | 12/5/2024 | - | Proprietary | 13749.00 |
| 100.00 | Gemini-1.5-Flash-8B-001 | 1212.29 | 1165.41 | 1191.43 | 1178.60 | 1173.92 | 1205.81 | 1221.39 | 1210.18 | 1182.51 | 1190.50 | 1217.76 | 1213.32 | 1261.42 | 1228.78 | 1210.62 | 1194.24 | 1182.27 | 1287.69 | 1192.13 | 1197.20 | 1287.78 | 1294.94 | 1257.30 | 1217.87 | gemini-1.5-flash-8b-001 | 12/5/2024 | - | Proprietary | 27858.00 | |
| 102.00 | Command R (08-2024) | 1179.52 | 1160.81 | 1168.57 | 1175.62 | 1165.45 | 1161.90 | 1179.21 | 1179.74 | 1129.38 | 1168.39 | 1184.72 | 1180.61 | 1204.08 | 1211.33 | 1169.66 | 1159.47 | 1154.66 | 1242.38 | 1140.20 | 1170.66 | 1295.40 | 1291.48 | 1201.36 | 1169.21 | Cohere | command-r-08-2024 | 12/5/2024 | 2024/8 | CC-BY-NC-4.0 | 10877.00 |
| 102.00 | Gemma-2-9B-it | 1190.06 | 1165.14 | 1208.50 | 1177.70 | 1161.25 | 1169.56 | 1208.59 | 1183.92 | 1152.86 | 1193.86 | 1194.47 | 1190.43 | 1226.80 | 1206.94 | 1170.69 | 1157.23 | 1167.73 | 1243.91 | 1149.67 | 1179.37 | 1287.46 | 1279.27 | 1220.23 | 1198.41 | gemma-2-9b-it | 12/5/2024 | 2024/6 | Gemma license | 43844.00 | |
| 103.00 | Claude 3 Haiku | 1179.33 | 1183.39 | 1170.09 | 1177.31 | 1174.18 | 1189.41 | 1163.06 | 1181.88 | 1159.49 | 1191.88 | 1188.36 | 1179.60 | 1213.97 | 1199.49 | 1178.06 | 1167.78 | 1157.51 | 1211.45 | 1150.12 | 1169.58 | 1255.62 | 1250.42 | 1224.73 | 1169.56 | Anthropic | claude-3-haiku-20240307 | 12/5/2024 | 2023/8 | Proprietary | 122407.00 |
| 103.00 | Reka-Core-20240501 | 1199.58 | 1172.72 | 1181.70 | 1177.33 | 1168.18 | 1190.01 | 1196.05 | 1186.04 | 1159.24 | 1188.85 | 1203.86 | 1200.97 | 1246.29 | 1192.44 | 1186.74 | 1173.39 | 1175.91 | 1260.61 | 1178.02 | 1197.53 | 1283.21 | 1272.94 | 1230.00 | 1189.75 | Reka AI | reka-core-20240501 | 12/5/2024 | - | Proprietary | 62627.00 |
| 112.00 | Gemini-1.5-Flash-8B-Exp-0827 | 1205.11 | 1160.93 | 1184.98 | 1172.31 | 1162.52 | 1189.33 | 1214.01 | 1199.09 | 1172.33 | 1201.49 | 1209.38 | 1205.77 | 1251.38 | 1231.90 | 1195.96 | 1181.60 | 1176.25 | 1274.17 | 1193.15 | 1181.05 | 1303.61 | 1301.03 | 1251.82 | 1219.91 | gemini-1.5-flash-8b-exp-0827 | 12/5/2024 | 2023/11 | Proprietary | 25422.00 | |
| 112.00 | Qwen-Max-0428 | 1183.02 | 1175.01 | 1164.52 | 1171.50 | 1168.32 | 1189.50 | 1177.54 | 1179.97 | 1167.31 | 1175.11 | 1186.66 | 1183.69 | 1219.73 | 1197.83 | 1186.36 | 1178.01 | 1167.92 | 1292.84 | 1161.38 | 1130.15 | 1265.53 | 1219.69 | 1179.61 | 1153.64 | Alibaba | qwen-max-0428 | 12/5/2024 | - | Proprietary | 25701.00 |
| 115.00 | GLM-4-0116 | 1183.15 | 1167.64 | 1170.15 | 1162.80 | 1165.00 | 1190.75 | 1180.60 | 1180.67 | 1161.59 | 1181.28 | 1186.32 | 1185.85 | 1221.10 | 1193.35 | 1186.74 | 1176.60 | 1177.02 | 1274.19 | 1127.63 | 1153.69 | 1244.92 | 1147.04 | 1182.67 | 1199.68 | Zhipu AI | glm-4-0116 | 12/5/2024 | Unknown | Proprietary | 7583.00 |
| 117.00 | Ministral-8B-2410 | 1182.70 | 1172.23 | 1175.79 | 1159.58 | 1167.91 | 1200.91 | 1181.65 | 1176.53 | 1165.27 | 1171.24 | 1187.05 | 1183.00 | 1206.59 | 1226.51 | 1198.72 | 1193.02 | 1168.70 | 1255.98 | 1133.41 | 1126.39 | 1291.46 | 1216.69 | 1223.58 | 1130.75 | Mistral | ministral-8b-2410 | 12/5/2024 | - | MRL | 5155.00 |
| 119.00 | Claude-1 | 1148.83 | 1149.06 | 1163.94 | 1158.92 | 1134.86 | 1135.61 | 1134.31 | 1141.14 | 1114.45 | 1171.54 | 1166.06 | 1148.32 | 1167.77 | 1162.90 | 1125.57 | 1116.84 | 1129.35 | 1194.70 | 1115.74 | 1172.75 | 1230.45 | 1103.51 | 1192.37 | 1171.58 | Anthropic | claude-1 | 12/5/2024 | - | Proprietary | 21165.00 |
| 119.00 | Jamba-1.5-Mini | 1175.77 | 1164.42 | 1166.99 | 1159.17 | 1146.33 | 1180.64 | 1171.71 | 1157.89 | 1131.48 | 1162.89 | 1179.79 | 1176.29 | 1202.11 | 1170.28 | 1168.74 | 1165.88 | 1177.46 | 1196.77 | 1134.74 | 1158.43 | 1173.80 | 1181.17 | 1179.70 | 1221.55 | AI21 Labs | jamba-1.5-mini | 12/5/2024 | 2024/3 | Jamba Open | 9284.00 |
| 119.00 | Mistral-Large-2402 | 1157.18 | 1170.09 | 1158.79 | 1157.59 | 1164.20 | 1169.58 | 1159.13 | 1172.37 | 1164.81 | 1165.71 | 1159.31 | 1158.45 | 1180.99 | 1176.96 | 1165.32 | 1157.15 | 1146.05 | 1178.23 | 1162.02 | 1173.62 | 1173.97 | 1160.04 | 1195.96 | 1194.24 | Mistral | mistral-large-2402 | 12/5/2024 | - | Proprietary | 64953.00 |
| 120.00 | Hunyuan-Standard-256K | 1188.52 | 1192.66 | 1154.79 | 1151.26 | 1182.51 | 1225.83 | 1177.17 | 1209.23 | 1206.20 | 1180.18 | 1194.47 | 1191.39 | 1223.18 | 1235.40 | 1220.23 | 1213.60 | 1168.85 | 1295.28 | 1173.53 | 1139.26 | 1249.94 | 1235.13 | 1189.83 | 1285.10 | Tencent | hunyuan-standard-256k | 12/5/2024 | - | Proprietary | 2932.00 |
| 120.00 | Qwen1.5-110B-Chat | 1161.59 | 1163.39 | 1147.01 | 1155.51 | 1154.63 | 1174.56 | 1150.22 | 1163.14 | 1150.85 | 1158.85 | 1164.82 | 1161.39 | 1185.02 | 1166.45 | 1168.81 | 1166.70 | 1150.62 | 1259.43 | 1109.50 | 1117.48 | 1227.95 | 1187.81 | 1145.04 | 1143.74 | Alibaba | qwen1.5-110b-chat | 12/5/2024 | 2024/4 | Qianwen LICENSE | 27479.00 |
| 123.00 | Reka-Flash-21B-online | 1155.97 | 1145.00 | 1130.68 | 1151.27 | 1143.88 | 1146.68 | 1131.02 | 1137.91 | 1140.25 | 1149.30 | 1158.12 | 1155.71 | 1179.56 | 1150.89 | 1142.68 | 1133.03 | 1135.93 | 1196.30 | 1111.71 | 1147.99 | 1231.71 | 1244.68 | 1190.74 | 1144.60 | Reka AI | reka-flash-21b-20240226-online | 12/5/2024 | Online | Proprietary | 16029.00 |
| 123.00 | Reka-Flash-Preview-20240611 | 1165.13 | 1145.86 | 1148.85 | 1151.68 | 1136.62 | 1154.95 | 1158.44 | 1146.54 | 1127.15 | 1148.45 | 1168.32 | 1165.38 | 1189.73 | 1147.07 | 1144.45 | 1130.77 | 1141.68 | 1218.60 | 1140.75 | 1161.04 | 1251.57 | 1250.56 | 1196.65 | 1174.96 | Reka AI | reka-flash-preview-20240611 | 12/5/2024 | - | Proprietary | 20447.00 |
| 125.00 | Mistral-Next | 1124.27 | 1154.29 | 1164.26 | 1149.20 | 1148.12 | 1132.26 | 1135.01 | 1157.61 | 1139.69 | 1137.13 | 1126.18 | 1124.68 | 1130.68 | 1150.24 | 1128.86 | 1121.32 | 1109.92 | 1133.97 | 1110.76 | 1154.78 | 1138.47 | 1043.31 | 1172.47 | 1129.80 | Mistral | mistral-next | 12/5/2024 | - | Proprietary | 12378.00 |
| 128.00 | Mixtral-8x22b-Instruct-v0.1 | 1147.45 | 1151.40 | 1146.80 | 1149.18 | 1146.47 | 1152.43 | 1146.74 | 1154.69 | 1152.40 | 1131.02 | 1150.54 | 1148.35 | 1163.57 | 1155.45 | 1148.46 | 1142.93 | 1136.35 | 1177.18 | 1122.24 | 1138.80 | 1195.12 | 1198.08 | 1180.13 | 1143.54 | Mistral | mixtral-8x22b-instruct-v0.1 | 12/5/2024 | 2024/4 | Apache 2.0 | 53847.00 |
| 129.00 | Claude-2.0 | 1131.80 | 1152.34 | 1143.76 | 1145.90 | 1141.07 | 1134.98 | 1101.70 | 1130.19 | 1126.45 | 1161.09 | 1150.46 | 1131.69 | 1140.36 | 1146.30 | 1126.12 | 1119.30 | 1113.92 | 1189.18 | 1102.72 | 1152.19 | 1215.40 | 1151.16 | 1204.12 | 1138.11 | Anthropic | claude-2.0 | 12/5/2024 | - | Proprietary | 12766.00 |
| 129.00 | Command R (04-2024) | 1148.63 | 1124.62 | 1153.14 | 1147.80 | 1122.77 | 1122.89 | 1159.14 | 1132.26 | 1089.11 | 1148.61 | 1150.82 | 1148.45 | 1167.88 | 1166.98 | 1119.45 | 1105.82 | 1123.30 | 1208.49 | 1113.26 | 1123.08 | 1247.24 | 1239.90 | 1184.08 | 1150.12 | Cohere | command-r | 12/5/2024 | 2024/3 | CC-BY-NC-4.0 | 56396.00 |
| 129.00 | Gemini-1.0-Pro-001 | 1131.37 | 1119.39 | 1153.07 | 1147.00 | 1124.71 | 1102.71 | 1133.63 | 1118.85 | 1098.97 | 1119.23 | 1133.41 | 1130.50 | 1144.61 | 1143.41 | 1105.63 | 1095.34 | 1108.36 | 1181.13 | 1102.87 | 1124.50 | 1199.35 | 1221.60 | 1207.41 | 1127.26 | gemini-pro-dev-api | 12/5/2024 | 2023/4 | Proprietary | 18801.00 | |
| 129.00 | GPT-3.5-Turbo-0314 | 1106.34 | 1143.34 | 1135.38 | 1141.33 | 1137.72 | 1115.08 | 1089.35 | 1148.44 | 1139.77 | 1107.34 | 1114.29 | 1106.32 | 1096.18 | 1116.93 | 1116.61 | 1096.89 | 1081.45 | 1203.55 | 1149.28 | 1151.81 | 1283.95 | 1222.89 | 1165.43 | 1165.26 | OpenAI | gpt-3.5-turbo-0314 | 12/5/2024 | 2021/9 | Proprietary | 5650.00 |
| 129.00 | Qwen1.5-72B-Chat | 1147.44 | 1156.64 | 1136.42 | 1147.93 | 1142.70 | 1159.93 | 1135.46 | 1143.97 | 1128.43 | 1153.70 | 1150.49 | 1147.17 | 1166.24 | 1165.66 | 1146.77 | 1140.92 | 1135.02 | 1240.11 | 1112.74 | 1077.76 | 1218.68 | 1189.43 | 1128.80 | 1110.71 | Alibaba | qwen1.5-72b-chat | 12/5/2024 | 2024/2 | Qianwen LICENSE | 40648.00 |
| 132.00 | Reka-Flash-21B | 1147.62 | 1138.50 | 1128.81 | 1141.70 | 1134.60 | 1141.12 | 1128.68 | 1129.66 | 1123.45 | 1141.98 | 1150.66 | 1147.16 | 1165.44 | 1150.71 | 1133.61 | 1126.69 | 1126.13 | 1193.44 | 1128.85 | 1150.39 | 1211.89 | 1217.81 | 1181.61 | 1141.37 | Reka AI | reka-flash-21b-20240226 | 12/5/2024 | 2023/11 | Proprietary | 25814.00 |
| 133.00 | Llama-3-8B-Instruct | 1152.01 | 1138.53 | 1151.28 | 1142.34 | 1129.16 | 1145.84 | 1154.93 | 1136.66 | 1118.90 | 1152.95 | 1154.46 | 1150.92 | 1171.12 | 1136.02 | 1137.10 | 1144.21 | 1163.68 | 1135.03 | 1113.43 | 1101.52 | 1138.42 | 1150.92 | 1139.03 | 1173.60 | Meta | llama-3-8b-instruct | 12/5/2024 | 2023/3 | Llama 3 Community | 109328.00 |
| 133.00 | Mistral Medium | 1147.82 | 1141.64 | 1147.38 | 1141.15 | 1137.00 | 1152.43 | 1160.70 | 1153.48 | 1139.39 | 1145.28 | 1148.37 | 1148.14 | 1167.81 | 1162.54 | 1144.16 | 1132.03 | 1137.83 | 1164.70 | 1134.15 | 1149.42 | 1182.26 | 1163.82 | 1190.05 | 1144.26 | Mistral | mistral-medium | 12/5/2024 | - | Proprietary | 35558.00 |
| 138.00 | GPT-3.5-Turbo-0613 | 1116.83 | 1146.92 | 1130.66 | 1136.77 | 1134.36 | 1134.82 | 1109.75 | 1128.44 | 1106.98 | 1117.20 | 1123.88 | 1116.70 | 1120.25 | 1125.39 | 1123.05 | 1115.81 | 1098.14 | 1156.97 | 1099.46 | 1121.00 | 1209.73 | 1202.52 | 1184.25 | 1120.64 | OpenAI | gpt-3.5-turbo-0613 | 12/5/2024 | 2021/9 | Proprietary | 38962.00 |
| 139.00 | Claude-2.1 | 1118.24 | 1151.90 | 1097.03 | 1134.91 | 1135.43 | 1131.72 | 1048.16 | 1109.46 | 1122.61 | 1158.83 | 1137.07 | 1117.62 | 1122.64 | 1133.27 | 1118.95 | 1107.57 | 1096.77 | 1146.57 | 1139.25 | 1136.80 | 1208.27 | 1151.42 | 1175.02 | 1123.12 | Anthropic | claude-2.1 | 12/5/2024 | - | Proprietary | 37706.00 |
| 139.00 | Gemini Pro | 1110.60 | 1111.17 | 1131.25 | 1131.36 | 1113.30 | 1091.58 | 1103.28 | 1102.95 | 1086.05 | 1142.82 | 1115.55 | 1109.78 | 1111.67 | 1125.22 | 1083.18 | 1080.22 | 1097.61 | 1151.93 | 1059.17 | 1017.33 | 1212.30 | 1295.57 | 1152.56 | 1086.68 | gemini-pro | 12/5/2024 | 2023/4 | Proprietary | 6561.00 | |
| 139.00 | GPT-3.5-Turbo-0125 | 1105.84 | 1145.91 | 1145.12 | 1137.14 | 1130.65 | 1123.60 | 1099.15 | 1125.09 | 1109.76 | 1114.99 | 1111.96 | 1105.51 | 1100.24 | 1136.80 | 1112.00 | 1106.12 | 1086.75 | 1130.51 | 1073.66 | 1091.55 | 1204.56 | 1168.64 | 1148.01 | 1117.42 | OpenAI | gpt-3.5-turbo-0125 | 12/5/2024 | 2021/9 | Proprietary | 68902.00 |
| 141.00 | Meta-Llama-3.1-8B-Instruct | 1175.06 | 1144.70 | 1132.49 | 1131.58 | 1142.14 | 1185.92 | 1160.54 | 1170.98 | 1152.81 | 1173.24 | 1179.09 | 1175.46 | 1199.94 | 1195.91 | 1182.11 | 1182.07 | 1170.98 | 1210.19 | 1145.31 | 1140.06 | 1210.37 | 1198.81 | 1186.25 | 1174.50 | Meta | llama-3.1-8b-instruct | 12/5/2024 | 2023/12 | Llama 3.1 Community | 49572.00 |
| 141.00 | Yi-1.5-34B-Chat | 1157.17 | 1135.08 | 1120.31 | 1132.98 | 1135.78 | 1162.12 | 1144.59 | 1147.23 | 1149.66 | 1158.15 | 1160.22 | 1157.42 | 1178.86 | 1159.10 | 1159.90 | 1159.58 | 1163.14 | 1266.97 | 1111.08 | 1106.36 | 1179.32 | 1150.51 | 1119.36 | 1124.10 | 01 AI | yi-1.5-34b-chat | 12/5/2024 | 2024/5 | Apache-2.0 | 25160.00 |
| 141.00 | Zephyr-ORPO-141b-A35b-v0.1 | 1126.89 | 1125.93 | 1116.71 | 1130.28 | 1119.22 | 1124.08 | 1113.66 | 1128.30 | 1118.60 | 1103.49 | 1128.84 | 1127.13 | 1136.74 | 1119.11 | 1116.85 | 1113.16 | 1118.63 | 1142.83 | 1139.39 | 1089.49 | 1186.68 | 1171.09 | 1141.45 | 1103.77 | HuggingFace | zephyr-orpo-141b-A35b-v0.1 | 12/5/2024 | 2024/4 | Apache 2.0 | 4862.00 |
| 144.00 | Claude-Instant-1 | 1111.13 | 1130.14 | 1104.82 | 1126.98 | 1123.97 | 1108.79 | 1060.17 | 1106.99 | 1111.03 | 1146.65 | 1129.85 | 1110.72 | 1110.21 | 1133.35 | 1106.91 | 1100.08 | 1096.84 | 1144.77 | 1080.10 | 1104.48 | 1193.14 | 1141.54 | 1130.90 | 1100.28 | Anthropic | claude-instant-1 | 12/5/2024 | - | Proprietary | 20627.00 |
| 145.00 | Qwen1.5-32B-Chat | 1125.50 | 1144.45 | 1087.94 | 1126.66 | 1130.99 | 1149.11 | 1088.73 | 1122.12 | 1124.78 | 1137.83 | 1128.40 | 1124.70 | 1130.97 | 1157.79 | 1135.62 | 1130.22 | 1109.74 | 1235.02 | 1060.18 | 1053.48 | 1188.08 | 1154.48 | 1097.16 | 1087.74 | Alibaba | qwen1.5-32b-chat | 12/5/2024 | 2024/2 | Qianwen LICENSE | 22766.00 |
| 151.00 | DBRX-Instruct-Preview | 1103.06 | 1123.67 | 1111.12 | 1113.28 | 1115.15 | 1117.75 | 1102.48 | 1114.16 | 1108.48 | 1102.04 | 1105.01 | 1103.12 | 1096.26 | 1124.88 | 1109.47 | 1110.23 | 1103.71 | 1121.03 | 1050.89 | 1061.49 | 1154.38 | 1136.82 | 1096.51 | 1066.19 | Databricks | dbrx-instruct-preview | 12/5/2024 | 2023/12 | DBRX LICENSE | 33753.00 |
| 151.00 | Gemma-2-2b-it | 1140.67 | 1087.51 | 1129.44 | 1113.84 | 1096.11 | 1104.26 | 1145.80 | 1125.46 | 1109.22 | 1118.50 | 1144.87 | 1140.70 | 1140.61 | 1142.35 | 1115.51 | 1111.19 | 1131.36 | 1187.94 | 1121.15 | 1103.72 | 1230.70 | 1197.44 | 1141.44 | 1143.15 | gemma-2-2b-it | 12/5/2024 | 2024/7 | Gemma license | 35365.00 | |
| 151.00 | GPT-3.5-Turbo-1106 | 1067.71 | 1125.49 | 1108.93 | 1109.79 | 1117.76 | 1095.01 | 1043.70 | 1090.68 | 1104.25 | 1070.88 | 1081.27 | 1067.24 | 1046.09 | 1088.59 | 1090.79 | 1088.66 | 1052.24 | 1075.99 | 1021.40 | 1066.18 | 1209.82 | 1099.43 | 1105.69 | 1089.87 | OpenAI | gpt-3.5-turbo-1106 | 12/5/2024 | 2021/9 | Proprietary | 17031.00 |
| 151.00 | Granite-3.0-8B-Instruct | 1094.40 | 1112.57 | 1103.58 | 1110.06 | 1120.04 | 1097.18 | 1089.93 | 1110.75 | 1126.28 | 1069.13 | 1097.94 | 1095.59 | 1066.99 | 1143.33 | 1109.68 | 1115.99 | 1109.98 | 1129.58 | 1027.07 | 982.57 | 1160.14 | 1117.98 | 1102.51 | 1033.80 | IBM | granite-3.0-8b-instruct | 12/5/2024 | - | Apache 2.0 | 7069.00 |
| 151.00 | InternLM2.5-20B-chat | 1149.42 | 1136.04 | 1095.52 | 1116.09 | 1142.18 | 1158.22 | 1135.10 | 1152.67 | 1158.31 | 1139.46 | 1154.74 | 1149.78 | 1153.80 | 1170.81 | 1165.82 | 1175.77 | 1156.86 | 1260.79 | 1029.01 | 1059.60 | 1195.30 | 1165.76 | 1139.98 | 1123.21 | InternLM | internlm2_5-20b-chat | 12/5/2024 | 2024/8 | Other | 10680.00 |
| 151.00 | Phi-3-Medium-4k-Instruct | 1123.01 | 1115.25 | 1105.44 | 1118.02 | 1121.57 | 1125.07 | 1111.57 | 1123.08 | 1141.06 | 1095.09 | 1126.44 | 1123.36 | 1118.44 | 1133.14 | 1129.72 | 1127.05 | 1117.89 | 1164.89 | 1070.77 | 1100.46 | 1198.41 | 1110.71 | 1169.91 | 1096.15 | Microsoft | phi-3-medium-4k-instruct | 12/5/2024 | 2023/10 | MIT | 26134.00 |
| 152.00 | Mixtral-8x7B-Instruct-v0.1 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | 1114.00 | Mistral | mixtral-8x7b-instruct-v0.1 | 12/5/2024 | 2023/12 | Apache 2.0 | 76170.00 |
| 153.00 | Qwen1.5-14B-Chat | 1108.75 | 1118.57 | 1092.19 | 1106.73 | 1109.75 | 1125.77 | 1095.20 | 1102.73 | 1090.90 | 1108.82 | 1111.01 | 1107.59 | 1105.64 | 1125.71 | 1116.60 | 1110.08 | 1095.38 | 1202.13 | 1069.22 | 1042.32 | 1189.80 | 1150.29 | 1073.06 | 1078.51 | Alibaba | qwen1.5-14b-chat | 12/5/2024 | 2024/2 | Qianwen LICENSE | 18683.00 |
| 153.00 | WizardLM-70B-v1.0 | 1106.19 | 1070.71 | 1149.59 | 1104.72 | 1075.04 | 1071.04 | 1152.22 | 1102.50 | 1075.67 | 1108.84 | 1103.26 | 1105.48 | 1105.75 | 1104.65 | 1077.65 | 1072.88 | 1097.89 | 1113.06 | 1034.76 | 1083.95 | 1168.73 | 1067.78 | 1166.73 | 1083.99 | Microsoft | wizardlm-70b | 12/5/2024 | 2023/8 | Llama 2 Community | 8382.00 |
| 156.00 | OpenChat-3.5-0106 | 1091.59 | 1106.24 | 1103.02 | 1100.50 | 1088.53 | 1101.87 | 1098.63 | 1081.56 | 1071.82 | 1092.10 | 1090.85 | 1089.85 | 1081.74 | 1096.63 | 1083.97 | 1073.78 | 1080.57 | 1137.98 | 1047.35 | 1066.36 | 1128.16 | 1044.39 | 1107.36 | 1102.60 | OpenChat | openchat-3.5-0106 | 12/5/2024 | 2024/1 | Apache-2.0 | 12991.00 |
| 156.00 | Snowflake Arctic Instruct | 1089.99 | 1092.34 | 1095.73 | 1102.43 | 1088.69 | 1076.88 | 1085.20 | 1077.74 | 1080.38 | 1070.36 | 1091.98 | 1088.90 | 1072.66 | 1018.18 | 1073.83 | 1066.33 | 1077.75 | 1128.68 | 1087.25 | 1077.78 | 1136.04 | 1091.26 | 1127.10 | 1089.43 | Snowflake | snowflake-arctic-instruct | 12/5/2024 | 2024/4 | Apache 2.0 | 34185.00 |
| 156.00 | Yi-34B-Chat | 1111.41 | 1090.73 | 1108.25 | 1101.25 | 1090.36 | 1106.05 | 1110.95 | 1094.13 | 1079.08 | 1110.31 | 1115.64 | 1110.95 | 1112.35 | 1105.44 | 1102.00 | 1097.41 | 1106.19 | 1231.40 | 1048.70 | 1038.44 | 1175.04 | 1098.13 | 1080.09 | 1072.19 | 01 AI | yi-34b-chat | 12/5/2024 | 2023/6 | Yi License | 15920.00 |
| 158.00 | Gemma-1.1-7B-it | 1083.50 | 1106.40 | 1104.42 | 1098.36 | 1095.61 | 1084.38 | 1070.00 | 1071.27 | 1078.81 | 1043.58 | 1086.40 | 1081.29 | 1061.46 | 1072.10 | 1076.84 | 1077.16 | 1078.68 | 1118.54 | 1019.63 | 1049.85 | 1133.86 | 1139.11 | 1076.70 | 1051.49 | gemma-1.1-7b-it | 12/5/2024 | 2024/2 | Gemma license | 25093.00 | |
| 159.00 | DeepSeek-LLM-67B-Chat | 1076.85 | 1086.60 | 1083.11 | 1090.88 | 1072.76 | 1079.21 | 1065.89 | 1082.55 | 1070.25 | 1077.48 | 1078.18 | 1076.87 | 1065.61 | 1099.63 | 1065.34 | 1059.94 | 1063.66 | 1180.60 | 1000.98 | 1005.51 | 1165.53 | 1171.86 | 1159.22 | 1062.95 | DeepSeek AI | deepseek-llm-67b-chat | 12/5/2024 | 2023/11 | DeepSeek License | 4987.00 |
| 159.00 | OpenChat-3.5 | 1076.49 | 1066.77 | 1133.83 | 1094.62 | 1076.50 | 1053.59 | 1126.90 | 1074.55 | 1034.44 | 1087.45 | 1070.11 | 1076.48 | 1062.68 | 1108.23 | 1065.17 | 1055.32 | 1064.68 | 1125.52 | 1065.04 | 1038.74 | 1109.19 | 1098.08 | 1128.03 | 1081.05 | OpenChat | openchat-3.5 | 12/5/2024 | 2023/11 | Apache-2.0 | 8113.00 |
| 159.00 | Phi-3-Small-8k-Instruct | 1101.75 | 1099.17 | 1088.31 | 1098.34 | 1101.20 | 1107.04 | 1087.48 | 1101.95 | 1120.17 | 1071.14 | 1106.21 | 1101.89 | 1085.46 | 1101.38 | 1107.34 | 1111.42 | 1106.06 | 1122.69 | 1092.46 | 1075.27 | 1127.20 | 1055.65 | 1138.86 | 1109.59 | Microsoft | phi-3-small-8k-instruct | 12/5/2024 | 2023/10 | MIT | 18501.00 |
| 159.00 | Tulu-2-DPO-70B | 1099.13 | 1082.08 | 1099.75 | 1092.13 | 1088.54 | 1093.14 | 1109.82 | 1106.20 | 1073.74 | 1082.03 | 1100.19 | 1098.90 | 1093.33 | 1116.28 | 1098.13 | 1099.21 | 1091.75 | 1060.02 | 1088.68 | 1066.64 | 1133.56 | 896.65 | 1156.39 | 1120.19 | AllenAI/UW | tulu-2-dpo-70b | 12/5/2024 | 2023/11 | AI2 ImpACT Low-risk | 6664.00 |
| 160.00 | Meta-Llama-3.2-3B-Instruct | 1102.99 | 1047.96 | 1101.82 | 1093.51 | 1084.72 | 1080.36 | 1100.69 | 1106.43 | 1097.62 | 1111.13 | 1106.36 | 1102.72 | 1083.71 | 1120.01 | 1102.86 | 1129.84 | 1141.40 | 1085.81 | 1031.93 | 1053.01 | 1083.56 | 1000.54 | 984.30 | 1095.37 | Meta | llama-3.2-3b-instruct | 12/5/2024 | 2023/12 | Llama 3.2 | 8435.00 |
| 161.00 | OpenHermes-2.5-Mistral-7B | 1074.46 | 1066.13 | 1111.28 | 1089.83 | 1078.01 | 1057.67 | 1103.07 | 1073.84 | 1061.54 | 1063.46 | 1069.46 | 1072.55 | 1059.67 | 1069.72 | 1068.65 | 1064.34 | 1071.98 | 1082.20 | 1027.89 | 995.56 | 1149.59 | 1175.24 | 1083.68 | 1050.18 | NousResearch | openhermes-2.5-mistral-7b | 12/5/2024 | 2023/11 | Apache-2.0 | 5090.00 |
| 162.00 | Starling-LM-7B-beta | 1119.11 | 1111.30 | 1058.73 | 1091.67 | 1103.95 | 1129.44 | 1097.32 | 1104.46 | 1093.68 | 1106.74 | 1120.73 | 1118.90 | 1124.29 | 1120.82 | 1119.60 | 1112.21 | 1107.70 | 1178.79 | 1064.67 | 1076.57 | 1162.64 | 1091.03 | 1123.67 | 1143.22 | Nexusflow | starling-lm-7b-beta | 12/5/2024 | 2024/3 | Apache-2.0 | 16672.00 |
| 164.00 | Vicuna-33B | 1090.69 | 1068.43 | 1131.89 | 1091.50 | 1066.65 | 1067.13 | 1136.39 | 1073.68 | 1036.31 | 1086.71 | 1087.31 | 1090.10 | 1082.68 | 1043.84 | 1066.09 | 1060.97 | 1086.38 | 1093.84 | 1055.62 | 1055.01 | 1148.66 | 979.96 | 1100.68 | 1085.57 | LMSYS | vicuna-33b | 12/5/2024 | 2023/8 | Non-commercial | 22960.00 |
| 165.00 | Granite-3.0-2B-Instruct | 1074.37 | 1095.48 | 1064.32 | 1081.68 | 1094.71 | 1088.08 | 1062.20 | 1081.59 | 1101.37 | 1064.46 | 1076.75 | 1074.76 | 1028.82 | 1103.30 | 1089.61 | 1084.58 | 1080.07 | 1130.42 | 1003.19 | 987.79 | 1142.83 | 1072.79 | 1081.02 | 1036.52 | IBM | granite-3.0-2b-instruct | 12/5/2024 | - | Apache 2.0 | 7245.00 |
| 166.00 | Starling-LM-7B-alpha | 1088.52 | 1076.09 | 1089.65 | 1083.32 | 1070.35 | 1079.74 | 1102.47 | 1073.44 | 1047.49 | 1082.56 | 1085.11 | 1088.44 | 1079.61 | 1092.54 | 1072.97 | 1070.29 | 1083.36 | 1106.26 | 1039.52 | 1028.65 | 1129.71 | 1118.41 | 1110.53 | 1112.43 | UC Berkeley | starling-lm-7b-alpha | 12/5/2024 | 2023/11 | CC-BY-NC-4.0 | 10416.00 |
| 170.00 | Llama-2-70B-chat | 1093.05 | 1061.47 | 1065.33 | 1081.54 | 1063.14 | 1072.02 | 1078.91 | 1074.77 | 1057.77 | 1081.08 | 1094.58 | 1091.88 | 1083.43 | 1071.49 | 1070.25 | 1070.33 | 1096.39 | 1056.85 | 1047.52 | 1027.26 | 1110.31 | 1113.14 | 1106.70 | 1137.87 | Meta | llama-2-70b-chat | 12/5/2024 | 2023/7 | Llama 2 Community | 39646.00 |
| 170.00 | NV-Llama2-70B-SteerLM-Chat | 1080.70 | 1025.56 | 1076.87 | 1074.04 | 1048.65 | 1022.73 | 1096.48 | 1063.31 | 1036.59 | 1059.60 | 1076.64 | 1079.86 | 1072.03 | 1011.88 | 1045.87 | 1035.54 | 1069.25 | 1086.34 | 1050.89 | 1081.73 | 1115.19 | 986.83 | 1139.37 | 1035.98 | Nvidia | llama2-70b-steerlm-chat | 12/5/2024 | 2023/11 | Llama 2 Community | 3638.00 |
| 171.00 | Dolphin-2.2.1-Mistral-7B | 1062.87 | 1033.15 | 1090.73 | 1069.27 | 1054.37 | 1024.08 | 1091.00 | 1056.63 | 1041.18 | 1017.98 | 1058.47 | 1062.05 | 1039.91 | 1031.61 | 1050.39 | 1044.49 | 1059.80 | 1104.61 | 990.63 | 936.94 | 1135.11 | 960.67 | 1109.04 | 988.99 | Cognitive Computations | dolphin-2.2.1-mistral-7b | 12/5/2024 | 2023/10 | Apache-2.0 | 1712.00 |
| 171.00 | Nous-Hermes-2-Mixtral-8x7B-DPO | 1084.43 | 1066.78 | 1090.12 | 1071.75 | 1036.37 | 1079.46 | 1105.04 | 1054.41 | 1028.10 | 1079.75 | 1085.75 | 1083.87 | 1074.70 | 1060.12 | 1052.19 | 1045.29 | 1077.99 | 1076.33 | 1081.62 | 1027.81 | 1159.20 | 1174.45 | 1084.44 | 1024.16 | NousResearch | nous-hermes-2-mixtral-8x7b-dpo | 12/5/2024 | 2024/1 | Apache-2.0 | 3836.00 |
| 171.00 | pplx-70B-online | 1077.83 | 1034.68 | 1054.47 | 1075.87 | 1029.97 | 1028.23 | 1049.99 | 1032.03 | 1041.60 | 986.48 | 1075.87 | 1076.92 | 1065.51 | 1016.44 | 1027.69 | 1024.77 | 1066.34 | 1127.44 | 1046.88 | 1039.06 | 1208.62 | 1195.71 | 1074.44 | 1063.75 | Perplexity AI | pplx-70b-online | 12/5/2024 | Online | Proprietary | 6894.00 |
| 174.00 | falcon-180b-chat | 1033.88 | 1041.16 | 1108.95 | 1058.91 | 1019.42 | 1016.60 | 1095.25 | 1052.94 | 1012.74 | 1012.05 | 1031.12 | 1034.33 | 1002.82 | 1056.09 | 1000.38 | 1009.83 | 1025.97 | 1003.19 | 950.22 | 1148.02 | 1166.50 | 468.14 | 859.17 | 1101.69 | TII | falcon-180b-chat | 12/5/2024 | 2023/9 | Falcon-180B TII License | 1326.00 |
| 174.00 | Qwen1.5-7B-Chat | 1070.15 | 1082.20 | 1036.13 | 1065.21 | 1058.77 | 1088.91 | 1039.84 | 1063.91 | 1048.42 | 1061.07 | 1069.80 | 1068.12 | 1047.69 | 1102.10 | 1067.25 | 1056.81 | 1054.59 | 1196.10 | 1017.80 | 1022.46 | 1177.38 | 1046.27 | 1034.72 | 1017.08 | Alibaba | qwen1.5-7b-chat | 12/5/2024 | 2024/2 | Qianwen LICENSE | 4868.00 |
| 174.00 | SOLAR-10.7B-Instruct-v1.0 | 1062.12 | 1053.05 | 1088.32 | 1065.76 | 1056.26 | 1047.03 | 1089.31 | 1057.97 | 1028.04 | 1041.59 | 1058.19 | 1062.00 | 1039.04 | 1134.84 | 1056.39 | 1050.42 | 1060.46 | 1070.06 | 1002.27 | 1013.05 | 1140.31 | 936.79 | 1062.08 | 1031.62 | Upstage AI | solar-10.7b-instruct-v1.0 | 12/5/2024 | 2023/11 | CC-BY-NC-4.0 | 4289.00 |
| 175.00 | Mistral-7B-Instruct-v0.2 | 1072.38 | 1066.55 | 1063.35 | 1067.33 | 1063.54 | 1073.56 | 1075.54 | 1067.32 | 1056.53 | 1070.15 | 1072.29 | 1071.20 | 1050.42 | 1071.66 | 1068.49 | 1070.84 | 1081.70 | 1068.42 | 983.70 | 979.20 | 1042.76 | 1064.25 | 1046.21 | 1024.68 | Mistral | mistral-7b-instruct-v0.2 | 12/5/2024 | 2023/12 | Apache-2.0 | 20075.00 |
| 175.00 | MPT-30B-chat | 1045.51 | 1044.09 | 1085.20 | 1060.26 | 1055.88 | 1030.62 | 1076.89 | 1057.18 | 1014.11 | 1052.23 | 1040.46 | 1043.75 | 1022.63 | 1066.91 | 1047.69 | 1059.26 | 1043.38 | 1023.89 | 998.71 | 992.74 | 1094.66 | 1018.50 | 961.29 | 1070.24 | MosaicML | mpt-30b-chat | 12/5/2024 | 2023/6 | CC-BY-NC-SA-4.0 | 2648.00 |
| 175.00 | Phi-3-Mini-4K-Instruct-June-24 | 1070.81 | 1073.67 | 1059.39 | 1068.00 | 1088.80 | 1081.94 | 1058.14 | 1074.87 | 1123.15 | 1055.04 | 1074.43 | 1071.21 | 1020.88 | 1055.67 | 1095.60 | 1100.70 | 1082.14 | 1094.02 | 1052.00 | 1030.62 | 1124.66 | 1034.73 | 1048.68 | 1134.46 | Microsoft | phi-3-mini-4k-instruct-june-2024 | 12/5/2024 | 2023/10 | MIT | 12860.00 |
| 175.00 | WizardLM-13b-v1.2 | 1058.52 | 1030.42 | 1092.10 | 1063.23 | 1014.48 | 1025.98 | 1093.16 | 1050.72 | 986.95 | 1042.92 | 1057.86 | 1055.95 | 1039.51 | 1066.29 | 1013.44 | 1010.44 | 1050.30 | 1073.95 | 1026.77 | 1031.07 | 1076.76 | 1041.66 | 1083.45 | 1072.82 | Microsoft | wizardlm-13b | 12/5/2024 | 2023/7 | Llama 2 Community | 7182.00 |
| 176.00 | Qwen-14B-Chat | 1035.14 | 1068.22 | 1057.35 | 1056.67 | 1038.34 | 1056.19 | 1034.94 | 1034.29 | 1032.94 | 1019.25 | 1036.82 | 1033.25 | 1000.13 | 1038.28 | 1023.93 | 1017.91 | 1017.09 | 1134.71 | 1026.65 | 1015.19 | 1172.92 | 957.36 | 1082.13 | 1082.87 | Alibaba | qwen-14b-chat | 12/5/2024 | 2023/8 | Qianwen LICENSE | 5071.00 |
| 177.00 | Vicuna-13B | 1041.98 | 1042.34 | 1080.96 | 1058.49 | 1034.96 | 1032.28 | 1063.82 | 1040.51 | 999.28 | 1032.74 | 1041.25 | 1040.34 | 1010.78 | 1061.62 | 1025.16 | 1017.62 | 1028.22 | 1097.16 | 993.73 | 992.04 | 1127.64 | 1049.44 | 1072.90 | 1069.10 | LMSYS | vicuna-13b | 12/5/2024 | 2023/7 | Llama 2 Community | 19794.00 |
| 180.00 | Phi-3-Mini-4k-Instruct | 1066.09 | 1069.27 | 1029.46 | 1055.65 | 1066.26 | 1085.72 | 1043.12 | 1067.34 | 1084.30 | 1025.82 | 1070.11 | 1065.05 | 1021.48 | 1052.48 | 1078.87 | 1084.43 | 1072.57 | 1081.95 | 1032.85 | 1038.35 | 1100.67 | 1060.30 | 1057.34 | 1092.45 | Microsoft | phi-3-mini-4k-instruct | 12/5/2024 | 2023/10 | MIT | 21107.00 |
| 180.00 | Zephyr-7B-alpha | 1041.73 | 1039.27 | 1059.05 | 1046.82 | 1025.38 | 1034.07 | 1075.70 | 1041.71 | 1006.32 | 1013.94 | 1033.88 | 1039.06 | 1012.85 | 1010.67 | 1022.60 | 1018.87 | 1039.62 | 1042.61 | 1005.50 | 913.56 | 1078.90 | 1303.43 | 1051.53 | 1000.81 | HuggingFace | zephyr-7b-alpha | 12/5/2024 | 2023/10 | MIT | 1816.00 |
| 181.00 | Llama-2-13b-chat | 1063.12 | 1042.05 | 1044.19 | 1053.67 | 1043.17 | 1051.26 | 1049.99 | 1046.58 | 1032.26 | 1045.94 | 1068.48 | 1061.70 | 1036.82 | 1077.47 | 1049.52 | 1048.61 | 1060.95 | 1055.21 | 990.65 | 997.62 | 1062.94 | 1094.35 | 1076.01 | 1075.73 | Meta | llama-2-13b-chat | 12/5/2024 | 2023/7 | Llama 2 Community | 19742.00 |
| 183.00 | Zephyr-7B-beta | 1053.43 | 1027.87 | 1096.68 | 1049.53 | 1022.60 | 1030.02 | 1112.90 | 1038.55 | 1010.57 | 1031.89 | 1048.59 | 1051.99 | 1027.71 | 1053.85 | 1026.56 | 1027.51 | 1053.30 | 1017.89 | 994.42 | 975.41 | 1042.13 | 1027.73 | 1069.06 | 1040.36 | HuggingFace | zephyr-7b-beta | 12/5/2024 | 2023/10 | MIT | 11333.00 |
| 184.00 | CodeLlama-34B-instruct | 1042.81 | 1042.57 | 1037.90 | 1047.22 | 1032.13 | 1041.95 | 1034.75 | 1029.20 | 1022.10 | 1012.58 | 1042.51 | 1040.73 | 1012.87 | 1025.95 | 1027.91 | 1022.34 | 1034.69 | 1032.83 | 1007.28 | 988.54 | 1031.41 | 1035.52 | 1106.50 | 1121.91 | Meta | codellama-34b-instruct | 12/5/2024 | 2023/7 | Llama 2 Community | 7514.00 |
| 185.00 | CodeLlama-70B-instruct | 1042.19 | 1054.69 | 1002.70 | 1038.40 | 1060.16 | 1047.23 | 1013.25 | 1031.57 | 1034.69 | 1032.11 | 1052.71 | 1040.94 | 1007.90 | 998.09 | 1051.23 | 1055.54 | 1044.90 | 1089.30 | 864.09 | 913.76 | 1117.31 | 1398.69 | 1037.55 | 1013.69 | Meta | codellama-70b-instruct | 12/5/2024 | 2024/1 | Llama 2 Community | 1193.00 |
| 185.00 | Gemma-7B-it | 1037.50 | 1056.85 | 1053.66 | 1047.68 | 1055.33 | 1046.52 | 1029.06 | 1023.17 | 1032.49 | 958.88 | 1040.40 | 1034.92 | 999.79 | 1036.48 | 1044.96 | 1045.31 | 1032.15 | 1095.29 | 980.10 | 978.95 | 1079.55 | 1110.78 | 1015.04 | 982.61 | gemma-7b-it | 12/5/2024 | 2024/2 | Gemma license | 9179.00 | |
| 185.00 | Phi-3-Mini-128k-Instruct | 1036.82 | 1032.41 | 1043.96 | 1048.54 | 1039.98 | 1029.06 | 1034.02 | 1036.07 | 1063.37 | 991.45 | 1039.77 | 1035.02 | 983.39 | 1014.96 | 1035.49 | 1036.18 | 1034.04 | 1076.26 | 993.08 | 1009.00 | 1078.98 | 1023.92 | 1039.21 | 1054.74 | Microsoft | phi-3-mini-128k-instruct | 12/5/2024 | 2023/10 | MIT | 21633.00 |
| 186.00 | Guanaco-33B | 1032.15 | 968.57 | 1086.30 | 1039.68 | 1004.54 | 965.80 | 1080.97 | 993.30 | 993.36 | 1005.24 | 1035.12 | 1030.54 | 1003.69 | 973.05 | 1000.59 | 996.38 | 1028.51 | 1013.02 | 1060.67 | 1020.69 | 982.69 | 597.97 | 1052.69 | 1053.51 | UW | guanaco-33b | 12/5/2024 | 2023/5 | Non-commercial | 2999.00 |
| 186.00 | Meta-Llama-3.2-1B-Instruct | 1053.53 | 1009.48 | 1045.02 | 1044.39 | 1039.48 | 1046.70 | 1044.64 | 1052.63 | 1064.88 | 1039.18 | 1057.21 | 1052.08 | 982.32 | 1070.34 | 1059.52 | 1078.74 | 1081.03 | 1022.52 | 1022.50 | 1010.13 | 1074.96 | 1014.70 | 973.40 | 1029.72 | Meta | llama-3.2-1b-instruct | 12/5/2024 | 2023/12 | Llama 3.2 | 8543.00 |
| 188.00 | PaLM-Chat-Bison-001 | 1003.62 | 1028.03 | 1043.19 | 1042.41 | 1036.06 | 990.23 | 998.34 | 1014.18 | 1014.84 | 993.00 | 997.46 | 1000.27 | 960.86 | 1013.91 | 1000.78 | 1010.29 | 1006.09 | 931.25 | 884.37 | 866.60 | 1067.82 | 1011.64 | 1021.85 | 894.53 | palm-2 | 12/5/2024 | 2021/6 | Proprietary | 8746.00 | |
| 188.00 | pplx-7B-online | 1044.58 | 1017.94 | 1010.25 | 1041.67 | 1017.19 | 1015.06 | 1007.40 | 997.68 | 1013.04 | 990.45 | 1039.84 | 1043.64 | 1017.77 | 994.98 | 1016.02 | 1013.27 | 1039.08 | 1083.89 | 929.50 | 947.87 | 1159.28 | 1112.82 | 1057.06 | 1041.57 | Perplexity AI | pplx-7b-online | 12/5/2024 | Online | Proprietary | 6335.00 |
| 189.00 | Gemma-1.1-2b-it | 1020.80 | 1062.27 | 1050.78 | 1039.54 | 1042.26 | 1036.07 | 1010.53 | 1006.42 | 1021.40 | 962.93 | 1023.08 | 1017.22 | 955.72 | 1019.29 | 1015.78 | 1016.88 | 1013.48 | 1076.52 | 964.31 | 947.85 | 1071.42 | 1049.85 | 1021.37 | 993.45 | gemma-1.1-2b-it | 12/5/2024 | 2024/2 | Gemma license | 11350.00 | |
| 192.00 | StripedHyena-Nous-7B | 1017.59 | 1012.65 | 1046.39 | 1034.00 | 1006.94 | 999.55 | 1035.94 | 1012.09 | 999.78 | 1011.60 | 1016.16 | 1016.16 | 971.91 | 994.23 | 995.87 | 994.00 | 1013.48 | 1029.35 | 971.07 | 933.29 | 1059.39 | 1061.41 | 1022.78 | 989.90 | Together AI | stripedhyena-nous-7b | 12/5/2024 | 2023/12 | Apache 2.0 | 5272.00 |
| 199.00 | Mistral-7B-Instruct-v0.1 | 1008.16 | 1021.44 | 1048.21 | 1026.85 | 1015.79 | 1007.95 | 1036.81 | 1012.78 | 996.27 | 1011.23 | 999.33 | 1006.81 | 956.35 | 1020.07 | 1002.33 | 1003.90 | 1008.40 | 992.54 | 897.71 | 924.67 | 1037.62 | 1030.19 | 1035.48 | 975.49 | Mistral | mistral-7b-instruct | 12/5/2024 | 2023/9 | Apache 2.0 | 9144.00 |
| 200.00 | Llama-2-7B-chat | 1036.81 | 992.74 | 1029.64 | 1024.49 | 1003.36 | 1002.53 | 1040.37 | 1012.27 | 1009.89 | 1027.79 | 1042.81 | 1034.64 | 997.76 | 1012.02 | 1009.89 | 1011.27 | 1040.94 | 1031.92 | 924.53 | 955.81 | 1061.49 | 1055.93 | 1015.69 | 989.50 | Meta | llama-2-7b-chat | 12/5/2024 | 2023/7 | Llama 2 Community | 14557.00 |
| 200.00 | Vicuna-7B | 1005.20 | 991.75 | 1040.34 | 1021.74 | 1001.45 | 981.57 | 1023.71 | 995.61 | 963.45 | 987.05 | 1004.39 | 1002.50 | 964.79 | 1047.23 | 989.70 | 979.00 | 989.21 | 1029.00 | 1006.98 | 962.23 | 1130.43 | 943.83 | 1046.61 | 1066.43 | LMSYS | vicuna-7b | 12/5/2024 | 2023/7 | Llama 2 Community | 7017.00 |
| 202.00 | Qwen1.5-4B-Chat | 988.48 | 1005.29 | 1004.63 | 1014.99 | 994.99 | 990.13 | 974.96 | 983.80 | 993.27 | 977.94 | 989.24 | 984.98 | 912.25 | 1004.57 | 977.90 | 965.30 | 966.71 | 1083.31 | 929.99 | 905.03 | 1030.44 | 991.32 | 976.23 | 1013.12 | Alibaba | qwen1.5-4b-chat | 12/5/2024 | 2024/2 | Qianwen LICENSE | 7815.00 |
| 204.00 | Gemma-2B-it | 989.37 | 1016.19 | 1026.94 | 1008.04 | 1008.47 | 1000.48 | 989.17 | 975.85 | 979.45 | 936.74 | 991.94 | 986.15 | 923.21 | 997.68 | 987.81 | 976.82 | 981.58 | 1049.21 | 852.56 | 909.81 | 1019.72 | 1044.83 | 965.99 | 985.15 | gemma-2b-it | 12/5/2024 | 2024/2 | Gemma license | 4921.00 | |
| 206.00 | OLMo-7B-instruct | 1015.52 | 998.64 | 961.80 | 993.65 | 978.73 | 1017.01 | 996.74 | 987.57 | 988.81 | 1005.26 | 1013.55 | 1014.07 | 964.90 | 1057.63 | 994.66 | 993.67 | 1018.53 | 1071.46 | 879.85 | 885.50 | 993.59 | 930.66 | 971.16 | 972.41 | Allen AI | olmo-7b-instruct | 12/5/2024 | 2024/2 | Apache-2.0 | 6506.00 |
| 207.00 | GPT4All-13B-Snoozy | 931.66 | 944.19 | 1011.17 | 971.90 | 956.45 | 909.48 | 972.09 | 947.55 | 903.29 | 921.95 | 928.45 | 930.29 | 857.88 | 949.03 | 930.95 | 931.39 | 930.73 | 931.46 | 714.10 | 812.37 | 924.53 | 966.12 | 975.57 | 880.59 | Nomic AI | gpt4all-13b-snoozy | 12/5/2024 | 2023/3 | Non-commercial | 1787.00 |
| 207.00 | Koala-13B | 964.18 | 944.45 | 992.77 | 979.54 | 931.39 | 937.45 | 971.72 | 941.08 | 897.62 | 918.04 | 963.84 | 961.44 | 905.77 | 884.78 | 924.81 | 919.18 | 960.80 | 926.05 | 876.47 | 907.34 | 1026.51 | 915.94 | 924.88 | 933.35 | UC Berkeley | koala-13b | 12/5/2024 | 2023/4 | Non-commercial | 7038.00 |
| 208.00 | Alpaca-13B | 901.41 | 868.44 | 1035.64 | 966.88 | 886.47 | 789.65 | 965.40 | 888.58 | 872.53 | 881.71 | 889.02 | 895.36 | 815.89 | 922.99 | 818.50 | 813.82 | 892.34 | 827.80 | 806.59 | 848.56 | 899.75 | 944.75 | 1030.00 | 931.06 | Stanford | alpaca-13b | 12/5/2024 | 2023/3 | Non-commercial | 5875.00 |
| 208.00 | ChatGLM3-6B | 955.22 | 966.15 | 993.82 | 974.52 | 962.67 | 953.04 | 973.59 | 960.80 | 954.06 | 957.83 | 947.34 | 952.76 | 875.84 | 970.12 | 952.94 | 955.03 | 949.08 | 1122.44 | 788.56 | 822.16 | 1042.09 | 939.21 | 925.97 | 924.30 | Tsinghua | chatglm3-6b | 12/5/2024 | 2023/10 | Apache-2.0 | 4765.00 |
| 208.00 | MPT-7B-Chat | 927.63 | 937.83 | 999.62 | 966.83 | 923.88 | 899.94 | 957.10 | 909.63 | 885.91 | 900.40 | 925.73 | 924.70 | 850.45 | 802.13 | 891.20 | 885.63 | 915.81 | 1001.48 | 880.32 | 904.89 | 963.19 | 1033.54 | 833.51 | 894.96 | MosaicML | mpt-7b-chat | 12/5/2024 | 2023/5 | CC-BY-NC-SA-4.0 | 4012.00 |
| 213.00 | RWKV-4-Raven-14B | 921.58 | 916.46 | 954.09 | 948.83 | 911.40 | 896.73 | 933.79 | 885.60 | 887.98 | 892.40 | 914.77 | 918.30 | 845.57 | 840.26 | 890.92 | 877.69 | 906.07 | 951.66 | 878.58 | 872.58 | 1027.00 | 875.25 | 1003.02 | 912.47 | RWKV | RWKV-4-Raven-14B | 12/5/2024 | 2023/4 | Apache 2.0 | 4934.00 |
| 213.00 | ChatGLM2-6B | 924.05 | 903.54 | 960.96 | 942.51 | 927.93 | 892.88 | 948.51 | 908.52 | 893.37 | 901.78 | 910.68 | 919.77 | 831.61 | 891.07 | 915.29 | 915.72 | 924.83 | 1047.49 | 764.61 | 662.80 | 924.44 | 925.61 | 855.68 | 852.11 | Tsinghua | chatglm2-6b | 12/5/2024 | 2023/6 | Apache-2.0 | 2710.00 |
| 213.00 | OpenAssistant-Pythia-12B | 893.20 | 904.55 | 958.85 | 931.14 | 913.10 | 873.26 | 920.87 | 889.10 | 858.37 | 865.24 | 885.16 | 890.19 | 802.11 | 865.21 | 880.42 | 874.21 | 887.54 | 859.63 | 874.97 | 835.92 | 864.52 | 921.58 | 840.46 | 928.94 | OpenAssistant | oasst-pythia-12b | 12/5/2024 | 2023/4 | Apache 2.0 | 6380.00 |
| 216.00 | ChatGLM-6B | 879.06 | 890.93 | 903.23 | 888.44 | 897.59 | 883.95 | 902.43 | 899.15 | 891.24 | 854.04 | 866.83 | 874.18 | 775.46 | 938.46 | 893.73 | 870.26 | 858.16 | 1131.16 | 723.01 | 686.75 | 976.78 | 814.34 | 726.40 | 710.03 | Tsinghua | chatglm-6b | 12/5/2024 | 2023/3 | Non-commercial | 4993.00 |
| 216.00 | Dolly-V2-12B | 821.97 | 815.64 | 917.99 | 881.36 | 855.20 | 746.16 | 864.24 | 812.75 | 837.21 | 738.63 | 807.25 | 817.44 | 691.36 | 857.66 | 797.60 | 785.48 | 804.18 | 875.36 | 809.03 | 743.51 | 935.02 | 858.37 | 786.85 | 822.87 | Databricks | dolly-v2-12b | 12/5/2024 | 2023/4 | MIT | 3485.00 |
| 216.00 | FastChat-T5-3B | 867.72 | 789.46 | 937.90 | 896.23 | 831.83 | 759.43 | 900.48 | 857.42 | 827.98 | 852.07 | 858.26 | 863.24 | 757.31 | 950.44 | 808.77 | 805.48 | 870.72 | 755.74 | 814.71 | 771.35 | 745.04 | 811.96 | 727.24 | 820.79 | LMSYS | fastchat-t5-3b | 12/5/2024 | 2023/4 | Apache 2.0 | 4302.00 |
| 217.00 | LLaMA-13B | 799.35 | 746.99 | 880.57 | 867.36 | 796.84 | 669.49 | 796.32 | 778.17 | 803.47 | 752.18 | 788.64 | 796.89 | 649.14 | 803.55 | 723.15 | 710.63 | 779.03 | 851.88 | 745.45 | 692.44 | 956.33 | 645.48 | 806.22 | 817.29 | Meta | llama-13b | 12/5/2024 | 2023/2 | Non-commercial | 2445.00 |
| 218.00 | StableLM-Tuned-Alpha-7B | 840.09 | 865.85 | 882.36 | 859.14 | 841.37 | 858.53 | 868.76 | 830.97 | 804.13 | 819.88 | 829.95 | 834.37 | 712.46 | 878.50 | 830.27 | 824.77 | 830.40 | 892.07 | 709.85 | 721.00 | 861.20 | 805.38 | 745.32 | 827.73 | Stability AI | stablelm-tuned-alpha-7b | 12/5/2024 | 2023/4 | CC-BY-NC-SA-4.0 | 3341.00 |