Model Leaderboard

Viewing: November 22, 2024

LLM Model Performance Comparison
Rank	Model	Overall Score	Coding Style	Creative Writing Style	Full Style	Hard-6 Style	Coding	Creative Writing	Instruction Following	Math	Multi-turn	No Refusal	No Short	No Tie	Long User	Hard-6	Hard English-6	English	Chinese	French	German	Japanese	Korean	Russian	Spanish	Organization	Model Slug	Date	Cutoff Date	License	Battles
1.00	ChatGPT-4o-latest (2024-11-20)	1361.00	1299.90	1373.32	1311.53	1277.53	1347.77	1401.37	1358.37	1292.47	1397.24	1367.40	1362.78	1505.56	1376.14	1334.06	1320.89	1335.65	1434.71	1352.80	1367.04	1470.60	1527.65	1372.10	1315.88	OpenAI	chatgpt-4o-latest-20241120	11/22/2024	-	Proprietary	10658.00
2.00	ChatGPT-4o-latest (2024-09-03)	1339.47	1296.84	1339.30	1299.40	1282.48	1338.91	1365.32	1338.64	1275.55	1378.34	1344.22	1341.24	1471.97	1364.99	1332.49	1320.59	1319.03	1421.93	1306.88	1322.67	1447.26	1421.85	1346.12	1319.59	OpenAI	chatgpt-4o-latest-20240903	11/22/2024	2023/10	Proprietary	45494.00
2.00	Gemini-Exp-1121	1365.31	1273.42	1313.93	1292.49	1288.35	1341.65	1384.95	1356.97	1314.65	1384.03	1369.32	1368.03	1505.01	1375.93	1349.80	1325.90	1332.26	1447.20	1359.78	1354.69	1491.11	1538.11	1373.20	1354.12	Google	gemini-exp-1121	11/22/2024	-	Proprietary	5625.00
2.00	o1-preview	1333.56	1309.38	1313.78	1300.53	1306.02	1354.58	1317.64	1344.91	1340.19	1365.24	1344.63	1335.24	1454.20	1351.44	1350.25	1349.83	1325.92	1382.65	1290.01	1306.85	1447.15	1409.90	1335.93	1295.27	OpenAI	o1-preview	11/22/2024	2023/10	Proprietary	27835.00
4.00	ChatGPT-4o-latest (2024-08-08)	1316.29	1293.64	1320.22	1291.24	1278.79	1323.71	1327.88	1320.54	1273.27	1346.36	1320.72	1318.29	1433.05	1343.91	1315.40	1305.50	1295.76	1372.95	1287.85	1318.44	1418.27	1400.95	1337.13	1310.02	OpenAI	chatgpt-4o-latest-20240808	11/22/2024	2023/10	Proprietary	35637.00
5.00	Claude 3.5 Sonnet (20241022)	1282.25	1305.49	1313.24	1283.21	1298.90	1319.37	1285.77	1300.38	1283.04	1327.46	1288.45	1283.70	1374.78	1313.28	1303.02	1292.10	1256.24	1329.75	1238.17	1305.28	1386.55	1327.41	1320.82	1276.88	Anthropic	claude-3-5-sonnet-20241022	11/22/2024	2024/4	Proprietary	29454.00
8.00	Gemini-1.5-Pro-Exp-0801	1297.89	1252.52	1310.26	1269.51	1254.60	1276.97	1327.76	1289.80	1261.29	1305.42	1301.79	1299.05	1401.67	1299.17	1277.95	1261.20	1267.53	1369.46	1296.85	1291.00	1424.37	1398.51	1334.22	1296.43	Google	gemini-1.5-pro-exp-0801	11/22/2024	2023/11	Proprietary	26051.00
9.00	Gemini-1.5-Pro-002	1300.58	1251.75	1299.08	1266.29	1264.99	1288.59	1323.07	1299.40	1281.71	1299.57	1305.41	1301.86	1406.57	1312.21	1298.51	1281.99	1270.62	1389.83	1238.26	1282.83	1422.60	1411.33	1330.06	1305.71	Google	gemini-1.5-pro-002	11/22/2024	-	Proprietary	27336.00
9.00	Gemini-1.5-Pro-Exp-0827	1299.21	1266.31	1298.72	1268.84	1261.63	1287.36	1319.96	1293.88	1273.44	1306.49	1303.91	1300.49	1408.07	1321.89	1288.22	1274.44	1268.31	1385.05	1277.29	1302.75	1422.76	1401.51	1341.87	1306.57	Google	gemini-1.5-pro-exp-0827	11/22/2024	2023/11	Proprietary	32345.00
9.00	Gemini-Exp-1114	1343.97	1265.54	1301.07	1268.33	1272.82	1325.64	1368.56	1337.47	1310.54	1364.94	1348.95	1346.06	1474.34	1352.19	1333.54	1316.97	1306.93	1443.62	1347.99	1395.87	1477.60	1485.53	1367.61	1286.49	Google	gemini-exp-1114	11/22/2024	-	Proprietary	12778.00
12.00	GPT-4o-2024-05-13	1284.96	1264.32	1285.45	1262.35	1251.36	1293.15	1289.33	1287.60	1254.64	1302.21	1289.45	1286.62	1378.93	1301.55	1284.62	1275.48	1262.85	1335.54	1257.67	1277.61	1398.05	1367.35	1305.37	1281.89	OpenAI	gpt-4o-2024-05-13	11/22/2024	2023/10	Proprietary	111745.00
16.00	Claude 3.5 Sonnet (20240620)	1267.99	1280.87	1255.61	1258.65	1269.89	1294.77	1241.90	1280.51	1271.79	1305.59	1276.11	1269.48	1351.97	1286.78	1279.38	1268.68	1241.17	1320.91	1244.86	1263.90	1369.20	1337.86	1302.34	1280.11	Anthropic	claude-3-5-sonnet-20240620	11/22/2024	2024/4	Proprietary	86632.00
16.00	o1-mini	1308.16	1302.55	1229.36	1258.08	1283.89	1364.70	1244.93	1315.02	1331.04	1327.23	1317.02	1309.35	1417.41	1332.68	1341.63	1341.22	1298.25	1371.19	1256.16	1279.41	1389.02	1377.72	1308.46	1299.16	OpenAI	o1-mini	11/22/2024	2023/10	Proprietary	31992.00
18.00	Gemini Advanced App (2024-05-14)	1266.60	1238.35	1282.16	1253.28	1237.16	1254.86	1275.36	1259.37	1238.69	1273.33	1270.23	1267.59	1348.98	1263.41	1253.44	1235.06	1234.47	1332.26	1259.02	1268.92	1382.00	1371.13	1304.45	1237.86	Google	gemini-advanced-0514	11/22/2024	Online	Proprietary	52221.00
19.00	Meta-Llama-3.1-405B-Instruct-bf16	1265.85	1263.59	1247.23	1251.43	1253.96	1284.22	1255.19	1265.81	1255.01	1288.90	1269.80	1266.58	1350.87	1276.16	1272.42	1275.22	1260.25	1288.17	1220.77	1247.49	1346.64	1308.85	1273.86	1248.33	Meta	llama-3.1-405b-instruct-bf16	11/22/2024	2023/12	Llama 3.1 Community	14596.00
20.00	Meta-Llama-3.1-405B-Instruct-fp8	1267.17	1255.50	1257.08	1252.23	1248.01	1276.54	1264.98	1269.41	1250.73	1293.35	1271.05	1268.43	1352.28	1270.75	1266.68	1266.99	1260.65	1291.35	1230.92	1246.18	1312.13	1322.43	1285.83	1251.26	Meta	llama-3.1-405b-instruct-fp8	11/22/2024	2023/12	Llama 3.1 Community	52089.00
24.00	GPT-4o-2024-08-06	1264.94	1249.53	1274.11	1249.07	1238.09	1273.54	1273.26	1272.36	1253.11	1277.69	1270.10	1266.11	1347.77	1286.75	1267.19	1258.18	1244.32	1310.55	1225.24	1254.38	1375.06	1361.10	1289.27	1269.14	OpenAI	gpt-4o-2024-08-06	11/22/2024	2023/10	Proprietary	43776.00
24.00	Grok-2-08-13	1288.87	1255.09	1263.57	1248.59	1239.22	1285.11	1283.44	1276.95	1252.88	1294.73	1293.51	1290.39	1387.33	1287.24	1275.37	1265.60	1270.98	1348.34	1271.16	1281.87	1392.40	1370.75	1306.23	1274.77	xAI	grok-2-2024-08-13	11/22/2024	2024/3	Proprietary	52102.00
26.00	Yi-Lightning	1286.81	1260.05	1246.29	1244.55	1249.70	1302.59	1280.57	1285.92	1268.92	1315.11	1290.87	1288.22	1385.43	1305.54	1299.17	1296.20	1277.75	1374.13	1250.77	1261.06	1370.44	1335.10	1276.83	1309.76	01 AI	yi-lightning	11/22/2024	-	Proprietary	29336.00
30.00	Gemini-1.5-Flash-Exp-0827	1269.10	1239.77	1249.00	1238.33	1236.35	1258.39	1273.98	1265.68	1243.37	1285.36	1273.47	1270.42	1358.25	1310.58	1263.58	1250.30	1237.03	1353.35	1260.06	1266.12	1381.20	1367.73	1310.27	1274.50	Google	gemini-1.5-flash-exp-0827	11/22/2024	2023/11	Proprietary	25476.00
30.00	Gemini-1.5-Pro-001	1259.69	1243.34	1272.53	1239.67	1237.97	1262.36	1274.98	1261.99	1237.44	1267.19	1266.40	1260.69	1339.12	1293.64	1258.23	1243.42	1231.20	1329.78	1229.28	1244.89	1380.68	1360.17	1296.79	1237.30	Google	gemini-1.5-pro-001	11/22/2024	2023/11	Proprietary	82614.00
30.00	GPT-4-Turbo-2024-04-09	1256.46	1239.13	1269.88	1241.46	1226.91	1262.81	1266.40	1260.24	1242.22	1267.73	1260.71	1258.09	1332.15	1264.16	1254.30	1248.03	1241.27	1300.99	1228.30	1255.45	1338.17	1320.09	1273.49	1253.66	OpenAI	gpt-4-turbo-2024-04-09	11/22/2024	2023/12	Proprietary	102279.00
31.00	Yi-Lightning-lite	1264.07	1236.77	1247.78	1236.97	1234.59	1267.09	1259.46	1268.10	1245.97	1292.58	1269.95	1265.63	1347.20	1288.51	1271.82	1261.02	1246.88	1320.37	1264.15	1265.79	1364.76	1312.15	1269.56	1273.65	01 AI	yi-lightning-lite	11/22/2024	-	Proprietary	17279.00
32.00	Claude 3 Opus	1247.59	1235.27	1239.58	1238.39	1234.91	1250.19	1240.41	1257.09	1239.46	1277.92	1259.58	1249.21	1316.93	1270.28	1245.63	1228.12	1214.06	1311.39	1229.27	1252.10	1351.13	1323.36	1306.07	1244.45	Anthropic	claude-3-opus-20240229	11/22/2024	2023/8	Proprietary	186718.00
33.00	Athene-v2-Chat-72B	1273.88	1246.81	1208.84	1229.42	1250.34	1288.10	1243.70	1281.52	1284.75	1294.54	1277.85	1274.26	1365.40	1288.99	1297.10	1287.07	1252.05	1343.64	1289.11	1294.03	1335.62	1352.10	1311.07	1257.61	NexusFlow	athene-v2-chat	11/22/2024	-	NexusFlow	4354.00
34.00	GLM-4-Plus	1273.69	1244.84	1237.25	1233.18	1230.98	1283.38	1263.00	1273.22	1245.07	1287.90	1278.89	1274.85	1363.72	1292.04	1274.06	1261.48	1247.44	1348.63	1258.16	1276.59	1352.27	1376.48	1294.46	1298.61	Zhipu AI	glm-4-plus	11/22/2024	-	Proprietary	28133.00
34.00	GPT-4-1106-preview	1249.97	1231.64	1240.75	1234.24	1226.55	1252.87	1247.81	1249.75	1242.20	1260.02	1257.16	1251.29	1318.33	1248.13	1246.43	1238.67	1231.58	1299.19	1241.61	1247.22	1336.17	1319.41	1271.54	1259.57	OpenAI	gpt-4-1106-preview	11/22/2024	2023/4	Proprietary	103847.00
35.00	GPT-4o-mini-2024-07-18	1272.85	1244.38	1242.13	1232.72	1221.60	1284.42	1267.56	1266.31	1231.69	1291.37	1277.67	1273.80	1362.52	1294.90	1268.12	1257.65	1253.64	1322.59	1248.14	1268.10	1358.49	1332.45	1292.77	1275.37	OpenAI	gpt-4o-mini-2024-07-18	11/22/2024	2023/10	Proprietary	51690.00
35.00	Qwen-Max-0919	1263.38	1244.14	1233.61	1229.84	1232.93	1279.92	1249.51	1271.85	1245.42	1280.52	1268.94	1265.07	1345.22	1296.47	1273.57	1265.24	1243.89	1309.57	1272.63	1249.82	1353.08	1290.50	1291.15	1277.53	Alibaba	qwen-max-0919	11/22/2024	-	Qwen	17630.00
36.00	GPT-4-0125-preview	1244.92	1221.13	1237.10	1230.38	1218.08	1243.61	1238.02	1244.61	1236.45	1255.03	1251.13	1246.39	1311.48	1249.19	1241.42	1234.38	1226.40	1295.67	1233.61	1237.51	1341.53	1311.57	1261.03	1244.25	OpenAI	gpt-4-0125-preview	11/22/2024	2023/12	Proprietary	97195.00
36.00	Mistral-Large-2407	1251.32	1243.05	1237.76	1230.43	1231.08	1269.00	1244.89	1256.26	1231.66	1262.36	1255.75	1252.61	1326.83	1269.94	1259.39	1253.34	1238.37	1297.91	1229.94	1249.65	1339.38	1316.53	1276.05	1232.83	Mistral	mistral-large-2407	11/22/2024	2024/7	Mistral Research	48270.00
37.00	Gemini-1.5-Flash-002	1271.36	1208.40	1246.21	1227.78	1214.32	1253.48	1284.18	1266.27	1236.77	1258.27	1277.21	1272.68	1359.92	1293.08	1255.39	1243.42	1239.84	1348.39	1214.06	1268.72	1398.82	1338.20	1307.44	1235.85	Google	gemini-1.5-flash-002	11/22/2024	-	Proprietary	21071.00
42.00	Deepseek-v2.5	1257.50	1254.81	1212.86	1223.60	1233.57	1288.43	1237.31	1259.78	1242.73	1263.73	1262.01	1258.43	1336.64	1280.49	1273.10	1262.70	1238.25	1336.69	1234.93	1226.66	1341.63	1324.53	1273.39	1254.64	DeepSeek	deepseek-v2.5	11/22/2024	-	DeepSeek	26023.00
42.00	Grok-2-Mini-08-13	1266.76	1229.15	1225.83	1223.31	1220.51	1261.99	1248.39	1257.38	1237.83	1267.45	1271.06	1267.95	1352.08	1276.38	1260.61	1254.12	1252.31	1319.04	1238.32	1270.68	1355.38	1329.13	1280.34	1262.61	xAI	grok-2-mini-2024-08-13	11/22/2024	2024/3	Proprietary	42192.00
43.00	Athene-70B	1250.13	1233.79	1219.41	1221.83	1224.38	1253.73	1238.55	1234.30	1200.99	1255.17	1253.87	1250.47	1326.97	1241.49	1247.19	1241.21	1237.76	1294.27	1238.59	1244.95	1286.08	1297.95	1272.07	1246.91	NexusFlow	athene-70b-0725	11/22/2024	2024/7	CC-BY-NC-4.0	20689.00
43.00	Qwen2.5-72B-Instruct	1258.60	1244.59	1215.32	1221.84	1226.04	1281.52	1233.97	1265.20	1249.04	1274.52	1263.37	1259.88	1337.89	1290.87	1268.71	1258.61	1238.55	1328.41	1238.71	1232.65	1327.91	1332.76	1278.11	1262.33	Alibaba	qwen2.5-72b-instruct	11/22/2024	2024/9	Qwen	26302.00
45.00	Llama-3.1-Nemotron-70B-Instruct	1268.99	1230.50	1227.25	1214.83	1224.18	1272.97	1269.56	1263.36	1247.44	1278.38	1273.14	1270.36	1357.36	1252.01	1267.82	1267.02	1264.12	1318.34	1277.82	1306.84	1344.57	1255.43	1251.55	1292.50	Nvidia	llama-3.1-nemotron-70b-instruct	11/22/2024	2023/12	Llama 3.1	7270.00
47.00	Gemini-1.5-Pro-Preview-0409	1257.43	1204.53	1255.57	1217.06	1199.39	1231.34	1274.40	1248.64	1213.14	1254.82	1261.00	1259.40	1330.15	1247.73	1232.56	1220.08	1233.48	1315.13	1257.44	1253.83	1347.20	1415.00	1302.40	1265.21	Google	gemini-1.5-pro-api-0409-preview	11/22/2024	2023/11	Proprietary	55539.00
51.00	Meta-Llama-3.1-70B-Instruct	1247.28	1218.78	1214.80	1212.64	1210.46	1250.24	1238.35	1240.88	1221.38	1259.69	1250.95	1248.30	1321.19	1249.09	1243.17	1243.77	1245.93	1274.03	1204.67	1218.72	1282.77	1281.65	1255.32	1245.67	Meta	llama-3.1-70b-instruct	11/22/2024	2023/12	Llama 3.1 Community	47975.00
52.00	Llama-3.1-Nemotron-51B-Instruct	1211.69	1192.91	1213.30	1203.87	1192.97	1211.16	1214.45	1209.86	1202.53	1229.53	1216.29	1212.94	1263.73	1216.43	1207.57	1189.82	1217.01	1238.18	1225.68	1170.95	1206.51	1241.40	1209.17	1223.25	Nvidia	llama-3.1-nemotron-51b-instruct	11/22/2024	2023/12	Llama 3.1	3942.00
52.00	Qwen-Plus-0828	1227.50	1216.64	1212.94	1205.31	1208.12	1245.59	1219.23	1235.10	1216.96	1248.79	1232.19	1229.01	1284.62	1266.38	1241.78	1235.04	1217.58	1313.47	1166.47	1181.24	1294.86	1269.00	1268.73	1242.63	Alibaba	qwen-plus-0828	11/22/2024	-	Proprietary	14730.00
52.00	Yi-Large-preview	1239.69	1209.10	1205.75	1206.05	1205.53	1245.07	1240.44	1236.21	1218.67	1235.11	1243.92	1241.47	1309.45	1246.75	1239.71	1228.97	1216.44	1316.16	1203.23	1225.34	1357.19	1286.16	1271.50	1243.27	01 AI	yi-large-preview	11/22/2024	Unknown	Proprietary	51704.00
53.00	Jamba-1.5-Large	1221.05	1207.88	1214.99	1203.68	1192.90	1228.22	1217.50	1220.69	1190.00	1223.37	1224.84	1221.47	1277.89	1214.36	1219.41	1215.23	1217.30	1260.95	1200.12	1196.29	1267.34	1281.95	1215.08	1245.56	AI21 Labs	jamba-1.5-large	11/22/2024	2024/3	Jamba Open	9178.00
55.00	Deepseek-v2-API-0628	1219.51	1222.37	1199.55	1201.49	1210.84	1241.92	1207.81	1221.53	1216.86	1229.17	1223.34	1220.89	1275.12	1243.43	1233.84	1223.84	1198.50	1282.71	1201.54	1201.22	1303.26	1272.45	1259.25	1216.41	DeepSeek AI	deepseek-v2-api-0628	11/22/2024	-	DeepSeek	19598.00
55.00	Gemini-1.5-Flash-001	1226.80	1207.64	1216.71	1203.00	1200.34	1231.73	1228.05	1222.47	1199.32	1232.19	1232.22	1227.38	1287.85	1262.99	1224.63	1210.68	1200.25	1291.08	1197.47	1211.30	1331.03	1334.15	1259.11	1222.68	Google	gemini-1.5-flash-001	11/22/2024	2023/11	Proprietary	65786.00
55.00	Gemma-2-27B-it	1219.23	1202.23	1240.15	1205.58	1192.35	1209.54	1241.89	1214.09	1185.15	1226.41	1224.20	1220.07	1274.64	1235.25	1203.98	1191.68	1193.99	1277.48	1183.56	1205.81	1321.73	1313.86	1254.62	1226.33	Google	gemma-2-27b-it	11/22/2024	2024/6	Gemma license	57595.00
55.00	Gemma-2-9B-it-SimPO	1215.58	1179.86	1236.31	1198.42	1186.00	1197.24	1242.43	1203.36	1145.43	1225.38	1218.75	1216.68	1269.05	1237.74	1203.26	1187.04	1195.74	1283.22	1183.10	1215.00	1291.08	1265.41	1247.76	1202.61	Princeton	gemma-2-9b-it-simpo	11/22/2024	2024/7	MIT	10609.00
55.00	Reka-Core-20240722	1230.55	1191.78	1221.98	1203.94	1186.88	1208.97	1241.05	1213.01	1187.04	1237.42	1234.24	1230.92	1293.45	1232.98	1205.81	1192.19	1204.97	1300.88	1232.70	1209.63	1308.66	1332.77	1267.18	1220.96	Reka AI	reka-core-20240722	11/22/2024	-	Proprietary	13330.00
56.00	GPT-4-0314	1186.21	1202.23	1202.97	1199.72	1202.90	1195.44	1189.49	1204.57	1194.01	1201.18	1189.21	1187.33	1222.96	1200.47	1195.85	1183.65	1164.37	1236.88	1178.12	1198.04	1275.80	1235.26	1219.21	1196.44	OpenAI	gpt-4-0314	11/22/2024	2021/9	Proprietary	55965.00
57.00	Command R+ (08-2024)	1214.99	1166.05	1214.34	1196.58	1171.35	1181.42	1235.13	1206.08	1163.25	1216.54	1222.29	1216.39	1265.92	1242.23	1188.81	1178.04	1189.14	1284.06	1160.56	1212.72	1311.85	1312.91	1248.72	1227.74	Cohere	command-r-plus-08-2024	11/22/2024	2024/8	CC-BY-NC-4.0	10604.00
57.00	Deepseek-Coder-v2-0724	1214.14	1243.71	1186.55	1196.72	1210.20	1266.78	1190.01	1221.24	1210.92	1218.37	1221.27	1215.79	1266.34	1254.13	1235.13	1233.86	1194.89	1286.30	1185.87	1201.12	1293.85	1256.13	1242.03	1200.24	DeepSeek	deepseek-coder-v2-0724	11/22/2024	-	Proprietary	11769.00
57.00	Qwen2.5-Coder-32B-Instruct	1219.53	1227.37	1155.96	1191.06	1233.58	1263.55	1175.65	1243.51	1240.95	1219.06	1224.31	1220.90	1269.49	1269.78	1272.89	1270.91	1205.88	1270.52	1176.76	1201.12	1292.68	1285.62	1237.65	1207.54	Alibaba	qwen2.5-coder-32b-instruct	11/22/2024	-	Apache 2.0	2410.00
59.00	Claude 3 Sonnet	1200.93	1201.22	1197.32	1197.03	1190.35	1212.93	1187.63	1204.64	1181.68	1226.73	1209.18	1201.99	1246.20	1222.39	1198.98	1186.59	1175.27	1245.31	1181.31	1198.84	1287.05	1263.98	1247.23	1205.29	Anthropic	claude-3-sonnet-20240229	11/22/2024	2023/8	Proprietary	113046.00
60.00	Nemotron-4-340B-Instruct	1209.02	1187.18	1192.76	1195.95	1188.88	1197.95	1207.52	1212.08	1185.93	1217.01	1213.20	1210.21	1261.27	1231.94	1202.17	1184.69	1186.62	1270.40	1149.20	1187.41	1278.87	1282.75	1243.50	1194.39	Nvidia	nemotron-4-340b-instruct	11/22/2024	2023/6	NVIDIA Open Model	20637.00
61.00	Yi-Large	1212.52	1194.72	1190.25	1194.25	1185.19	1219.70	1202.59	1208.09	1195.39	1219.82	1219.14	1213.30	1266.71	1218.40	1208.59	1197.64	1194.73	1267.67	1168.81	1197.81	1311.29	1264.70	1244.32	1208.47	01 AI	yi-large	11/22/2024	Unknown	Proprietary	16668.00
64.00	Llama-3-70B-Instruct	1206.45	1190.78	1207.72	1194.51	1187.31	1199.61	1213.70	1199.18	1188.73	1224.81	1208.90	1206.75	1257.83	1185.61	1197.03	1211.70	1226.31	1175.93	1184.70	1166.30	1177.14	1169.20	1186.77	1240.62	Meta	llama-3-70b-instruct	11/22/2024	2023/12	Llama 3 Community	163859.00
68.00	GLM-4-0520	1206.47	1191.78	1192.61	1187.63	1188.93	1215.97	1197.80	1209.06	1187.99	1221.28	1209.69	1207.47	1257.18	1217.50	1213.28	1201.27	1190.13	1289.08	1160.90	1177.65	1271.89	1189.90	1234.98	1219.62	Zhipu AI	glm-4-0520	11/22/2024	Unknown	Proprietary	10224.00
73.00	Aya-Expanse-32B	1207.43	1178.06	1175.43	1182.41	1181.34	1188.81	1200.56	1206.70	1176.28	1196.17	1212.93	1209.08	1252.84	1240.78	1197.94	1175.82	1178.33	1269.72	1186.93	1184.93	1304.91	1292.80	1241.13	1194.01	Cohere	c4ai-aya-expanse-32b	11/22/2024	-	CC-BY-NC-4.0	16701.00
73.00	GPT-4-0613	1163.09	1179.74	1211.42	1185.54	1181.90	1166.89	1187.32	1188.48	1178.12	1174.36	1168.56	1164.15	1187.47	1193.48	1167.94	1164.00	1147.97	1182.37	1123.28	1156.39	1267.98	1205.19	1195.23	1167.42	OpenAI	gpt-4-0613	11/22/2024	2021/9	Proprietary	91629.00
74.00	Gemini App (2024-01-24)	1208.53	1161.65	1168.32	1179.83	1141.53	1171.15	1193.14	1158.30	1134.92	1198.02	1212.53	1207.98	1248.94	1133.42	1156.27	1141.59	1181.85	1274.97	1263.64	1243.35	1332.85	1409.16	1259.44	1225.54	Google	bard-jan-24-gemini-pro	11/22/2024	Online	Proprietary	11820.00
74.00	Command R+ (04-2024)	1189.82	1154.01	1186.21	1182.69	1159.78	1164.32	1199.40	1187.13	1136.98	1196.90	1194.26	1191.22	1231.65	1214.81	1168.75	1154.10	1163.05	1253.70	1161.02	1188.85	1305.05	1271.57	1224.51	1181.32	Cohere	command-r-plus	11/22/2024	2024/3	CC-BY-NC-4.0	80872.00
74.00	DeepSeek-Coder-V2-Instruct	1178.23	1225.37	1158.85	1181.45	1196.80	1238.96	1128.22	1189.28	1211.24	1180.45	1204.85	1179.53	1211.86	1224.65	1211.00	1202.71	1150.18	1259.12	1138.74	1158.74	1283.47	1247.18	1210.11	1152.23	DeepSeek AI	deepseek-coder-v2	11/22/2024	2024/6	DeepSeek License	15792.00
74.00	Qwen2-72B-Instruct	1187.12	1178.25	1176.79	1180.57	1178.12	1186.77	1183.36	1190.27	1202.70	1196.98	1192.36	1187.99	1225.39	1200.59	1189.19	1184.61	1171.16	1293.05	1128.55	1146.08	1265.30	1224.70	1194.90	1171.28	Alibaba	qwen2-72b-instruct	11/22/2024	2024/6	Qianwen LICENSE	38976.00
74.00	Reka-Flash-20240722	1200.96	1173.62	1178.53	1180.07	1164.87	1187.55	1197.52	1188.07	1161.15	1197.93	1204.99	1200.79	1245.17	1194.52	1178.31	1168.01	1174.05	1270.20	1198.28	1202.29	1290.11	1287.53	1248.03	1213.23	Reka AI	reka-flash-20240722	11/22/2024	-	Proprietary	13775.00
77.00	Gemini-1.5-Flash-8B-001	1210.72	1163.60	1188.89	1176.43	1171.75	1204.64	1219.02	1209.34	1182.23	1190.15	1216.53	1211.75	1259.47	1230.11	1209.23	1192.75	1180.38	1283.53	1194.54	1188.75	1283.16	1289.12	1255.31	1211.61	Google	gemini-1.5-flash-8b-001	11/22/2024	-	Proprietary	22443.00
78.00	Command R (08-2024)	1179.48	1160.54	1168.54	1175.47	1165.01	1161.71	1179.24	1179.43	1129.74	1168.14	1184.78	1180.64	1203.79	1211.45	1169.42	1159.10	1154.71	1241.89	1139.46	1170.51	1294.65	1291.06	1200.79	1168.85	Cohere	command-r-08-2024	11/22/2024	2024/8	CC-BY-NC-4.0	10922.00
78.00	Gemma-2-9B-it	1190.03	1164.58	1208.67	1177.22	1160.46	1169.22	1209.00	1183.82	1152.76	1194.07	1194.48	1190.44	1227.00	1206.00	1170.24	1157.72	1168.10	1243.16	1148.42	1180.80	1288.64	1273.72	1220.22	1199.08	Google	gemma-2-9b-it	11/22/2024	2024/6	Gemma license	41124.00
79.00	Claude 3 Haiku	1179.30	1183.31	1170.04	1177.18	1174.12	1189.42	1162.92	1182.06	1159.66	1191.91	1188.32	1179.60	1213.86	1199.65	1178.03	1167.78	1157.38	1211.50	1150.27	1169.72	1255.61	1250.64	1224.41	1169.56	Anthropic	claude-3-haiku-20240307	11/22/2024	2023/8	Proprietary	122399.00
79.00	Reka-Core-20240501	1199.47	1172.32	1181.27	1176.88	1167.77	1189.93	1195.89	1186.05	1159.19	1188.78	1203.76	1200.95	1246.09	1192.57	1186.73	1173.43	1175.97	1260.60	1178.70	1197.63	1283.05	1272.35	1229.47	1189.11	Reka AI	reka-core-20240501	11/22/2024	-	Proprietary	62589.00
83.00	Gemini-1.5-Flash-8B-Exp-0827	1205.13	1160.80	1184.29	1171.79	1162.04	1189.68	1213.66	1199.23	1172.53	1201.30	1209.49	1205.84	1251.47	1232.30	1196.06	1181.82	1176.33	1273.77	1193.99	1181.34	1302.92	1301.42	1251.14	1220.76	Google	gemini-1.5-flash-8b-exp-0827	11/22/2024	2023/11	Proprietary	25472.00
83.00	Qwen-Max-0428	1182.98	1174.79	1164.38	1171.24	1167.90	1189.53	1177.52	1180.11	1167.46	1175.17	1186.71	1183.74	1219.69	1197.94	1186.29	1177.93	1167.86	1293.35	1162.95	1130.27	1264.97	1218.62	1179.45	1153.78	Alibaba	qwen-max-0428	11/22/2024	-	Proprietary	25707.00
91.00	GLM-4-0116	1183.31	1167.19	1169.91	1162.76	1164.66	1190.53	1180.52	1180.84	1161.88	1181.26	1186.50	1185.95	1221.24	1193.50	1186.73	1176.60	1176.72	1275.18	1131.03	1153.79	1244.78	1147.18	1182.20	1201.33	Zhipu AI	glm-4-0116	11/22/2024	Unknown	Proprietary	7582.00
91.00	Ministral-8B-2410	1183.21	1172.31	1170.45	1159.63	1166.83	1201.55	1177.14	1178.93	1166.43	1174.05	1187.64	1183.09	1207.75	1226.98	1198.47	1196.29	1171.47	1249.40	1141.27	1127.64	1286.77	1220.16	1222.07	1119.70	Mistral	ministral-8b-2410	11/22/2024	-	MRL	4587.00
92.00	Claude-1	1148.84	1149.25	1163.98	1158.81	1135.05	1135.73	1134.22	1141.31	1114.62	1171.58	1165.98	1148.35	1167.72	1163.01	1125.68	1116.95	1129.38	1194.90	1115.79	1173.01	1230.30	1102.01	1192.91	1170.79	Anthropic	claude-1	11/22/2024	-	Proprietary	21154.00
92.00	Hunyuan-Standard-256K	1188.00	1190.86	1153.12	1149.65	1180.11	1224.90	1176.72	1209.11	1204.50	1179.89	1194.18	1190.81	1222.55	1234.23	1218.87	1210.95	1168.75	1294.48	1171.69	1140.36	1253.88	1234.25	1188.27	1286.23	Tencent	hunyuan-standard-256k	11/22/2024	-	Proprietary	2934.00
92.00	Jamba-1.5-Mini	1176.25	1164.71	1167.74	1159.24	1145.90	1181.46	1172.38	1158.59	1132.34	1162.74	1180.25	1176.64	1202.81	1170.99	1168.98	1165.88	1177.79	1197.20	1135.29	1158.83	1174.23	1183.06	1179.84	1221.47	AI21 Labs	jamba-1.5-mini	11/22/2024	2024/3	Jamba Open	9302.00
92.00	Mistral-Large-2402	1157.16	1169.98	1158.80	1157.57	1164.11	1169.50	1159.15	1172.47	1164.97	1165.71	1159.31	1158.43	1180.95	1176.85	1165.23	1157.12	1146.08	1178.19	1162.26	1173.72	1174.00	1159.56	1195.65	1193.03	Mistral	mistral-large-2402	11/22/2024	-	Proprietary	64909.00
93.00	Qwen1.5-110B-Chat	1161.50	1163.17	1146.90	1155.29	1154.36	1174.55	1150.10	1163.19	1150.70	1158.85	1164.74	1161.42	1184.89	1166.65	1168.77	1166.78	1150.59	1259.74	1106.50	1117.57	1227.80	1187.86	1144.42	1144.19	Alibaba	qwen1.5-110b-chat	11/22/2024	2024/4	Qianwen LICENSE	27472.00
95.00	Reka-Flash-21B-online	1155.82	1145.03	1130.58	1151.04	1143.80	1146.66	1131.03	1137.90	1140.07	1149.34	1157.95	1155.68	1179.28	1151.04	1142.61	1133.01	1135.89	1196.24	1110.49	1148.13	1231.51	1244.27	1189.55	1144.50	Reka AI	reka-flash-21b-20240226-online	11/22/2024	Online	Proprietary	16025.00
95.00	Reka-Flash-Preview-20240611	1165.05	1145.82	1148.56	1151.39	1136.33	1155.00	1158.34	1146.43	1126.89	1148.59	1168.25	1165.29	1189.55	1147.04	1144.28	1130.70	1141.76	1218.38	1141.03	1161.21	1250.78	1249.67	1195.86	1174.97	Reka AI	reka-flash-preview-20240611	11/22/2024	-	Proprietary	20458.00
97.00	Mistral-Next	1124.32	1154.56	1164.52	1149.28	1148.29	1132.42	1135.19	1157.78	1139.91	1137.16	1126.25	1124.81	1130.70	1150.33	1128.90	1121.31	1110.03	1134.50	1111.80	1154.91	1138.21	1041.58	1172.72	1129.53	Mistral	mistral-next	11/22/2024	-	Proprietary	12375.00
98.00	Claude-2.0	1131.76	1152.57	1143.79	1145.72	1141.23	1135.08	1101.64	1130.31	1126.52	1161.13	1150.34	1131.72	1140.23	1146.54	1126.12	1119.33	1114.03	1189.34	1102.71	1152.39	1215.07	1150.34	1204.30	1137.57	Anthropic	claude-2.0	11/22/2024	-	Proprietary	12758.00
98.00	GPT-3.5-Turbo-0314	1106.51	1143.37	1135.07	1141.33	1138.19	1114.98	1088.92	1148.54	1139.82	1107.66	1114.24	1106.27	1096.48	1116.97	1116.73	1096.85	1081.57	1204.14	1149.13	1151.74	1283.86	1220.92	1166.58	1164.82	OpenAI	gpt-3.5-turbo-0314	11/22/2024	2021/9	Proprietary	5644.00
98.00	Mixtral-8x22b-Instruct-v0.1	1147.53	1151.55	1147.04	1149.27	1146.51	1152.59	1146.86	1154.79	1152.66	1131.01	1150.64	1148.44	1163.71	1155.52	1148.49	1142.98	1136.48	1177.48	1122.28	1138.92	1195.10	1197.32	1179.80	1143.42	Mistral	mixtral-8x22b-instruct-v0.1	11/22/2024	2024/4	Apache 2.0	53819.00
99.00	Gemini-1.0-Pro-001	1131.36	1119.34	1152.88	1146.80	1124.77	1102.66	1133.63	1118.76	1098.90	1119.26	1133.38	1130.51	1144.57	1143.75	1105.62	1095.34	1108.41	1181.21	1102.23	1124.65	1200.02	1220.67	1207.51	1127.06	Google	gemini-pro-dev-api	11/22/2024	2023/4	Proprietary	18783.00
100.00	Qwen1.5-72B-Chat	1147.33	1156.59	1136.51	1147.75	1142.54	1159.93	1135.57	1144.12	1128.37	1153.74	1150.40	1147.23	1166.03	1165.58	1146.69	1140.79	1135.10	1240.44	1112.84	1077.87	1218.58	1189.78	1127.98	1110.61	Alibaba	qwen1.5-72b-chat	11/22/2024	2024/2	Qianwen LICENSE	40618.00
101.00	Command R (04-2024)	1148.64	1124.60	1153.09	1147.78	1122.70	1122.87	1159.14	1132.28	1089.23	1148.62	1150.82	1148.45	1167.83	1167.04	1119.37	1105.67	1123.26	1208.61	1112.69	1123.20	1247.19	1239.12	1183.95	1150.38	Cohere	command-r	11/22/2024	2024/3	CC-BY-NC-4.0	56387.00
104.00	Reka-Flash-21B	1147.53	1138.50	1128.56	1141.52	1134.61	1141.12	1128.48	1129.59	1123.53	1142.02	1150.58	1147.16	1165.31	1150.95	1133.60	1126.77	1126.03	1193.57	1129.82	1150.50	1211.73	1217.07	1181.35	1140.97	Reka AI	reka-flash-21b-20240226	11/22/2024	2023/11	Proprietary	25800.00
105.00	Mistral Medium	1147.76	1141.71	1147.19	1141.09	1136.89	1152.50	1160.60	1153.52	1139.36	1145.33	1148.30	1148.16	1167.75	1162.62	1144.07	1131.97	1137.93	1164.81	1133.58	1149.54	1182.65	1164.05	1189.58	1143.49	Mistral	mistral-medium	11/22/2024	-	Proprietary	35541.00
106.00	Llama-3-8B-Instruct	1151.96	1138.48	1150.99	1142.03	1128.98	1145.93	1154.85	1136.67	1118.79	1153.06	1154.41	1150.88	1170.98	1136.15	1137.02	1144.19	1163.62	1135.09	1113.82	1101.65	1138.21	1150.03	1138.49	1173.65	Meta	llama-3-8b-instruct	11/22/2024	2023/3	Llama 3 Community	109293.00
110.00	GPT-3.5-Turbo-0125	1105.80	1146.02	1145.28	1137.13	1130.76	1123.65	1099.15	1125.14	1109.60	1115.05	1111.91	1105.52	1100.16	1136.89	1111.97	1106.07	1086.84	1130.70	1073.63	1091.63	1204.23	1168.57	1147.21	1117.25	OpenAI	gpt-3.5-turbo-0125	11/22/2024	2021/9	Proprietary	68870.00
110.00	GPT-3.5-Turbo-0613	1116.77	1146.99	1130.65	1136.73	1134.49	1134.79	1109.74	1128.49	1107.20	1117.25	1123.79	1116.67	1120.14	1125.55	1123.07	1115.83	1098.16	1156.87	1099.36	1121.19	1209.42	1201.53	1183.88	1119.88	OpenAI	gpt-3.5-turbo-0613	11/22/2024	2021/9	Proprietary	38944.00
110.00	Zephyr-ORPO-141b-A35b-v0.1	1127.01	1126.00	1117.77	1130.23	1119.12	1124.11	1114.71	1128.50	1118.54	1103.52	1129.00	1127.13	1136.94	1119.23	1116.72	1113.02	1118.81	1142.89	1139.84	1089.62	1186.48	1170.63	1140.76	1103.70	HuggingFace	zephyr-orpo-141b-A35b-v0.1	11/22/2024	2024/4	Apache 2.0	4854.00
111.00	Claude-2.1	1118.17	1151.93	1097.08	1134.77	1135.56	1131.65	1048.11	1109.58	1122.72	1158.83	1136.99	1117.61	1122.53	1133.19	1118.96	1107.67	1096.80	1146.75	1139.32	1136.97	1208.51	1150.45	1174.42	1122.08	Anthropic	claude-2.1	11/22/2024	-	Proprietary	37683.00
111.00	Gemini Pro	1110.62	1111.16	1130.92	1131.21	1113.40	1091.48	1103.10	1103.21	1086.20	1143.09	1115.56	1109.77	1111.61	1125.49	1083.14	1080.18	1097.67	1152.08	1059.17	1017.71	1212.07	1294.62	1152.22	1086.20	Google	gemini-pro	11/22/2024	2023/4	Proprietary	6558.00
113.00	Meta-Llama-3.1-8B-Instruct	1175.26	1144.01	1132.35	1131.06	1141.64	1186.12	1160.97	1171.81	1152.33	1173.42	1179.36	1175.69	1200.68	1197.23	1182.52	1182.44	1170.85	1209.21	1144.07	1141.53	1211.69	1205.57	1185.20	1176.86	Meta	llama-3.1-8b-instruct	11/22/2024	2023/12	Llama 3.1 Community	46435.00
113.00	Yi-1.5-34B-Chat	1157.11	1134.84	1119.83	1132.65	1135.41	1162.19	1144.38	1147.28	1150.08	1158.15	1160.19	1157.44	1178.85	1158.70	1159.92	1159.78	1163.25	1266.67	1111.43	1106.32	1179.49	1149.70	1118.78	1124.20	01 AI	yi-1.5-34b-chat	11/22/2024	2024/5	Apache-2.0	25142.00
117.00	Claude-Instant-1	1111.10	1130.19	1104.82	1126.85	1124.09	1108.78	1060.08	1107.06	1111.24	1146.78	1129.78	1110.67	1110.10	1133.54	1106.88	1100.07	1096.86	1145.28	1080.03	1104.64	1192.74	1139.68	1130.46	1099.73	Anthropic	claude-instant-1	11/22/2024	-	Proprietary	20619.00
117.00	Qwen1.5-32B-Chat	1125.31	1144.47	1087.81	1126.41	1131.07	1149.19	1088.69	1122.19	1125.11	1137.88	1128.26	1124.75	1130.67	1157.80	1135.68	1130.37	1109.72	1234.84	1059.50	1053.59	1188.90	1150.29	1096.95	1087.69	Alibaba	qwen1.5-32b-chat	11/22/2024	2024/2	Qianwen LICENSE	22749.00
123.00	DBRX-Instruct-Preview	1103.10	1123.81	1111.15	1113.33	1115.18	1117.86	1102.50	1114.32	1108.40	1102.09	1105.05	1103.17	1096.30	1124.97	1109.40	1110.09	1103.62	1121.23	1051.05	1061.53	1154.61	1136.54	1096.38	1065.70	Databricks	dbrx-instruct-preview	11/22/2024	2023/12	DBRX LICENSE	33724.00
123.00	Gemma-2-2b-it	1140.44	1087.09	1128.68	1113.09	1094.87	1104.15	1145.23	1124.77	1108.98	1116.74	1144.72	1140.33	1140.71	1141.88	1114.60	1110.98	1131.39	1186.80	1123.65	1109.03	1233.16	1200.48	1139.49	1136.44	Google	gemma-2-2b-it	11/22/2024	2024/7	Gemma license	32637.00
123.00	Granite-3.0-8B-Instruct	1094.80	1113.67	1104.04	1110.35	1120.27	1098.72	1090.56	1111.83	1125.59	1070.12	1098.27	1095.93	1066.95	1142.35	1110.06	1116.72	1110.56	1129.50	1026.24	984.50	1158.61	1115.45	1102.02	1032.00	IBM	granite-3.0-8b-instruct	11/22/2024	-	Apache 2.0	7101.00
123.00	InternLM2.5-20B-chat	1149.37	1136.21	1094.78	1115.77	1142.18	1158.65	1134.53	1153.32	1158.63	1139.08	1154.79	1149.81	1153.23	1170.81	1166.21	1176.04	1156.68	1260.49	1028.34	1058.98	1194.57	1164.13	1139.37	1123.35	InternLM	internlm2_5-20b-chat	11/22/2024	2024/8	Other	10710.00
123.00	Mixtral-8x7B-Instruct-v0.1	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	Mistral	mixtral-8x7b-instruct-v0.1	11/22/2024	2023/12	Apache 2.0	76133.00
123.00	Phi-3-Medium-4k-Instruct	1122.96	1115.21	1105.84	1117.93	1121.34	1125.20	1111.86	1123.17	1141.57	1095.06	1126.46	1123.44	1118.41	1132.76	1129.58	1126.85	1118.00	1165.00	1071.24	1100.94	1197.93	1109.20	1169.58	1094.28	Microsoft	phi-3-medium-4k-instruct	11/22/2024	2023/10	MIT	26140.00
125.00	GPT-3.5-Turbo-1106	1067.73	1125.57	1109.08	1109.95	1118.08	1094.98	1043.59	1090.80	1104.61	1070.91	1081.29	1067.27	1046.09	1088.64	1090.88	1088.69	1052.41	1076.12	1021.32	1066.38	1208.32	1098.01	1105.15	1090.65	OpenAI	gpt-3.5-turbo-1106	11/22/2024	2021/9	Proprietary	17026.00
125.00	Qwen1.5-14B-Chat	1108.83	1118.60	1092.12	1106.72	1109.70	1125.80	1095.20	1102.77	1090.75	1108.85	1111.19	1107.60	1105.73	1125.84	1116.59	1110.09	1095.49	1202.42	1069.40	1042.48	1189.79	1150.32	1072.39	1078.36	Alibaba	qwen1.5-14b-chat	11/22/2024	2024/2	Qianwen LICENSE	18663.00
125.00	WizardLM-70B-v1.0	1105.98	1070.73	1149.21	1104.40	1074.57	1070.99	1151.88	1102.18	1075.87	1108.95	1102.96	1105.30	1105.37	1104.61	1077.20	1072.39	1097.73	1113.26	1034.68	1084.03	1168.47	1066.79	1166.05	1083.35	Microsoft	wizardlm-70b	11/22/2024	2023/8	Llama 2 Community	8380.00
128.00	Snowflake Arctic Instruct	1090.02	1092.38	1095.86	1102.49	1088.74	1076.87	1085.30	1077.75	1080.45	1070.44	1092.01	1088.92	1072.69	1018.38	1073.74	1066.25	1077.70	1129.02	1087.38	1077.91	1135.60	1090.40	1126.55	1089.56	Snowflake	snowflake-arctic-instruct	11/22/2024	2024/4	Apache 2.0	34150.00
128.00	Yi-34B-Chat	1111.08	1090.47	1107.90	1100.79	1090.01	1106.03	1110.74	1094.08	1079.06	1110.38	1115.29	1110.85	1111.85	1105.24	1101.85	1097.25	1106.11	1231.45	1046.94	1038.56	1174.11	1095.44	1079.10	1069.97	01 AI	yi-34b-chat	11/22/2024	2023/6	Yi License	15925.00
129.00	OpenChat-3.5-0106	1091.39	1106.62	1102.93	1100.35	1088.60	1102.21	1098.60	1081.59	1071.62	1092.16	1090.76	1089.89	1081.48	1096.73	1083.89	1073.71	1080.57	1137.85	1047.56	1066.45	1128.01	1043.12	1107.02	1101.17	OpenChat	openchat-3.5-0106	11/22/2024	2024/1	Apache-2.0	12968.00
131.00	Gemma-1.1-7B-it	1083.53	1106.29	1104.10	1098.02	1095.60	1084.32	1069.99	1071.50	1079.16	1043.62	1086.47	1081.30	1061.44	1072.38	1076.92	1077.23	1078.70	1118.48	1020.86	1050.19	1133.64	1137.90	1076.26	1051.07	Google	gemma-1.1-7b-it	11/22/2024	2024/2	Gemma license	25071.00
131.00	Meta-Llama-3.2-3B-Instruct	1102.52	1047.88	1099.10	1092.73	1084.47	1080.54	1098.43	1106.31	1097.62	1111.17	1106.04	1102.41	1082.95	1119.74	1102.89	1129.65	1140.55	1085.35	1031.52	1052.48	1081.29	1004.14	981.56	1096.72	Meta	llama-3.2-3b-instruct	11/22/2024	2023/12	Llama 3.2	8448.00
131.00	OpenChat-3.5	1076.36	1066.81	1133.55	1094.44	1076.48	1053.56	1126.61	1074.30	1034.67	1087.52	1069.98	1076.36	1062.48	1108.36	1065.10	1055.26	1064.65	1124.82	1065.00	1039.01	1108.92	1097.12	1127.47	1080.63	OpenChat	openchat-3.5	11/22/2024	2023/11	Apache-2.0	8109.00
131.00	Phi-3-Small-8k-Instruct	1101.66	1099.16	1088.13	1098.10	1101.22	1107.12	1087.26	1102.01	1120.41	1071.14	1106.09	1101.94	1085.18	1101.55	1107.41	1111.62	1106.10	1122.55	1092.79	1075.16	1126.97	1053.33	1138.45	1109.57	Microsoft	phi-3-small-8k-instruct	11/22/2024	2023/10	MIT	18504.00
132.00	DeepSeek-LLM-67B-Chat	1076.72	1086.49	1083.01	1090.72	1072.44	1079.07	1065.81	1082.14	1069.94	1077.50	1078.13	1076.68	1065.50	1100.01	1065.06	1059.92	1063.91	1179.27	1000.80	1005.62	1162.32	1170.10	1158.56	1062.53	DeepSeek AI	deepseek-llm-67b-chat	11/22/2024	2023/11	DeepSeek License	4986.00
132.00	Tulu-2-DPO-70B	1099.13	1082.09	1099.63	1092.12	1088.48	1093.05	1109.72	1106.28	1073.84	1082.09	1100.19	1098.84	1093.23	1116.20	1098.11	1099.15	1091.90	1060.19	1088.63	1066.81	1133.35	894.88	1155.89	1119.60	AllenAI/UW	tulu-2-dpo-70b	11/22/2024	2023/11	AI2 ImpACT Low-risk	6662.00
135.00	OpenHermes-2.5-Mistral-7B	1074.27	1066.08	1111.07	1089.54	1077.91	1057.64	1103.06	1074.08	1061.70	1063.53	1069.32	1072.53	1059.57	1069.83	1068.59	1064.34	1071.90	1083.70	1027.89	995.69	1149.28	1172.71	1082.41	1049.70	NousResearch	openhermes-2.5-mistral-7b	11/22/2024	2023/11	Apache-2.0	5087.00
135.00	Starling-LM-7B-beta	1119.04	1111.15	1058.71	1091.42	1103.74	1129.38	1097.55	1104.47	1093.67	1106.78	1120.67	1118.89	1124.15	1120.92	1119.50	1112.09	1107.77	1178.66	1064.76	1076.71	1162.49	1089.68	1123.30	1143.17	Nexusflow	starling-lm-7b-beta	11/22/2024	2024/3	Apache-2.0	16669.00
135.00	Vicuna-33B	1090.62	1068.43	1131.81	1091.36	1066.55	1067.13	1136.36	1073.57	1036.22	1086.77	1087.18	1090.05	1082.50	1043.91	1065.96	1060.84	1086.39	1093.38	1055.25	1055.16	1148.38	978.23	1100.03	1085.01	LMSYS	vicuna-33b	11/22/2024	2023/8	Non-commercial	22942.00
137.00	Granite-3.0-2B-Instruct	1075.33	1096.03	1063.55	1082.72	1095.84	1088.98	1061.78	1083.97	1102.95	1065.01	1077.71	1075.66	1029.81	1102.17	1090.92	1086.93	1081.14	1129.82	1003.03	987.82	1144.38	1081.55	1081.50	1037.79	IBM	granite-3.0-2b-instruct	11/22/2024	-	Apache 2.0	7284.00
137.00	Starling-LM-7B-alpha	1088.21	1076.09	1089.04	1082.90	1070.24	1079.73	1102.03	1073.54	1047.84	1082.59	1084.85	1088.39	1079.14	1092.47	1072.88	1070.18	1083.13	1106.32	1039.60	1028.81	1129.44	1117.76	1110.11	1112.02	UC Berkeley	starling-lm-7b-alpha	11/22/2024	2023/11	CC-BY-NC-4.0	10417.00
142.00	Llama-2-70B-chat	1093.01	1061.50	1065.28	1081.41	1063.16	1072.08	1078.97	1074.90	1058.15	1081.13	1094.52	1091.93	1083.34	1071.70	1070.32	1070.50	1096.53	1056.77	1047.60	1027.40	1110.11	1108.75	1106.21	1137.57	Meta	llama-2-70b-chat	11/22/2024	2023/7	Llama 2 Community	39612.00
142.00	NV-Llama2-70B-SteerLM-Chat	1080.51	1025.62	1077.01	1074.03	1048.56	1022.57	1096.73	1063.32	1036.65	1059.65	1076.40	1079.84	1071.74	1012.21	1045.82	1035.30	1069.38	1086.57	1050.63	1081.88	1115.04	983.08	1139.10	1035.14	Nvidia	llama2-70b-steerlm-chat	11/22/2024	2023/11	Llama 2 Community	3636.00
144.00	Dolphin-2.2.1-Mistral-7B	1062.23	1032.78	1090.13	1068.33	1054.03	1024.54	1090.83	1056.57	1041.45	1018.06	1057.90	1061.45	1039.47	1031.56	1050.15	1043.68	1059.61	1104.71	990.45	937.42	1134.98	963.47	1107.42	988.23	Cognitive Computations	dolphin-2.2.1-mistral-7b	11/22/2024	2023/10	Apache-2.0	1712.00
144.00	Nous-Hermes-2-Mixtral-8x7B-DPO	1084.35	1066.69	1091.32	1071.63	1036.18	1079.46	1106.05	1054.47	1028.22	1079.77	1085.71	1083.77	1074.74	1060.53	1052.13	1045.23	1078.27	1076.47	1078.54	1027.86	1159.02	1173.29	1083.38	1023.78	NousResearch	nous-hermes-2-mixtral-8x7b-dpo	11/22/2024	2024/1	Apache-2.0	3836.00
144.00	pplx-70B-online	1077.81	1034.60	1054.11	1075.66	1030.36	1028.19	1049.96	1032.44	1042.77	986.33	1075.86	1076.95	1065.48	1016.34	1028.20	1025.41	1066.55	1127.60	1046.81	1039.14	1208.27	1194.57	1074.01	1063.46	Perplexity AI	pplx-70b-online	11/22/2024	Online	Proprietary	6892.00
145.00	falcon-180b-chat	1033.69	1040.80	1108.26	1058.79	1019.57	1016.75	1094.81	1052.73	1013.04	1012.16	1030.80	1034.16	1002.29	1055.48	1000.27	1009.50	1026.22	1002.61	950.96	1148.55	1166.19	454.08	863.02	1101.16	TII	falcon-180b-chat	11/22/2024	2023/9	Falcon-180B TII License	1325.00
146.00	SOLAR-10.7B-Instruct-v1.0	1062.00	1052.06	1088.70	1065.66	1055.53	1045.97	1089.58	1058.16	1028.73	1041.64	1058.11	1061.91	1038.94	1134.20	1055.79	1049.64	1060.43	1070.27	1002.26	1015.92	1139.97	934.16	1061.97	1031.18	Upstage AI	solar-10.7b-instruct-v1.0	11/22/2024	2023/11	CC-BY-NC-4.0	4287.00
147.00	Mistral-7B-Instruct-v0.2	1072.26	1066.54	1063.15	1067.18	1063.46	1073.58	1075.49	1067.38	1056.71	1070.18	1072.15	1071.19	1050.18	1071.73	1068.44	1070.81	1081.68	1068.24	984.29	979.31	1042.67	1061.50	1045.14	1024.70	Mistral	mistral-7b-instruct-v0.2	11/22/2024	2023/12	Apache-2.0	20060.00
147.00	MPT-30B-chat	1045.34	1043.84	1085.16	1059.89	1056.04	1030.72	1076.96	1057.36	1014.24	1052.49	1040.02	1043.87	1022.05	1067.04	1047.66	1059.02	1043.52	1024.24	998.95	993.08	1094.38	1016.06	961.40	1049.55	MosaicML	mpt-30b-chat	11/22/2024	2023/6	CC-BY-NC-SA-4.0	2650.00
147.00	Phi-3-Mini-4K-Instruct-June-24	1070.77	1074.00	1059.13	1067.92	1088.85	1082.41	1057.98	1075.06	1123.96	1054.94	1074.51	1071.29	1020.57	1055.78	1095.69	1100.91	1082.19	1093.69	1052.56	1029.02	1124.12	1032.12	1049.24	1134.32	Microsoft	phi-3-mini-4k-instruct-june-2024	11/22/2024	2023/10	MIT	12867.00
147.00	Qwen1.5-7B-Chat	1070.08	1081.67	1035.81	1064.95	1057.99	1088.52	1039.81	1063.75	1048.65	1061.12	1069.77	1068.07	1047.52	1102.45	1066.58	1055.86	1054.53	1196.15	1018.04	1022.59	1177.26	1046.96	1034.03	1015.52	Alibaba	qwen1.5-7b-chat	11/22/2024	2024/2	Qianwen LICENSE	4863.00
148.00	Qwen-14B-Chat	1035.20	1068.25	1057.33	1056.70	1038.33	1056.10	1034.95	1034.34	1033.23	1019.36	1036.89	1033.20	1000.31	1038.52	1023.91	1017.87	1017.26	1136.24	1026.84	1015.24	1172.55	953.71	1081.32	1082.34	Alibaba	qwen-14b-chat	11/22/2024	2023/8	Qianwen LICENSE	5070.00
148.00	Vicuna-13B	1042.10	1042.28	1080.90	1058.59	1035.31	1032.31	1063.77	1040.78	999.52	1033.01	1041.26	1040.40	1010.86	1062.18	1025.33	1017.81	1028.42	1097.63	993.73	992.17	1127.40	1047.34	1072.75	1067.74	LMSYS	vicuna-13b	11/22/2024	2023/7	Llama 2 Community	19782.00
148.00	WizardLM-13b-v1.2	1058.47	1030.36	1091.99	1063.15	1014.49	1025.92	1093.11	1050.85	987.19	1043.06	1057.69	1055.93	1039.35	1066.90	1013.40	1010.49	1050.31	1075.14	1026.78	1031.11	1076.49	1040.04	1082.93	1072.01	Microsoft	wizardlm-13b	11/22/2024	2023/7	Llama 2 Community	7183.00
152.00	Llama-2-13b-chat	1063.13	1041.95	1044.20	1053.61	1043.17	1051.24	1050.10	1046.68	1032.39	1046.03	1068.46	1061.72	1036.76	1077.67	1049.57	1048.69	1060.96	1055.33	990.65	997.75	1062.73	1091.58	1076.03	1075.17	Meta	llama-2-13b-chat	11/22/2024	2023/7	Llama 2 Community	19729.00
152.00	Phi-3-Mini-4k-Instruct	1066.03	1069.17	1029.28	1055.47	1066.05	1085.78	1042.98	1067.33	1084.45	1025.93	1070.04	1064.97	1021.45	1052.43	1078.84	1084.41	1072.49	1081.72	1031.25	1038.46	1099.85	1060.24	1056.56	1092.43	Microsoft	phi-3-mini-4k-instruct	11/22/2024	2023/10	MIT	21114.00
152.00	Zephyr-7B-alpha	1040.79	1039.04	1059.13	1045.50	1025.06	1034.29	1075.95	1041.64	1006.38	1014.25	1032.75	1038.45	1011.94	1010.94	1022.38	1017.88	1039.03	1042.50	1005.15	913.29	1078.42	1302.96	1049.93	1000.42	HuggingFace	zephyr-7b-alpha	11/22/2024	2023/10	MIT	1812.00
154.00	Zephyr-7B-beta	1053.34	1027.79	1096.84	1049.43	1022.54	1029.96	1113.03	1038.58	1010.71	1031.97	1048.50	1051.94	1027.57	1054.17	1026.52	1027.48	1053.33	1018.00	994.38	975.48	1041.85	1026.26	1068.46	1039.66	HuggingFace	zephyr-7b-beta	11/22/2024	2023/10	MIT	11329.00
155.00	CodeLlama-34B-instruct	1042.73	1042.56	1037.95	1047.10	1031.78	1041.90	1034.89	1029.07	1021.70	1012.65	1042.38	1040.68	1012.61	1026.04	1027.54	1021.97	1034.70	1033.16	1007.27	988.68	1031.14	1034.17	1105.94	1121.39	Meta	codellama-34b-instruct	11/22/2024	2023/7	Llama 2 Community	7508.00
155.00	CodeLlama-70B-instruct	1041.03	1054.46	1005.38	1037.18	1059.62	1047.58	1015.74	1031.08	1032.56	1032.05	1051.80	1039.85	1006.99	998.84	1050.93	1053.59	1046.55	1089.51	865.31	914.20	1116.90	1398.86	1039.50	1015.00	Meta	codellama-70b-instruct	11/22/2024	2024/1	Llama 2 Community	1190.00
157.00	Gemma-7B-it	1037.42	1056.70	1053.34	1047.31	1055.16	1046.55	1029.06	1023.31	1032.51	958.91	1040.34	1034.96	999.72	1036.37	1044.92	1045.21	1032.12	1095.27	980.36	979.04	1079.39	1109.69	1015.90	982.48	Google	gemma-7b-it	11/22/2024	2024/2	Gemma license	9176.00
157.00	Guanaco-33B	1032.52	968.47	1086.30	1039.93	1004.78	965.59	1081.01	993.45	993.71	1005.49	1035.19	1030.74	1003.71	973.12	1000.57	996.71	1028.75	1013.51	1061.03	1021.01	982.38	589.06	1054.47	1052.79	UW	guanaco-33b	11/22/2024	2023/5	Non-commercial	2997.00
157.00	Phi-3-Mini-128k-Instruct	1036.88	1032.47	1043.92	1048.57	1040.11	1029.16	1034.01	1036.22	1063.56	991.44	1039.84	1035.07	983.49	1015.15	1035.60	1036.23	1034.00	1076.59	994.47	1009.40	1078.76	1025.34	1038.38	1055.18	Microsoft	phi-3-mini-128k-instruct	11/22/2024	2023/10	MIT	21612.00
158.00	Meta-Llama-3.2-1B-Instruct	1053.64	1009.18	1045.48	1044.24	1039.90	1046.62	1045.00	1053.10	1066.06	1039.16	1057.55	1052.32	982.40	1070.20	1060.11	1079.38	1081.19	1022.77	1022.02	1009.88	1076.67	1011.49	972.01	1029.66	Meta	llama-3.2-1b-instruct	11/22/2024	2023/12	Llama 3.2	8564.00
161.00	Gemma-1.1-2b-it	1020.57	1062.19	1050.40	1039.10	1042.17	1036.01	1010.36	1006.24	1021.61	963.16	1022.85	1017.09	955.30	1019.68	1015.70	1016.80	1013.42	1076.43	967.63	947.92	1071.18	1046.49	1020.45	993.35	Google	gemma-1.1-2b-it	11/22/2024	2024/2	Gemma license	11344.00
161.00	PaLM-Chat-Bison-001	1003.68	1028.12	1043.09	1042.43	1036.41	990.18	998.18	1014.29	1015.06	993.16	997.40	1000.25	960.86	1013.99	1000.77	1010.33	1006.21	931.55	884.37	866.63	1067.57	1009.95	1021.50	893.71	Google	palm-2	11/22/2024	2021/6	Proprietary	8745.00
161.00	pplx-7B-online	1044.59	1017.85	1009.76	1041.44	1017.31	1015.01	1007.34	997.85	1013.94	990.46	1039.86	1043.71	1017.82	994.70	1016.18	1013.45	1039.28	1084.02	929.48	947.97	1158.91	1109.41	1056.27	1041.21	Perplexity AI	pplx-7b-online	11/22/2024	Online	Proprietary	6333.00
164.00	StripedHyena-Nous-7B	1017.38	1012.70	1046.24	1033.85	1006.86	999.44	1035.86	1012.09	999.89	1011.65	1015.95	1016.02	971.69	994.25	995.78	993.79	1013.47	1029.71	971.00	933.45	1059.16	1059.93	1020.99	989.54	Together AI	stripedhyena-nous-7b	11/22/2024	2023/12	Apache 2.0	5270.00
170.00	Mistral-7B-Instruct-v0.1	1008.04	1021.47	1048.08	1026.78	1015.77	1007.89	1036.75	1012.88	996.44	1011.29	999.23	1006.78	956.18	1020.37	1002.26	1003.81	1008.41	992.50	897.67	924.70	1037.39	1029.21	1034.81	974.93	Mistral	mistral-7b-instruct	11/22/2024	2023/9	Apache 2.0	9137.00
172.00	Llama-2-7B-chat	1036.75	992.40	1029.60	1024.33	1003.33	1002.20	1040.42	1012.29	1009.83	1027.86	1042.72	1034.63	997.63	1012.06	1009.85	1011.21	1041.02	1032.00	924.70	955.94	1061.27	1054.09	1014.28	989.01	Meta	llama-2-7b-chat	11/22/2024	2023/7	Llama 2 Community	14549.00
172.00	Vicuna-7B	1005.08	991.65	1039.89	1021.60	1001.59	981.50	1023.32	995.65	963.92	987.26	1004.13	1002.46	964.38	1047.51	989.68	979.08	989.24	1028.41	1006.96	962.36	1130.18	941.22	1046.76	1065.44	LMSYS	vicuna-7b	11/22/2024	2023/7	Llama 2 Community	7014.00
173.00	Qwen1.5-4B-Chat	988.34	1005.35	1004.71	1014.86	995.07	990.11	975.05	983.88	993.99	977.97	989.12	985.06	912.12	1004.61	977.80	965.13	966.64	1083.95	927.47	905.03	1030.42	991.15	977.00	1012.89	Alibaba	qwen1.5-4b-chat	11/22/2024	2024/2	Qianwen LICENSE	7809.00
175.00	Gemma-2B-it	989.56	1016.23	1026.99	1007.63	1008.09	1000.41	989.48	975.93	978.85	936.79	992.25	986.23	923.54	997.74	987.31	976.30	981.82	1049.26	856.42	909.93	1019.68	1043.31	965.42	984.86	Google	gemma-2b-it	11/22/2024	2024/2	Gemma license	4917.00
178.00	OLMo-7B-instruct	1015.33	998.67	960.85	993.49	978.39	1016.98	996.17	987.48	988.67	1005.23	1013.24	1013.88	964.59	1057.61	994.38	993.17	1018.40	1071.63	880.23	885.42	993.50	927.46	971.02	975.04	Allen AI	olmo-7b-instruct	11/22/2024	2024/2	Apache-2.0	6498.00
179.00	Koala-13B	964.38	944.20	992.78	979.68	931.65	937.41	971.78	941.37	897.74	918.38	963.77	961.44	905.93	885.08	924.75	919.35	960.98	926.47	876.33	907.43	1026.21	913.44	927.05	932.35	UC Berkeley	koala-13b	11/22/2024	2023/4	Non-commercial	7033.00
180.00	Alpaca-13B	901.63	868.30	1035.55	967.16	887.78	789.63	965.12	888.85	873.49	882.06	888.96	895.41	816.06	923.00	818.97	814.67	892.53	828.39	806.44	848.71	899.49	941.27	1032.22	930.41	Stanford	alpaca-13b	11/22/2024	2023/3	Non-commercial	5873.00
180.00	ChatGLM3-6B	955.39	966.31	993.74	974.78	962.83	952.80	973.56	961.14	955.47	957.89	947.53	952.77	876.03	970.23	953.05	955.11	949.33	1122.88	790.59	822.00	1041.67	937.37	924.52	923.50	Tsinghua	chatglm3-6b	11/22/2024	2023/10	Apache-2.0	4766.00
180.00	GPT4All-13B-Snoozy	932.20	943.91	1011.62	972.45	957.35	909.55	972.02	947.30	903.35	922.15	928.76	930.27	858.38	950.21	931.24	931.49	930.82	932.09	715.82	812.09	924.27	965.03	978.71	880.66	Nomic AI	gpt4all-13b-snoozy	11/22/2024	2023/3	Non-commercial	1787.00
180.00	MPT-7B-Chat	927.84	937.60	998.44	967.03	924.43	899.92	956.07	909.86	886.38	900.73	925.67	924.64	850.41	802.87	891.24	885.95	915.74	1003.91	880.59	905.03	962.94	1030.73	837.04	893.74	MosaicML	mpt-7b-chat	11/22/2024	2023/5	CC-BY-NC-SA-4.0	4012.00
183.00	RWKV-4-Raven-14B	921.85	916.23	953.61	949.11	911.83	896.66	933.47	885.88	888.51	892.74	914.79	918.31	845.74	840.34	891.05	878.10	906.15	952.36	878.47	872.72	1026.75	870.70	1004.46	919.77	RWKV	RWKV-4-Raven-14B	11/22/2024	2023/4	Apache 2.0	4933.00
185.00	ChatGLM2-6B	924.29	903.81	961.28	942.84	927.78	892.56	948.70	909.02	893.55	902.15	910.72	919.95	831.26	892.14	915.02	916.40	924.98	1047.56	764.92	662.02	924.24	926.94	854.19	851.72	Tsinghua	chatglm2-6b	11/22/2024	2023/6	Apache-2.0	2708.00
186.00	OpenAssistant-Pythia-12B	893.40	904.33	958.57	931.30	913.64	873.23	920.65	889.38	858.67	865.59	885.10	890.18	802.16	865.45	880.44	874.40	887.64	860.13	874.91	836.02	864.22	918.28	843.11	927.72	OpenAssistant	oasst-pythia-12b	11/22/2024	2023/4	Apache 2.0	6381.00
188.00	ChatGLM-6B	879.04	890.66	902.11	888.42	897.98	883.91	901.57	899.41	891.63	854.42	866.50	873.99	775.03	938.50	893.76	870.60	857.94	1131.64	722.55	686.81	976.51	809.74	730.34	710.06	Tsinghua	chatglm-6b	11/22/2024	2023/3	Non-commercial	4991.00
188.00	Dolly-V2-12B	822.11	815.32	917.41	881.42	855.98	746.23	863.81	812.92	837.59	739.14	807.04	817.37	691.43	858.62	797.63	785.75	804.21	875.93	808.74	743.56	934.69	856.82	791.77	822.10	Databricks	dolly-v2-12b	11/22/2024	2023/4	MIT	3484.00
188.00	FastChat-T5-3B	867.90	789.13	937.28	896.28	832.33	759.48	899.94	857.62	828.20	852.44	858.12	863.34	757.39	950.39	808.64	805.65	870.73	756.64	814.62	771.56	744.89	812.80	729.87	820.44	LMSYS	fastchat-t5-3b	11/22/2024	2023/4	Apache 2.0	4300.00
190.00	LLaMA-13B	799.34	746.55	879.98	867.28	796.70	669.24	795.72	778.60	801.61	752.74	788.19	796.62	648.92	801.38	721.89	709.63	778.78	852.46	745.25	693.12	956.21	628.31	809.53	816.52	Meta	llama-13b	11/22/2024	2023/2	Non-commercial	2444.00
191.00	StableLM-Tuned-Alpha-7B	840.13	865.35	882.02	858.91	841.84	858.56	868.71	831.25	804.34	820.33	829.57	834.15	712.22	880.05	830.25	825.14	830.29	892.65	709.50	721.10	860.98	798.18	750.08	827.38	Stability AI	stablelm-tuned-alpha-7b	11/22/2024	2023/4	CC-BY-NC-SA-4.0	3338.00

Back to Leaderboard History