Model Leaderboard

Viewing: October 23, 2024

LLM Model Performance Comparison
Rank	Model	Overall Score	Coding Style	Creative Writing Style	Full Style	Hard-6 Style	Coding	Creative Writing	Instruction Following	Math	Multi-turn	No Refusal	No Short	No Tie	Long User	Hard-6	Hard English-6	English	Chinese	French	German	Japanese	Korean	Russian	Spanish	Organization	Model Slug	Date	Cutoff Date	License	Battles
1.00	ChatGPT-4o-latest (2024-09-03)	1340.24	1297.24	1342.32	1299.46	1283.66	1339.35	1367.57	1338.06	1275.83	1377.82	1344.92	1342.07	1474.46	1365.73	1334.39	1320.32	1320.22	1423.21	1303.58	1327.15	1444.70	1402.76	1348.42	1324.78	OpenAI	chatgpt-4o-latest-20240903	10/23/2024	2023/10	Proprietary	4758.00
2.00	Gemini-1.5-Pro-002	1303.04	1252.61	1305.09	1268.28	1263.95	1290.25	1330.12	1301.26	1282.06	1307.68	1307.67	1304.41	1411.17	1315.71	1298.15	1285.90	1273.09	1396.60	1215.22	1280.56	1423.11	1428.57	1333.62	1313.25	Google	gemini-1.5-pro-002	10/23/2024	-	Proprietary	2044.00
2.00	o1-preview	1336.84	1308.25	1322.64	1302.86	1308.70	1354.79	1325.85	1351.05	1346.31	1372.45	1348.34	1338.69	1459.29	1356.02	1354.13	1353.88	1329.74	1388.00	1302.35	1309.16	1438.38	1402.24	1336.35	1301.53	OpenAI	o1-preview	10/23/2024	2023/10	Proprietary	2968.00
3.00	ChatGPT-4o-latest (2024-08-08)	1316.30	1293.30	1319.71	1290.23	1277.62	1323.82	1327.75	1320.28	1273.06	1346.06	1320.74	1318.34	1433.38	1343.99	1315.29	1305.19	1295.86	1372.83	1286.22	1318.87	1418.60	1400.97	1336.74	1310.64	OpenAI	chatgpt-4o-latest-20240808	10/23/2024	2023/10	Proprietary	5869.00
3.00	Gemini-1.5-Pro-Exp-0801	1297.72	1251.43	1309.35	1268.21	1253.37	1276.82	1327.56	1289.51	1260.61	1304.76	1301.67	1299.01	1401.58	1299.13	1277.58	1260.65	1267.48	1369.46	1295.67	1291.43	1424.38	1398.51	1334.10	1296.98	Google	gemini-1.5-pro-exp-0801	10/23/2024	2023/11	Proprietary	4339.00
3.00	Gemini-1.5-Pro-Exp-0827	1299.23	1265.77	1297.70	1267.66	1260.82	1287.53	1319.82	1293.73	1272.81	1306.21	1303.96	1300.58	1408.35	1322.04	1288.25	1274.51	1268.47	1384.76	1276.62	1303.30	1422.42	1401.11	1341.32	1306.51	Google	gemini-1.5-pro-exp-0827	10/23/2024	2023/11	Proprietary	5060.00
10.00	Gemini-1.5-Flash-002	1271.19	1205.54	1246.75	1226.22	1207.56	1252.21	1285.77	1265.71	1235.56	1257.86	1277.36	1272.68	1360.00	1298.61	1250.27	1240.50	1238.52	1351.14	1230.91	1251.09	1400.29	1344.42	1307.49	1240.45	Google	gemini-1.5-flash-002	10/23/2024	-	Proprietary	1644.00
10.00	GPT-4o-2024-05-13	1284.65	1263.30	1285.33	1261.30	1250.44	1292.49	1289.35	1287.66	1255.08	1302.10	1289.08	1286.31	1378.35	1301.79	1284.46	1274.98	1262.42	1336.02	1258.04	1277.74	1401.00	1364.46	1306.18	1282.17	OpenAI	gpt-4o-2024-05-13	10/23/2024	2023/10	Proprietary	15264.00
10.00	Grok-2-08-13	1290.48	1255.95	1263.40	1248.15	1240.76	1287.23	1284.75	1280.07	1253.00	1294.17	1295.18	1292.16	1389.75	1291.32	1278.32	1268.77	1273.06	1352.62	1266.10	1283.48	1390.16	1371.08	1305.53	1280.99	xAI	grok-2-2024-08-13	10/23/2024	2024/3	Proprietary	5989.00
11.00	Gemini-1.5-Flash-Exp-0827	1268.92	1238.66	1247.60	1236.87	1235.28	1258.06	1273.81	1265.32	1242.61	1284.99	1273.27	1270.31	1358.23	1310.34	1263.40	1250.00	1236.90	1352.78	1258.39	1266.38	1380.13	1367.45	1309.84	1275.93	Google	gemini-1.5-flash-exp-0827	10/23/2024	2023/11	Proprietary	3925.00
11.00	Yi-Lightning	1285.57	1258.94	1239.44	1241.46	1247.81	1302.87	1274.13	1285.02	1272.35	1309.99	1289.80	1287.20	1384.03	1301.11	1299.06	1298.23	1276.64	1372.43	1245.69	1262.28	1371.09	1336.78	1272.96	1316.85	01 AI	yi-lightning	10/23/2024	-	Proprietary	2771.00
12.00	Gemini-1.5-Pro-001	1259.69	1242.70	1271.56	1238.59	1237.21	1262.37	1274.72	1261.93	1237.36	1266.99	1266.41	1260.71	1339.19	1293.75	1258.22	1243.40	1231.25	1329.91	1229.58	1245.23	1380.78	1359.80	1296.74	1238.38	Google	gemini-1.5-pro-001	10/23/2024	2023/11	Proprietary	12534.00
12.00	Gemini-1.5-Pro-Preview-0409	1257.45	1204.09	1254.25	1215.38	1198.43	1231.44	1274.52	1248.85	1213.30	1254.85	1261.02	1259.49	1330.22	1247.96	1232.75	1220.17	1233.47	1315.62	1256.64	1253.72	1347.32	1416.01	1302.65	1265.62	Google	gemini-1.5-pro-api-0409-preview	10/23/2024	2023/11	Proprietary	8490.00
12.00	Gemini Advanced App (2024-05-14)	1266.49	1237.62	1281.50	1252.33	1236.34	1254.76	1275.10	1259.26	1238.34	1273.20	1270.12	1267.51	1348.81	1263.24	1253.26	1234.98	1234.44	1332.48	1256.90	1269.11	1381.82	1371.08	1304.32	1238.78	Google	gemini-advanced-0514	10/23/2024	Online	Proprietary	7372.00
12.00	GLM-4-Plus	1275.41	1247.81	1240.63	1233.41	1231.22	1286.81	1267.11	1275.51	1246.21	1283.95	1281.13	1276.76	1366.84	1293.59	1275.39	1261.62	1250.38	1351.09	1259.71	1267.38	1358.36	1377.50	1293.02	1303.87	Zhipu AI	glm-4-plus	10/23/2024	-	Proprietary	2897.00
12.00	GPT-4o-2024-08-06	1264.21	1248.58	1273.50	1247.88	1237.76	1273.00	1272.20	1270.41	1252.29	1274.75	1269.36	1265.27	1346.63	1286.11	1267.35	1257.97	1244.83	1309.34	1217.59	1252.15	1373.34	1357.51	1286.02	1265.34	OpenAI	gpt-4o-2024-08-06	10/23/2024	2023/10	Proprietary	5263.00
12.00	Llama-3.1-Nemotron-70b-Instruct	1266.82	1228.05	1215.83	1210.49	1217.75	1271.43	1259.90	1262.58	1248.42	1278.03	1271.11	1268.76	1354.56	1243.89	1262.92	1267.62	1262.91	1320.97	1233.17	1326.46	1342.99	1288.66	1234.85	1277.13	Nvidia	llama-3.1-nemotron-70b-instruct	10/23/2024	2023/12	Llama 3.1	685.00
13.00	GPT-4o-mini-2024-07-18	1273.52	1244.27	1243.13	1231.81	1220.52	1285.03	1268.82	1265.65	1230.50	1292.36	1278.40	1274.52	1364.13	1295.33	1268.56	1258.30	1254.12	1322.42	1251.42	1271.74	1356.57	1332.71	1294.33	1276.45	OpenAI	gpt-4o-mini-2024-07-18	10/23/2024	2023/10	Proprietary	6531.00
14.00	GPT-4-Turbo-2024-04-09	1256.62	1239.13	1269.99	1241.02	1226.53	1263.26	1266.68	1260.87	1242.74	1267.75	1260.88	1258.27	1332.45	1265.30	1254.77	1248.70	1241.68	1301.00	1225.90	1254.02	1336.55	1319.60	1273.23	1254.57	OpenAI	gpt-4-turbo-2024-04-09	10/23/2024	2023/12	Proprietary	14658.00
14.00	Meta-Llama-3.1-405b-Instruct-fp8	1266.64	1256.23	1254.79	1251.38	1248.38	1277.63	1262.93	1269.91	1246.88	1292.94	1270.49	1267.92	1351.39	1271.01	1267.45	1267.45	1260.52	1287.04	1245.80	1247.33	1310.29	1316.36	1285.19	1250.37	Meta	llama-3.1-405b-instruct-fp8	10/23/2024	2023/12	Llama 3.1 Community	6629.00
15.00	Meta-Llama-3.1-405b-Instruct-bf16	1265.99	1262.65	1247.64	1251.17	1253.68	1283.85	1255.74	1265.53	1255.21	1288.64	1269.93	1266.77	1351.24	1276.46	1272.55	1275.67	1260.37	1288.81	1217.26	1247.59	1344.97	1307.71	1273.44	1248.92	Meta	llama-3.1-405b-instruct-bf16	10/23/2024	2023/12	Llama 3.1 Community	2148.00
15.00	Yi-Lightning-lite	1264.76	1237.25	1248.39	1236.60	1233.87	1268.18	1260.39	1268.81	1246.98	1292.15	1270.72	1266.30	1348.48	1288.94	1272.14	1260.86	1247.61	1320.94	1264.27	1265.13	1364.48	1311.83	1269.93	1276.22	01 AI	yi-lightning-lite	10/23/2024	-	Proprietary	2682.00
21.00	Qwen-Max-0919	1263.38	1241.92	1232.01	1228.73	1231.10	1277.81	1248.71	1272.35	1244.36	1279.69	1269.30	1265.03	1345.28	1297.09	1272.55	1261.63	1244.50	1309.17	1273.01	1255.97	1349.14	1284.11	1289.61	1286.95	Alibaba	qwen-max-0919	10/23/2024	-	Qwen	2093.00
24.00	Gemma-2-9b-it-SimPO	1215.69	1178.84	1235.53	1197.53	1185.41	1197.14	1242.26	1203.19	1145.06	1225.03	1218.91	1216.78	1269.48	1237.67	1203.39	1187.11	1196.09	1283.09	1181.91	1215.49	1291.25	1265.44	1247.21	1203.49	Princeton	gemma-2-9b-it-simpo	10/23/2024	2024/7	MIT	1805.00
24.00	Grok-2-Mini-08-13	1267.21	1227.80	1223.95	1221.63	1218.18	1261.85	1247.86	1257.54	1237.44	1268.78	1271.41	1268.46	1353.13	1272.70	1259.73	1253.16	1252.54	1316.42	1229.60	1265.30	1361.89	1334.84	1281.11	1258.40	xAI	grok-2-mini-2024-08-13	10/23/2024	2024/3	Proprietary	5148.00
24.00	Mistral-Large-2407	1251.10	1242.83	1240.77	1229.56	1231.06	1268.94	1247.75	1256.91	1232.44	1262.07	1255.53	1252.66	1326.55	1271.28	1259.90	1251.88	1238.00	1298.52	1218.11	1246.43	1344.40	1315.00	1275.66	1234.78	Mistral	mistral-large-2407	10/23/2024	2024/7	Mistral Research	5856.00
24.00	o1-mini	1308.86	1305.91	1226.62	1256.93	1285.89	1369.32	1244.80	1317.01	1334.50	1328.27	1318.01	1310.37	1418.48	1332.89	1344.74	1341.09	1297.62	1374.23	1253.76	1285.63	1393.07	1380.59	1310.38	1299.66	OpenAI	o1-mini	10/23/2024	2023/10	Proprietary	3294.00
24.00	Reka-Core-20240722	1230.34	1190.73	1221.03	1202.96	1185.63	1208.46	1240.62	1212.64	1185.61	1237.13	1234.00	1230.73	1293.17	1232.73	1205.10	1191.03	1204.79	1300.52	1231.41	1210.02	1308.93	1330.89	1266.38	1221.20	Reka AI	reka-core-20240722	10/23/2024	-	Proprietary	2090.00
25.00	GPT-4-1106-preview	1250.29	1231.58	1240.73	1234.17	1226.80	1253.20	1247.92	1250.14	1242.53	1260.50	1257.51	1251.53	1318.80	1248.83	1247.15	1238.99	1231.71	1299.48	1241.03	1248.39	1336.56	1320.51	1271.97	1259.93	OpenAI	gpt-4-1106-preview	10/23/2024	2023/4	Proprietary	16126.00
26.00	Athene-70b	1250.07	1232.86	1218.23	1220.62	1223.54	1253.61	1238.20	1234.03	1200.73	1254.83	1253.80	1250.46	1327.08	1241.26	1247.16	1241.11	1237.90	1294.37	1235.89	1245.43	1285.95	1297.18	1271.73	1246.62	NexusFlow	athene-70b-0725	10/23/2024	2024/7	CC-BY-NC-4.0	3289.00
26.00	Command R+ (08-2024)	1214.98	1165.76	1214.74	1196.14	1170.96	1181.57	1235.59	1205.73	1163.07	1216.18	1222.37	1216.43	1266.14	1242.56	1188.82	1178.13	1189.22	1284.65	1160.34	1212.80	1310.43	1311.21	1248.65	1233.34	Cohere	command-r-plus-08-2024	10/23/2024	2024/8	CC-BY-NC-4.0	1599.00
26.00	Gemma-2-27b-it	1219.26	1201.57	1239.10	1204.85	1191.62	1209.29	1241.53	1213.79	1185.94	1225.10	1224.28	1220.11	1275.06	1233.95	1203.74	1191.59	1194.23	1278.42	1184.43	1206.97	1319.16	1318.55	1254.72	1226.54	Google	gemma-2-27b-it	10/23/2024	2024/6	Gemma license	7639.00
27.00	Claude 3.5 Sonnet	1268.42	1282.03	1254.64	1258.36	1269.77	1296.23	1241.14	1280.98	1273.38	1305.46	1276.65	1269.90	1352.65	1287.16	1279.66	1269.14	1241.71	1321.03	1245.96	1266.05	1369.32	1340.68	1302.49	1283.72	Anthropic	claude-3-5-sonnet-20240620	10/23/2024	2024/4	Proprietary	12405.00
27.00	Claude 3 Opus	1247.63	1235.29	1239.34	1237.97	1234.47	1250.41	1240.63	1257.46	1239.11	1278.31	1259.57	1249.33	1316.87	1270.00	1245.57	1227.97	1214.06	1312.19	1228.46	1251.72	1351.35	1323.96	1307.02	1244.14	Anthropic	claude-3-opus-20240229	10/23/2024	2023/8	Proprietary	26082.00
27.00	Deepseek-v2.5	1255.52	1248.61	1210.67	1220.64	1234.06	1282.65	1235.38	1255.66	1241.78	1257.51	1260.11	1256.61	1333.70	1283.22	1274.62	1264.96	1236.11	1337.71	1232.49	1222.79	1319.89	1312.62	1274.01	1244.60	DeepSeek	deepseek-v2.5	10/23/2024	-	DeepSeek	2401.00
27.00	Meta-Llama-3.1-70b-Instruct	1246.91	1217.23	1212.60	1210.83	1207.77	1249.79	1237.04	1238.72	1219.11	1258.20	1250.53	1247.91	1321.18	1247.89	1241.85	1244.06	1245.90	1274.63	1201.09	1221.79	1278.46	1276.45	1251.85	1244.51	Meta	llama-3.1-70b-instruct	10/23/2024	2023/12	Llama 3.1 Community	5845.00
27.00	Yi-Large-preview	1239.56	1208.30	1204.99	1205.22	1204.62	1244.94	1240.35	1236.21	1218.62	1235.03	1243.78	1241.40	1309.24	1246.86	1239.60	1228.75	1216.41	1316.24	1202.63	1225.44	1356.75	1285.45	1271.44	1244.19	01 AI	yi-large-preview	10/23/2024	Unknown	Proprietary	7458.00
28.00	GPT-4-0125-preview	1245.05	1220.77	1237.09	1229.99	1217.66	1243.62	1238.24	1244.84	1237.05	1255.25	1251.28	1246.54	1311.62	1249.14	1241.64	1234.73	1226.58	1296.02	1233.26	1236.79	1341.20	1310.82	1261.24	1244.95	OpenAI	gpt-4-0125-preview	10/23/2024	2023/12	Proprietary	14474.00
28.00	Qwen2.5-72b-Instruct	1258.86	1244.96	1211.93	1220.76	1223.32	1282.69	1231.81	1265.86	1248.64	1272.93	1263.61	1260.44	1338.68	1289.51	1267.43	1257.11	1239.98	1330.20	1234.69	1227.20	1306.52	1334.59	1276.62	1258.72	Alibaba	qwen2.5-72b-instruct	10/23/2024	2024/9	Qwen	2410.00
34.00	Gemini-1.5-Flash-001	1226.78	1206.81	1215.66	1201.79	1199.48	1231.69	1227.91	1222.34	1199.06	1232.01	1232.20	1227.36	1287.87	1262.99	1224.60	1210.71	1200.36	1291.30	1195.52	1211.50	1330.69	1333.39	1259.11	1222.77	Google	gemini-1.5-flash-001	10/23/2024	2023/11	Proprietary	9577.00
40.00	Qwen-Plus-0828	1227.46	1216.10	1213.06	1204.34	1207.15	1245.70	1219.60	1235.00	1216.75	1248.37	1232.14	1229.12	1284.80	1266.88	1241.74	1234.93	1217.80	1313.34	1165.29	1181.30	1292.28	1267.98	1268.12	1244.26	Alibaba	qwen-plus-0828	10/23/2024	-	Proprietary	2242.00
43.00	Gemini-1.5-Flash-8B-001	1210.24	1160.57	1188.85	1175.50	1169.22	1203.51	1218.13	1207.80	1182.37	1189.11	1215.77	1211.08	1259.72	1229.29	1207.92	1189.13	1177.79	1285.66	1192.47	1179.21	1281.84	1284.70	1257.30	1229.38	Google	gemini-1.5-flash-8b-001	10/23/2024	-	Proprietary	1794.00
44.00	Jamba-1.5-Large	1220.99	1207.38	1214.22	1202.64	1192.07	1228.21	1217.28	1220.41	1189.21	1223.04	1224.79	1221.48	1278.02	1214.34	1219.39	1215.02	1217.34	1260.81	1197.84	1196.71	1266.95	1281.75	1214.34	1246.27	AI21 Labs	jamba-1.5-large	10/23/2024	2024/3	Jamba Open	1499.00
46.00	Gemini-1.5-Flash-8b-Exp-0827	1205.14	1159.87	1183.19	1170.50	1160.95	1189.77	1213.66	1199.06	1172.04	1201.05	1209.48	1205.83	1251.71	1231.98	1196.09	1181.46	1176.31	1274.02	1190.56	1181.44	1302.76	1301.21	1250.66	1221.54	Google	gemini-1.5-flash-8b-exp-0827	10/23/2024	2023/11	Proprietary	3830.00
49.00	Llama-3-70b-Instruct	1206.48	1190.48	1207.31	1193.99	1186.94	1199.59	1213.68	1199.27	1188.58	1224.67	1208.91	1206.76	1257.89	1185.56	1197.00	1211.63	1226.24	1176.21	1183.80	1166.31	1176.83	1169.84	1186.98	1241.55	Meta	llama-3-70b-instruct	10/23/2024	2023/12	Llama 3 Community	23928.00
50.00	Deepseek-v2-API-0628	1219.45	1221.79	1198.89	1200.70	1210.02	1241.76	1207.45	1221.32	1216.45	1228.63	1223.29	1220.89	1275.16	1243.28	1233.76	1223.55	1198.65	1282.24	1200.89	1201.82	1303.02	1274.11	1258.47	1216.02	DeepSeek AI	deepseek-v2-api-0628	10/23/2024	-	DeepSeek	3203.00
51.00	Gemini App (2024-01-24)	1208.66	1161.40	1167.33	1178.83	1141.30	1171.27	1193.16	1158.56	1135.38	1198.15	1212.67	1208.05	1249.12	1133.62	1156.62	1141.95	1181.92	1275.14	1263.04	1243.43	1332.53	1408.16	1259.17	1225.46	Google	bard-jan-24-gemini-pro	10/23/2024	Online	Proprietary	1786.00
51.00	Deepseek-Coder-v2-0724	1214.11	1242.95	1185.85	1195.90	1209.29	1266.59	1189.65	1221.10	1209.96	1218.05	1221.27	1215.76	1266.42	1253.75	1235.06	1233.56	1194.97	1286.09	1183.96	1201.49	1293.86	1257.15	1240.85	1202.25	DeepSeek	deepseek-coder-v2-0724	10/23/2024	-	Proprietary	1944.00
51.00	Gemma-2-9b-it	1189.52	1162.29	1206.58	1175.75	1158.53	1167.17	1207.47	1181.55	1151.34	1192.67	1193.83	1189.87	1226.29	1205.68	1168.75	1156.18	1167.99	1243.07	1151.99	1183.98	1280.62	1278.09	1220.61	1199.83	Google	gemma-2-9b-it	10/23/2024	2024/6	Gemma license	5685.00
51.00	GLM-4-0520	1206.59	1191.42	1192.47	1187.12	1188.38	1216.06	1198.14	1209.16	1188.08	1221.10	1209.85	1207.52	1257.39	1217.50	1213.35	1201.30	1190.29	1289.37	1160.64	1177.93	1271.37	1190.83	1235.49	1220.54	Zhipu AI	glm-4-0520	10/23/2024	Unknown	Proprietary	1651.00
51.00	Nemotron-4-340B-Instruct	1209.17	1187.10	1192.48	1195.87	1188.69	1198.08	1207.40	1212.14	1186.26	1216.95	1213.36	1210.31	1261.53	1231.97	1202.24	1184.69	1186.72	1270.52	1148.72	1187.70	1278.49	1283.92	1243.70	1195.81	Nvidia	nemotron-4-340b-instruct	10/23/2024	2023/6	NVIDIA Open Model	3379.00
51.00	Reka-Flash-20240722	1200.80	1173.10	1177.68	1179.30	1164.40	1187.48	1197.02	1187.92	1160.32	1197.62	1204.82	1200.78	1245.03	1194.37	1178.26	1167.83	1174.01	1270.05	1196.87	1202.78	1289.30	1287.91	1247.27	1213.80	Reka AI	reka-flash-20240722	10/23/2024	-	Proprietary	2134.00
51.00	Yi-Large	1212.53	1194.14	1189.79	1193.78	1184.57	1219.58	1202.42	1208.00	1195.37	1219.51	1219.17	1213.36	1266.84	1218.36	1208.55	1197.69	1194.85	1267.69	1168.38	1198.07	1312.43	1264.99	1244.34	1209.18	01 AI	yi-large	10/23/2024	Unknown	Proprietary	2638.00
52.00	Command R+ (04-2024)	1189.85	1153.95	1186.05	1182.56	1159.66	1164.44	1199.40	1187.16	1136.85	1196.90	1194.27	1191.24	1231.71	1214.91	1168.85	1154.23	1163.04	1254.21	1159.67	1188.76	1304.54	1271.95	1224.67	1181.06	Cohere	command-r-plus	10/23/2024	2024/3	CC-BY-NC-4.0	11582.00
54.00	Reka-Core-20240501	1199.64	1172.22	1180.77	1176.36	1167.31	1190.13	1195.91	1186.08	1159.34	1188.75	1203.95	1200.99	1246.38	1192.65	1186.80	1173.52	1176.11	1261.13	1178.76	1197.66	1283.20	1272.63	1229.71	1191.13	Reka AI	reka-core-20240501	10/23/2024	-	Proprietary	9260.00
56.00	GLM-4-0116	1183.30	1166.95	1169.34	1162.15	1164.11	1190.77	1180.29	1180.94	1162.22	1181.26	1186.48	1185.93	1221.26	1193.66	1186.74	1176.63	1177.21	1275.27	1129.72	1153.59	1244.65	1145.06	1182.50	1199.89	Zhipu AI	glm-4-0116	10/23/2024	Unknown	Proprietary	1025.00
56.00	GPT-4-0314	1186.30	1202.47	1203.36	1199.87	1203.14	1195.47	1189.76	1204.63	1194.08	1201.16	1189.30	1187.38	1223.14	1200.40	1195.94	1183.66	1164.44	1237.03	1178.32	1197.95	1275.60	1235.02	1219.42	1196.54	OpenAI	gpt-4-0314	10/23/2024	2021/9	Proprietary	8497.00
60.00	Claude 3 Sonnet	1201.06	1201.04	1197.46	1196.91	1190.13	1213.01	1187.61	1204.67	1181.65	1226.72	1209.33	1202.04	1246.42	1222.32	1199.01	1186.67	1175.34	1245.49	1180.77	1198.72	1286.79	1264.67	1247.50	1206.10	Anthropic	claude-3-sonnet-20240229	10/23/2024	2023/8	Proprietary	16232.00
60.00	GPT-4-0613	1163.17	1180.03	1211.70	1185.88	1182.30	1166.91	1187.33	1188.55	1178.08	1174.35	1168.65	1164.19	1187.64	1193.36	1168.01	1164.07	1147.95	1182.58	1122.30	1156.40	1268.14	1205.34	1195.42	1167.97	OpenAI	gpt-4-0613	10/23/2024	2021/9	Proprietary	14377.00
61.00	Command R (08-2024)	1179.42	1160.38	1168.55	1175.20	1165.02	1161.73	1179.23	1179.05	1129.46	1168.02	1184.79	1180.55	1203.82	1211.75	1169.48	1159.24	1154.43	1242.21	1137.31	1169.60	1294.61	1291.67	1200.09	1170.95	Cohere	command-r-08-2024	10/23/2024	2024/8	CC-BY-NC-4.0	1559.00
62.00	Qwen2-72B-Instruct	1187.10	1177.86	1176.76	1180.36	1177.81	1186.56	1183.44	1190.18	1202.34	1196.65	1192.35	1187.97	1225.42	1200.37	1189.13	1184.49	1171.14	1293.61	1127.55	1146.29	1264.71	1224.95	1194.99	1171.97	Alibaba	qwen2-72b-instruct	10/23/2024	2024/6	Qianwen LICENSE	5859.00
64.00	Qwen-Max-0428	1182.92	1174.33	1164.12	1170.78	1167.38	1189.46	1177.54	1180.22	1167.15	1175.00	1186.69	1183.72	1219.54	1198.04	1186.25	1177.78	1167.85	1293.17	1161.62	1130.14	1265.32	1218.98	1179.58	1153.86	Alibaba	qwen-max-0428	10/23/2024	-	Proprietary	3715.00
67.00	Jamba-1.5-Mini	1176.15	1163.93	1166.36	1158.09	1145.22	1181.36	1171.61	1158.59	1132.41	1162.36	1180.14	1176.73	1202.81	1170.58	1169.30	1166.34	1177.88	1196.52	1133.29	1159.24	1172.79	1181.57	1179.06	1222.01	AI21 Labs	jamba-1.5-mini	10/23/2024	2024/3	Jamba Open	1495.00
73.00	Claude 3 Haiku	1179.20	1183.10	1169.96	1176.73	1173.87	1189.41	1162.87	1181.65	1159.35	1191.62	1188.26	1179.51	1213.81	1198.99	1178.00	1167.74	1157.41	1211.35	1150.10	1169.05	1256.20	1250.22	1224.13	1169.32	Anthropic	claude-3-haiku-20240307	10/23/2024	2023/8	Proprietary	17299.00
73.00	Mistral Medium	1147.86	1141.57	1147.05	1141.09	1136.97	1152.58	1160.60	1153.71	1139.69	1145.39	1148.42	1148.19	1167.93	1162.73	1144.30	1132.22	1137.89	1164.90	1132.97	1149.52	1182.47	1166.03	1189.94	1144.01	Mistral	mistral-medium	10/23/2024	-	Proprietary	5717.00
73.00	Reka-Flash-Preview-20240611	1165.05	1145.77	1148.10	1151.00	1136.32	1155.15	1158.14	1146.46	1127.14	1148.53	1168.24	1165.36	1189.54	1147.05	1144.45	1130.72	1141.84	1218.86	1140.63	1161.89	1250.76	1250.10	1196.37	1175.76	Reka AI	reka-flash-preview-20240611	10/23/2024	-	Proprietary	3207.00
74.00	Command R (04-2024)	1148.77	1124.71	1153.24	1147.93	1122.83	1122.95	1159.28	1132.36	1089.34	1148.59	1150.94	1148.49	1168.04	1166.95	1119.42	1105.69	1123.36	1208.92	1112.65	1123.18	1247.04	1239.34	1184.21	1150.26	Cohere	command-r	10/23/2024	2024/3	CC-BY-NC-4.0	8233.00
74.00	Meta-Llama-3.1-8b-Instruct	1174.08	1141.23	1126.55	1127.64	1138.28	1184.97	1157.19	1170.30	1146.61	1174.47	1178.34	1174.47	1199.78	1195.04	1180.83	1179.32	1169.58	1208.11	1130.36	1144.54	1214.32	1207.75	1178.60	1182.93	Meta	llama-3.1-8b-instruct	10/23/2024	2023/12	Llama 3.1 Community	5538.00
74.00	Mistral-Large-2402	1157.23	1170.20	1158.84	1157.61	1164.18	1169.64	1159.19	1172.51	1164.88	1165.66	1159.36	1158.48	1181.04	1176.99	1165.32	1157.18	1146.13	1178.49	1161.82	1173.79	1173.76	1159.68	1195.76	1193.17	Mistral	mistral-large-2402	10/23/2024	-	Proprietary	9460.00
74.00	WizardLM-70B-v1.0	1106.23	1070.90	1149.29	1104.52	1074.63	1071.09	1151.93	1102.27	1076.33	1109.04	1103.20	1105.37	1105.75	1104.80	1077.36	1072.55	1097.84	1113.46	1034.15	1083.95	1168.07	1065.82	1166.24	1083.89	Microsoft	wizardlm-70b	10/23/2024	2023/8	Llama 2 Community	1799.00
75.00	Llama-3-8b-Instruct	1151.98	1138.35	1150.59	1141.53	1128.72	1146.03	1154.81	1136.80	1118.93	1152.82	1154.33	1150.91	1170.98	1136.13	1137.05	1144.13	1163.64	1135.28	1113.54	1101.67	1137.50	1151.12	1138.49	1174.00	Meta	llama-3-8b-instruct	10/23/2024	2023/3	Llama 3 Community	16156.00
77.00	Qwen1.5-110B-Chat	1161.39	1162.71	1146.63	1154.89	1153.97	1174.45	1149.95	1163.20	1150.54	1158.82	1164.65	1161.33	1184.67	1166.55	1168.77	1166.71	1150.47	1260.11	1106.35	1117.54	1228.23	1187.06	1144.45	1143.17	Alibaba	qwen1.5-110b-chat	10/23/2024	2024/4	Qianwen LICENSE	3856.00
77.00	Yi-1.5-34B-Chat	1157.24	1134.29	1119.14	1132.18	1134.80	1162.15	1144.20	1147.24	1150.19	1158.02	1160.33	1157.49	1179.12	1158.71	1159.94	1159.79	1163.39	1267.05	1110.86	1106.50	1178.98	1150.75	1119.07	1126.14	01 AI	yi-1.5-34b-chat	10/23/2024	2024/5	Apache-2.0	3806.00
78.00	Gemma-2-2b-it	1138.01	1079.54	1126.07	1109.45	1090.08	1097.62	1143.29	1120.29	1104.73	1113.53	1142.29	1137.95	1137.01	1138.67	1110.59	1107.88	1128.21	1183.17	1125.92	1110.50	1236.82	1210.32	1132.88	1129.47	Google	gemma-2-2b-it	10/23/2024	2024/7	Gemma license	4310.00
78.00	Mixtral-8x22b-Instruct-v0.1	1147.65	1151.79	1147.02	1149.42	1146.60	1152.84	1146.85	1154.88	1152.33	1130.89	1150.77	1148.48	1163.88	1155.63	1148.63	1143.03	1136.57	1177.71	1121.09	1139.01	1194.21	1197.28	1179.82	1144.00	Mistral	mixtral-8x22b-instruct-v0.1	10/23/2024	2024/4	Apache 2.0	7872.00
83.00	InternLM2.5-20b-chat	1149.80	1136.81	1094.40	1115.37	1141.58	1159.92	1134.65	1153.63	1158.79	1138.48	1155.33	1150.32	1154.35	1170.93	1166.02	1175.58	1157.44	1260.90	1032.42	1058.51	1192.17	1159.83	1138.99	1124.72	InternLM	internlm2_5-20b-chat	10/23/2024	2024/8	Other	1610.00
84.00	Claude-1	1148.94	1149.89	1164.59	1158.96	1135.25	1135.96	1134.50	1141.38	1114.74	1171.73	1166.04	1148.40	1167.85	1163.69	1125.80	1117.09	1129.40	1195.40	1115.28	1173.03	1229.81	1102.62	1193.45	1171.54	Anthropic	claude-1	10/23/2024	-	Proprietary	3468.00
84.00	DeepSeek-Coder-V2-Instruct	1178.34	1225.67	1158.72	1181.09	1196.51	1239.41	1128.09	1189.46	1211.25	1180.14	1204.92	1179.56	1212.10	1224.64	1211.23	1202.78	1150.25	1259.40	1138.48	1159.20	1283.04	1247.98	1210.58	1153.07	DeepSeek AI	deepseek-coder-v2	10/23/2024	2024/6	DeepSeek License	2444.00
84.00	Gemini-1.0-Pro-001	1131.53	1119.64	1152.95	1146.65	1125.21	1102.76	1133.85	1118.83	1099.31	1119.32	1133.57	1130.57	1144.82	1143.73	1105.80	1095.44	1108.51	1181.37	1101.63	1124.57	1198.86	1221.06	1208.06	1127.39	Google	gemini-pro-dev-api	10/23/2024	2023/4	Proprietary	3127.00
84.00	Mistral-Next	1124.38	1155.10	1165.17	1149.64	1149.03	1132.48	1135.47	1157.97	1140.23	1136.98	1126.39	1124.89	1130.74	1150.85	1129.21	1121.66	1110.14	1134.88	1111.21	1154.89	1138.01	1040.43	1172.35	1129.91	Mistral	mistral-next	10/23/2024	-	Proprietary	1871.00
84.00	OpenChat-3.5	1076.49	1067.23	1133.74	1094.71	1077.09	1053.79	1126.73	1074.44	1035.02	1087.65	1070.04	1076.44	1062.63	1108.59	1065.50	1055.67	1064.70	1124.94	1064.45	1039.07	1108.52	1095.85	1127.24	1081.32	OpenChat	openchat-3.5	10/23/2024	2023/11	Apache-2.0	1482.00
84.00	Qwen1.5-72B-Chat	1147.38	1156.60	1136.39	1147.66	1142.56	1160.05	1135.52	1144.25	1128.45	1153.73	1150.44	1147.27	1166.10	1165.74	1146.85	1140.90	1135.11	1240.86	1112.35	1077.78	1218.62	1188.14	1128.35	1111.26	Alibaba	qwen1.5-72b-chat	10/23/2024	2024/2	Qianwen LICENSE	6083.00
84.00	Reka-Flash-21B	1147.68	1138.41	1128.23	1141.34	1134.70	1141.12	1128.38	1129.69	1123.59	1142.08	1150.75	1147.19	1165.56	1151.12	1133.72	1126.79	1126.10	1194.10	1128.52	1150.40	1211.55	1217.71	1181.56	1141.61	Reka AI	reka-flash-21b-20240226	10/23/2024	2023/11	Proprietary	3657.00
84.00	Reka-Flash-21B-online	1155.89	1145.24	1130.41	1150.91	1144.08	1146.92	1131.07	1138.08	1140.43	1149.39	1158.05	1155.74	1179.37	1151.10	1142.86	1133.32	1136.10	1196.19	1111.71	1147.98	1231.31	1245.26	1189.55	1144.98	Reka AI	reka-flash-21b-20240226-online	10/23/2024	Online	Proprietary	2212.00
84.00	Vicuna-33B	1090.82	1068.49	1131.96	1091.45	1066.67	1067.13	1136.56	1073.63	1036.24	1086.86	1087.37	1090.10	1082.79	1044.05	1066.10	1060.97	1086.48	1093.66	1054.69	1055.12	1147.91	978.45	1100.22	1085.82	LMSYS	vicuna-33b	10/23/2024	2023/8	Non-commercial	4088.00
89.00	Nous-Hermes-2-Mixtral-8x7B-DPO	1084.31	1066.53	1089.81	1071.23	1035.88	1079.54	1105.02	1054.59	1028.26	1079.17	1085.63	1083.89	1074.62	1060.67	1052.22	1045.35	1078.08	1076.57	1078.01	1027.94	1158.77	1173.11	1082.90	1024.23	NousResearch	nous-hermes-2-mixtral-8x7b-dpo	10/23/2024	2024/1	Apache-2.0	626.00
89.00	Zephyr-ORPO-141b-A35b-v0.1	1127.56	1126.52	1117.14	1130.78	1119.46	1124.54	1114.07	1129.02	1119.04	1103.49	1129.54	1127.49	1137.67	1119.26	1117.00	1113.11	1119.40	1143.23	1138.98	1089.39	1186.25	1171.02	1141.89	1104.13	HuggingFace	zephyr-orpo-141b-A35b-v0.1	10/23/2024	2024/4	Apache 2.0	676.00
90.00	Tulu-2-DPO-70B	1099.30	1082.06	1099.55	1092.16	1088.45	1093.11	1109.73	1106.41	1073.87	1082.22	1100.35	1098.99	1093.47	1116.33	1098.22	1099.27	1091.88	1060.37	1088.04	1066.79	1132.82	892.33	1156.34	1120.20	AllenAI/UW	tulu-2-dpo-70b	10/23/2024	2023/11	AI2 ImpACT Low-risk	1143.00
90.00	Zephyr-7b-beta	1053.46	1027.73	1096.63	1049.46	1022.47	1029.97	1113.01	1038.68	1010.71	1031.89	1048.64	1052.00	1027.72	1054.32	1026.58	1027.52	1053.34	1018.17	993.79	975.48	1041.46	1025.25	1068.35	1041.60	HuggingFace	zephyr-7b-beta	10/23/2024	2023/10	MIT	2023.00
93.00	Dolphin-2.2.1-Mistral-7B	1062.18	1033.03	1090.35	1068.25	1054.33	1024.94	1090.95	1056.84	1041.46	1018.09	1057.93	1061.34	1039.45	1032.38	1050.64	1044.17	1059.44	1104.87	989.91	937.39	1134.54	964.79	1105.24	988.84	Cognitive Computations	dolphin-2.2.1-mistral-7b	10/23/2024	2023/10	Apache-2.0	295.00
93.00	Yi-34B-Chat	1111.15	1090.12	1107.69	1100.54	1089.82	1106.04	1110.69	1094.21	1079.28	1110.58	1115.35	1110.90	1111.99	1105.66	1101.96	1097.24	1106.10	1232.35	1046.27	1038.50	1173.80	1097.27	1079.25	1071.24	01 AI	yi-34b-chat	10/23/2024	2023/6	Yi License	2451.00
94.00	NV-Llama2-70B-SteerLM-Chat	1080.39	1025.81	1076.05	1073.90	1048.90	1022.81	1096.36	1063.49	1036.73	1059.80	1076.22	1079.88	1071.51	1012.25	1046.02	1035.41	1069.04	1086.76	1050.07	1081.93	1114.56	985.51	1139.63	1035.68	Nvidia	llama2-70b-steerlm-chat	10/23/2024	2023/11	Llama 2 Community	619.00
94.00	Phi-3-Medium-4k-Instruct	1123.02	1115.23	1105.76	1117.80	1121.17	1125.37	1111.75	1123.12	1141.14	1094.85	1126.50	1123.46	1118.55	1132.88	1129.65	1126.72	1118.00	1165.23	1071.53	1101.56	1197.73	1109.11	1169.46	1095.78	Microsoft	phi-3-medium-4k-instruct	10/23/2024	2023/10	MIT	3940.00
95.00	falcon-180b-chat	1034.09	1041.35	1108.61	1059.39	1019.96	1016.87	1095.05	1052.87	1013.01	1012.60	1031.38	1034.04	1002.86	1056.00	1000.56	1009.73	1026.29	1002.67	950.58	1148.20	1165.93	462.28	866.04	1101.85	TII	falcon-180b-chat	10/23/2024	2023/9	Falcon-180B TII License	275.00
95.00	GPT-3.5-Turbo-0613	1116.88	1147.33	1130.87	1137.05	1134.91	1134.86	1109.74	1128.59	1107.32	1117.40	1123.88	1116.71	1120.30	1125.55	1123.24	1115.98	1098.20	1157.10	1098.80	1121.25	1209.06	1200.37	1184.10	1120.62	OpenAI	gpt-3.5-turbo-0613	10/23/2024	2021/9	Proprietary	6747.00
95.00	OpenHermes-2.5-Mistral-7b	1074.68	1067.63	1111.66	1090.07	1078.29	1059.07	1103.53	1074.48	1061.81	1064.25	1069.68	1072.66	1060.15	1071.49	1068.73	1064.51	1072.16	1083.78	1027.31	995.77	1149.00	1173.87	1081.43	1050.37	NousResearch	openhermes-2.5-mistral-7b	10/23/2024	2023/11	Apache-2.0	826.00
96.00	Gemini Pro	1110.74	1111.70	1131.62	1131.15	1113.95	1091.59	1103.69	1103.17	1085.97	1143.27	1115.67	1109.95	1111.77	1125.62	1083.13	1080.07	1097.74	1152.22	1058.68	1017.89	1211.77	1294.12	1152.61	1086.71	Google	gemini-pro	10/23/2024	2023/4	Proprietary	971.00
98.00	Claude-2.0	1132.00	1153.11	1144.38	1145.78	1141.66	1135.20	1101.75	1130.50	1126.62	1161.44	1150.57	1131.85	1140.52	1146.81	1126.30	1119.50	1114.13	1189.68	1102.16	1152.57	1214.72	1150.34	1204.77	1138.29	Anthropic	claude-2.0	10/23/2024	-	Proprietary	2283.00
98.00	Meta-Llama-3.2-3b-Instruct	1103.02	1048.33	1098.52	1092.78	1084.59	1081.95	1098.37	1106.12	1097.61	1111.38	1106.64	1102.68	1084.12	1120.04	1103.45	1130.15	1141.35	1086.08	1025.22	1052.59	1078.56	1003.77	980.58	1104.14	Meta	llama-3.2-3b-instruct	10/23/2024	2023/12	Llama 3.2	1148.00
98.00	Mixtral-8x7b-Instruct-v0.1	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	1114.00	Mistral	mixtral-8x7b-instruct-v0.1	10/23/2024	2023/12	Apache 2.0	11623.00
98.00	SOLAR-10.7B-Instruct-v1.0	1061.98	1052.31	1088.72	1065.69	1055.90	1046.19	1089.69	1058.10	1028.75	1041.77	1058.04	1061.94	1038.77	1134.01	1056.16	1050.00	1060.27	1070.36	1001.91	1016.03	1139.60	932.89	1063.05	1031.66	Upstage AI	solar-10.7b-instruct-v1.0	10/23/2024	2023/11	CC-BY-NC-4.0	725.00
98.00	Starling-LM-7B-alpha	1088.48	1076.47	1089.17	1083.00	1070.20	1080.16	1102.30	1073.56	1047.33	1082.66	1085.13	1088.44	1079.54	1093.27	1072.97	1070.25	1083.36	1106.47	1038.98	1028.76	1129.15	1117.02	1110.16	1112.56	UC Berkeley	starling-lm-7b-alpha	10/23/2024	2023/11	CC-BY-NC-4.0	1729.00
99.00	DBRX-Instruct-Preview	1103.15	1123.95	1111.17	1113.48	1115.20	1117.90	1102.40	1114.34	1108.27	1102.30	1105.10	1103.22	1096.40	1124.89	1109.33	1110.12	1103.74	1121.27	1049.61	1061.49	1154.43	1136.26	1096.54	1066.10	Databricks	dbrx-instruct-preview	10/23/2024	2023/12	DBRX LICENSE	5074.00
99.00	OpenChat-3.5-0106	1091.34	1106.64	1103.15	1100.32	1088.47	1102.14	1098.75	1081.68	1071.33	1092.37	1090.66	1089.85	1081.36	1096.72	1083.71	1073.65	1080.57	1138.31	1046.95	1066.16	1127.86	1043.73	1107.31	1101.81	OpenChat	openchat-3.5-0106	10/23/2024	2024/1	Apache-2.0	1910.00
100.00	GPT-3.5-Turbo-0125	1105.78	1146.48	1145.77	1137.42	1131.10	1123.64	1099.16	1125.17	1109.47	1115.15	1111.89	1105.47	1100.14	1136.92	1111.93	1105.96	1086.84	1130.77	1072.39	1091.60	1203.96	1168.02	1147.40	1117.33	OpenAI	gpt-3.5-turbo-0125	10/23/2024	2021/9	Proprietary	10120.00
100.00	GPT-3.5-Turbo-0314	1106.61	1144.36	1135.74	1141.72	1138.80	1115.17	1089.26	1148.61	1140.16	1107.65	1114.49	1106.20	1096.76	1117.47	1116.97	1097.14	1081.60	1204.41	1149.04	1151.70	1283.02	1222.72	1166.65	1165.12	OpenAI	gpt-3.5-turbo-0314	10/23/2024	2021/9	Proprietary	908.00
100.00	Guanaco-33B	1032.61	968.74	1086.56	1040.10	1004.82	965.56	1081.09	993.47	993.76	1005.44	1035.35	1030.74	1003.94	973.79	1000.68	996.92	1028.77	1013.90	1060.69	1021.03	981.71	595.02	1054.71	1053.18	UW	guanaco-33b	10/23/2024	2023/5	Non-commercial	519.00
100.00	MPT-30B-chat	1045.69	1044.26	1085.38	1060.25	1056.21	1030.73	1077.01	1057.40	1014.29	1052.47	1040.46	1043.84	1022.71	1067.59	1047.86	1059.33	1043.53	1024.54	998.50	993.10	1093.71	1018.11	959.07	1070.81	MosaicML	mpt-30b-chat	10/23/2024	2023/6	CC-BY-NC-SA-4.0	458.00
100.00	Qwen1.5-14B-Chat	1108.84	1118.57	1091.49	1106.56	1109.44	1125.97	1094.71	1102.84	1090.86	1108.74	1111.17	1107.59	1105.73	1125.76	1116.53	1110.09	1095.47	1202.67	1068.68	1041.68	1190.08	1150.36	1073.01	1078.58	Alibaba	qwen1.5-14b-chat	10/23/2024	2024/2	Qianwen LICENSE	2500.00
100.00	Starling-LM-7B-beta	1118.94	1110.84	1057.93	1090.75	1103.48	1129.47	1097.31	1104.48	1093.52	1106.81	1120.52	1118.93	1123.98	1120.51	1119.63	1112.12	1107.79	1178.78	1064.15	1075.85	1162.31	1089.70	1123.42	1143.39	Nexusflow	starling-lm-7b-beta	10/23/2024	2024/3	Apache-2.0	2485.00
100.00	WizardLM-13b-v1.2	1058.73	1031.04	1092.06	1063.30	1014.89	1026.34	1093.20	1050.92	987.23	1043.07	1057.95	1056.11	1039.70	1067.09	1013.82	1011.06	1050.42	1075.34	1026.29	1031.12	1075.99	1047.80	1082.30	1072.97	Microsoft	wizardlm-13b	10/23/2024	2023/7	Llama 2 Community	1390.00
104.00	Phi-3-Small-8k-Instruct	1101.80	1099.05	1087.92	1098.12	1100.99	1107.13	1087.14	1101.93	1120.30	1071.00	1106.22	1101.97	1085.40	1101.53	1107.33	1111.58	1106.19	1123.38	1090.83	1075.33	1126.62	1053.22	1138.37	1110.24	Microsoft	phi-3-small-8k-instruct	10/23/2024	2023/10	MIT	2523.00
104.00	Qwen1.5-32B-Chat	1125.45	1144.46	1088.03	1126.55	1131.00	1149.27	1088.80	1122.24	1125.40	1138.11	1128.39	1124.77	1130.95	1157.70	1135.73	1130.48	1110.05	1234.91	1057.41	1053.42	1189.58	1150.74	1096.54	1087.96	Alibaba	qwen1.5-32b-chat	10/23/2024	2024/2	Qianwen LICENSE	3162.00
104.00	Snowflake Arctic Instruct	1090.07	1092.87	1095.87	1102.61	1089.11	1077.02	1085.19	1077.94	1080.46	1070.32	1092.06	1089.02	1072.65	1018.47	1073.83	1066.30	1077.79	1129.19	1085.38	1077.84	1135.35	1090.82	1126.84	1090.07	Snowflake	snowflake-arctic-instruct	10/23/2024	2024/4	Apache 2.0	5021.00
104.00	Zephyr-7b-alpha	1040.92	1039.08	1059.15	1045.64	1025.16	1034.30	1075.84	1041.73	1006.28	1014.12	1033.04	1038.26	1012.29	1011.53	1022.89	1018.34	1039.16	1042.81	1004.48	913.11	1078.07	1303.17	1047.56	1001.26	HuggingFace	zephyr-7b-alpha	10/23/2024	2023/10	MIT	401.00
110.00	Llama-2-70b-chat	1093.20	1061.51	1065.09	1081.27	1063.10	1072.29	1079.02	1075.05	1058.34	1081.33	1094.72	1092.03	1083.59	1071.84	1070.46	1070.60	1096.70	1057.10	1046.95	1027.27	1109.10	1110.70	1106.37	1137.91	Meta	llama-2-70b-chat	10/23/2024	2023/7	Llama 2 Community	6550.00
111.00	Mistral-7B-Instruct-v0.2	1072.31	1066.65	1063.15	1067.12	1063.49	1073.82	1075.59	1067.53	1056.71	1070.22	1072.20	1071.29	1050.22	1071.79	1068.63	1071.17	1081.83	1068.56	983.38	979.17	1042.49	1061.51	1045.68	1024.99	Mistral	mistral-7b-instruct-v0.2	10/23/2024	2023/12	Apache-2.0	3037.00
113.00	DeepSeek-LLM-67B-Chat	1076.79	1086.77	1082.76	1090.98	1072.77	1079.16	1065.34	1082.27	1070.08	1077.67	1078.16	1076.76	1065.61	1100.16	1065.21	1060.03	1063.90	1179.53	1000.25	1005.73	1162.06	1170.46	1158.53	1062.39	DeepSeek AI	deepseek-llm-67b-chat	10/23/2024	2023/11	DeepSeek License	796.00
117.00	Gemma-1.1-7b-it	1083.75	1106.73	1103.71	1097.63	1095.84	1084.56	1069.99	1071.54	1079.03	1043.71	1086.69	1081.40	1061.79	1072.31	1077.09	1077.45	1078.79	1119.09	1019.42	1050.17	1134.12	1139.48	1076.08	1052.07	Google	gemma-1.1-7b-it	10/23/2024	2024/2	Gemma license	3589.00
121.00	Vicuna-13B	1042.22	1042.57	1081.10	1058.85	1035.54	1032.27	1063.79	1040.82	999.66	1032.81	1041.41	1040.45	1011.04	1061.68	1025.40	1017.99	1028.39	1098.07	994.74	992.15	1126.73	1048.05	1072.56	1069.24	LMSYS	vicuna-13b	10/23/2024	2023/7	Llama 2 Community	3429.00
123.00	Phi-3-Mini-4k-Instruct-June-24	1070.74	1073.72	1058.92	1067.66	1088.70	1082.41	1057.83	1074.84	1123.49	1054.55	1074.45	1071.26	1020.30	1055.75	1095.75	1101.10	1082.35	1094.18	1051.96	1029.56	1124.17	1033.44	1048.84	1132.06	Microsoft	phi-3-mini-4k-instruct-june-2024	10/23/2024	2023/10	MIT	2118.00
124.00	Claude-Instant-1	1111.27	1130.84	1105.53	1126.86	1124.48	1108.95	1060.41	1107.20	1111.15	1146.96	1129.93	1110.76	1110.37	1133.85	1107.06	1100.26	1096.96	1145.53	1079.48	1104.69	1191.01	1139.24	1131.73	1100.30	Anthropic	claude-instant-1	10/23/2024	-	Proprietary	3629.00
125.00	Meta-Llama-3.2-1b-Instruct	1053.43	1008.67	1045.42	1043.62	1039.66	1047.03	1045.22	1053.24	1064.96	1038.68	1057.41	1052.21	982.25	1072.60	1060.45	1079.28	1080.78	1025.76	1018.91	1012.82	1076.25	1007.37	971.67	1031.68	Meta	llama-3.2-1b-instruct	10/23/2024	2023/12	Llama 3.2	1178.00
125.00	pplx-70b-online	1077.89	1034.72	1053.65	1075.34	1030.09	1028.35	1050.05	1032.51	1042.62	986.43	1075.92	1076.96	1065.58	1016.48	1028.02	1025.11	1066.52	1127.75	1046.28	1039.20	1207.88	1194.26	1074.35	1063.93	Perplexity AI	pplx-70b-online	10/23/2024	Online	Proprietary	1219.00
128.00	Llama-2-13b-chat	1063.27	1041.76	1044.14	1053.38	1043.01	1051.23	1050.14	1046.70	1032.30	1046.01	1068.59	1061.76	1036.97	1077.79	1049.62	1048.75	1061.03	1055.36	989.50	997.68	1061.42	1090.96	1075.63	1076.03	Meta	llama-2-13b-chat	10/23/2024	2023/7	Llama 2 Community	3387.00
129.00	Claude-2.1	1118.31	1152.52	1097.65	1134.80	1135.82	1131.79	1048.25	1109.73	1122.77	1158.98	1137.12	1117.71	1122.73	1133.33	1119.06	1107.76	1096.91	1146.99	1138.76	1137.01	1207.66	1150.53	1174.73	1122.72	Anthropic	claude-2.1	10/23/2024	-	Proprietary	5812.00
129.00	CodeLlama-70B-instruct	1041.84	1054.47	1004.88	1037.64	1059.79	1047.78	1014.86	1031.28	1032.47	1032.00	1053.00	1039.73	1008.20	998.61	1051.53	1054.19	1046.42	1091.23	864.76	913.92	1116.78	1399.82	1039.22	1015.15	Meta	codellama-70b-instruct	10/23/2024	2024/1	Llama 2 Community	153.00
129.00	Qwen1.5-7B-Chat	1070.13	1081.52	1035.67	1064.73	1057.86	1088.63	1039.78	1063.94	1048.18	1061.06	1069.75	1068.38	1047.53	1102.43	1066.75	1056.05	1054.84	1196.48	1017.25	1022.47	1177.12	1044.83	1034.87	1015.97	Alibaba	qwen1.5-7b-chat	10/23/2024	2024/2	Qianwen LICENSE	731.00
129.00	StripedHyena-Nous-7B	1017.53	1013.23	1046.52	1034.14	1007.07	999.79	1036.01	1012.14	999.88	1011.79	1015.95	1016.22	971.84	994.64	995.84	993.85	1013.46	1029.92	970.41	933.51	1059.00	1057.54	1020.45	990.11	Together AI	stripedhyena-nous-7b	10/23/2024	2023/12	Apache 2.0	884.00
130.00	GPT-3.5-Turbo-1106	1067.81	1126.06	1109.83	1110.49	1118.70	1094.95	1043.73	1090.84	1104.58	1070.98	1081.38	1067.33	1046.21	1088.91	1090.93	1088.66	1052.39	1076.32	1020.76	1066.50	1207.97	1097.63	1104.83	1090.87	OpenAI	gpt-3.5-turbo-1106	10/23/2024	2021/9	Proprietary	2902.00
130.00	Llama-2-7b-chat	1036.90	992.39	1029.51	1024.08	1003.27	1002.44	1040.52	1012.52	1009.79	1027.89	1042.88	1034.69	997.77	1012.60	1010.02	1011.43	1041.13	1032.34	924.04	955.95	1062.67	1049.20	1014.76	989.80	Meta	llama-2-7b-chat	10/23/2024	2023/7	Llama 2 Community	2401.00
130.00	Phi-3-Mini-4k-Instruct	1066.14	1068.77	1029.02	1055.31	1065.76	1085.68	1043.01	1067.41	1084.77	1025.88	1070.16	1065.04	1021.63	1052.42	1078.88	1084.49	1072.51	1081.71	1031.40	1038.47	1099.59	1060.55	1056.45	1093.87	Microsoft	phi-3-mini-4k-instruct	10/23/2024	2023/10	MIT	2985.00
130.00	Qwen-14B-Chat	1035.18	1068.28	1057.62	1056.94	1038.61	1055.80	1034.98	1034.46	1033.12	1019.07	1036.93	1033.22	1000.24	1038.45	1023.82	1017.72	1017.22	1135.14	1026.35	1015.31	1172.07	953.50	1080.46	1082.99	Alibaba	qwen-14b-chat	10/23/2024	2023/8	Qianwen LICENSE	920.00
133.00	CodeLlama-34B-instruct	1042.82	1042.69	1037.90	1047.05	1032.09	1041.99	1034.96	1029.30	1022.11	1012.72	1042.42	1040.74	1012.77	1026.18	1027.88	1022.33	1034.81	1033.25	1006.69	988.73	1030.62	1034.61	1106.05	1119.29	Meta	codellama-34b-instruct	10/23/2024	2023/7	Llama 2 Community	1536.00
133.00	Mistral-7B-Instruct-v0.1	1008.24	1021.76	1048.49	1027.17	1016.03	1008.02	1036.97	1012.80	996.23	1011.34	999.43	1006.78	956.40	1020.49	1002.28	1003.81	1008.52	992.74	897.04	924.68	1036.93	1025.91	1034.22	975.72	Mistral	mistral-7b-instruct	10/23/2024	2023/9	Apache 2.0	1726.00
135.00	Gemma-7b-it	1037.48	1057.09	1053.08	1046.77	1055.27	1046.91	1029.11	1023.42	1032.43	959.01	1040.35	1035.07	999.78	1036.36	1045.15	1045.57	1032.23	1095.57	979.75	978.92	1079.33	1109.73	1014.76	982.81	Google	gemma-7b-it	10/23/2024	2024/2	Gemma license	1389.00
136.00	Phi-3-Mini-128k-Instruct	1036.89	1032.69	1044.03	1048.59	1040.33	1029.31	1034.14	1036.39	1063.65	991.42	1039.83	1035.16	983.40	1015.34	1035.76	1036.35	1034.01	1076.86	993.75	1009.32	1078.55	1026.60	1038.33	1055.68	Microsoft	phi-3-mini-128k-instruct	10/23/2024	2023/10	MIT	3136.00
138.00	Vicuna-7B	1005.14	992.03	1040.20	1021.72	1001.89	981.52	1023.45	995.70	963.96	987.26	1004.19	1002.44	964.44	1047.73	989.78	979.27	989.17	1028.69	1006.50	962.39	1128.81	945.30	1047.02	1066.51	LMSYS	vicuna-7b	10/23/2024	2023/7	Llama 2 Community	1336.00
142.00	Gemma-1.1-2b-it	1020.72	1062.38	1050.48	1038.60	1042.49	1035.98	1010.71	1006.47	1022.79	962.89	1022.94	1017.21	955.70	1019.79	1015.86	1016.93	1013.66	1076.56	967.63	947.88	1069.96	1048.46	1020.07	993.92	Google	gemma-1.1-2b-it	10/23/2024	2024/2	Gemma license	1569.00
145.00	pplx-7b-online	1044.58	1017.85	1009.00	1040.99	1017.33	1015.19	1007.18	997.95	1013.97	990.54	1039.80	1043.63	1017.78	994.87	1016.34	1013.56	1039.16	1084.11	928.86	947.10	1158.57	1109.70	1056.62	1041.71	Perplexity AI	pplx-7b-online	10/23/2024	Online	Proprietary	1129.00
148.00	OLMo-7B-instruct	1015.37	998.29	960.46	993.13	977.68	1017.17	996.12	987.59	987.94	1005.32	1013.07	1014.13	964.38	1057.45	994.08	993.36	1018.37	1072.36	879.68	885.25	993.52	927.43	971.10	975.32	Allen AI	olmo-7b-instruct	10/23/2024	2024/2	Apache-2.0	1041.00
152.00	Gemma-2b-it	989.60	1016.39	1026.93	1007.19	1008.20	1000.47	989.56	975.99	978.68	936.79	992.29	986.40	923.60	997.71	987.25	976.49	981.63	1050.54	855.77	909.90	1019.53	1044.07	965.10	985.36	Google	gemma-2b-it	10/23/2024	2024/2	Gemma license	712.00
152.00	PaLM-Chat-Bison-001	1003.61	1029.10	1043.57	1042.64	1037.21	990.21	998.32	1014.28	1015.12	993.18	997.32	1000.26	960.76	1014.22	1000.88	1010.51	1006.06	931.88	883.93	866.68	1066.97	1011.46	1021.33	894.55	Google	palm-2	10/23/2024	2021/6	Proprietary	1613.00
153.00	ChatGLM3-6B	955.44	966.59	994.04	975.05	963.17	952.95	973.61	961.29	954.53	957.96	947.47	952.90	876.11	970.18	953.19	955.20	949.36	1122.93	790.06	822.13	1041.35	939.49	923.89	924.17	Tsinghua	chatglm3-6b	10/23/2024	2023/10	Apache-2.0	833.00
153.00	GPT4All-13B-Snoozy	932.08	945.19	1012.07	972.59	957.87	909.57	972.30	947.29	903.43	922.12	928.63	930.33	858.02	950.72	931.25	931.79	930.60	932.47	715.11	812.09	923.78	970.96	979.10	880.59	Nomic AI	gpt4all-13b-snoozy	10/23/2024	2023/3	Non-commercial	259.00
154.00	Qwen1.5-4B-Chat	988.32	1005.65	1005.08	1015.13	995.11	990.17	975.08	983.99	992.79	978.00	989.01	985.09	911.81	1004.59	977.52	965.31	966.86	1084.18	926.79	904.89	1030.18	989.71	978.54	1013.23	Alibaba	qwen1.5-4b-chat	10/23/2024	2024/2	Qianwen LICENSE	1116.00
155.00	Alpaca-13B	901.81	870.15	1036.44	967.91	888.99	789.43	965.41	888.84	873.55	881.96	889.16	895.46	816.30	923.67	818.90	814.86	892.58	828.68	806.45	848.82	898.12	945.96	1032.89	930.96	Stanford	alpaca-13b	10/23/2024	2023/3	Non-commercial	971.00
155.00	Koala-13B	964.57	944.60	993.27	979.89	931.70	937.27	972.14	941.31	897.79	918.28	964.02	961.47	906.18	885.70	924.73	919.54	961.02	926.86	876.36	907.51	1025.29	916.45	926.94	932.90	UC Berkeley	koala-13b	10/23/2024	2023/4	Non-commercial	1211.00
156.00	MPT-7B-Chat	927.88	938.57	999.04	967.37	924.99	899.81	956.28	909.86	886.42	900.64	925.72	924.68	850.46	804.01	891.24	886.16	915.78	1004.28	880.28	905.10	962.25	1034.06	837.68	886.53	MosaicML	mpt-7b-chat	10/23/2024	2023/5	CC-BY-NC-SA-4.0	697.00
157.00	ChatGLM2-6B	924.36	903.99	961.48	943.07	928.05	892.37	948.74	909.15	893.47	902.07	910.81	920.19	831.50	891.68	915.18	916.44	924.94	1047.70	764.49	661.75	923.63	928.75	849.29	852.38	Tsinghua	chatglm2-6b	10/23/2024	2023/6	Apache-2.0	575.00
161.00	RWKV-4-Raven-14B	921.96	916.85	953.98	949.34	912.14	896.58	933.76	885.85	888.44	892.65	914.92	918.42	845.91	841.41	890.95	878.19	906.30	952.71	878.44	872.82	1026.05	874.60	999.23	912.63	RWKV	RWKV-4-Raven-14B	10/23/2024	2023/4	Apache 2.0	895.00
163.00	OpenAssistant-Pythia-12B	893.62	905.20	959.15	931.81	914.19	873.14	920.98	889.38	858.74	865.47	885.35	890.20	802.50	866.23	880.43	874.60	887.68	860.54	874.93	836.12	863.24	922.39	842.51	932.98	OpenAssistant	oasst-pythia-12b	10/23/2024	2023/4	Apache 2.0	1104.00
166.00	ChatGLM-6B	879.43	891.04	902.28	888.70	897.92	883.79	901.84	899.40	891.66	854.30	866.95	874.16	775.57	939.11	893.75	870.80	858.22	1132.02	722.60	686.97	978.84	813.85	730.92	708.13	Tsinghua	chatglm-6b	10/23/2024	2023/3	Non-commercial	778.00
166.00	FastChat-T5-3B	868.28	790.07	938.06	896.58	832.58	759.33	900.49	857.63	828.34	852.33	858.59	863.51	757.92	951.10	808.72	806.05	870.99	756.86	814.50	771.70	743.33	815.13	732.30	820.76	LMSYS	fastchat-t5-3b	10/23/2024	2023/4	Apache 2.0	755.00
168.00	Dolly-V2-12B	822.30	816.87	918.15	882.08	856.74	745.77	864.14	812.89	837.31	739.00	807.32	817.22	691.74	859.19	797.39	785.82	804.14	876.23	808.81	743.75	933.68	860.70	794.04	822.76	Databricks	dolly-v2-12b	10/23/2024	2023/4	MIT	575.00
168.00	StableLM-Tuned-Alpha-7B	840.16	865.78	882.56	858.92	841.83	858.31	869.39	831.22	804.34	820.19	829.67	834.14	712.22	880.76	830.20	825.40	830.43	893.02	709.49	721.33	853.00	804.21	752.17	827.68	Stability AI	stablelm-tuned-alpha-7b	10/23/2024	2023/4	CC-BY-NC-SA-4.0	545.00
172.00	LLaMA-13B	799.49	748.68	880.82	867.80	797.70	668.73	796.25	778.50	801.60	752.61	788.48	796.57	649.21	801.40	721.57	709.85	778.80	852.77	745.20	693.73	954.67	633.62	808.04	817.19	Meta	llama-13b	10/23/2024	2023/2	Non-commercial	432.00

Back to Leaderboard History