
Request Access For A Free Trial
Processing...













Processing...
Thanks for requesting access to Abacus.AI, we will get back to you shortly
GPT - 3.5 (PROP) | GEMINI PRO (PROP) | MISTRAL - SMALL (PROP) | MISTRAL - MEDIUM (PROP) | SMAUG - 72B (PROP) | |
MMLU | 70.0 | 71.8 | 70.6 | 75.3 | 77.15 |
HellaSwag | 85.5 | 84.7 | 86.7 | 88.9 | 89.27 |
Arc | 85.2 | unknown | 85.8 | 88.9 | 76.02 |
WinoGrade | 81.6 | unknown | 81.2 | 88 | 85.05 |
GSM-8K | 57.1 | unknown | 58.4 | 66.7 | 78.7 |
Truthful QA | unknown | unknown | unknown | unknown | 76.67 |