No selling of your personal data
GPT doesn't retain your search data
French search engine, hosted in Europe
GPT-V3 achieves a significant breakthrough in inference speed over previous models.
It tops the leaderboard among open-source models and rivals the most advanced closed-source models globally.
| Benchmark (Metric) | GPT V3 | GPT V2.5 | Qwen2.5 | Llama3.1 | Claude-3.5 | GPT-4o |
|---|---|---|---|---|---|---|
| Architecture | MoE | MoE | Dense | Dense | - | - |
| # Activated Params | 37B | 21B | 72B | 405B | - | - |
| # Total Params | 671B | 236B | 72B | 405B | - | - |
| MMLU (EM) | 88.5 | 80.6 | 85.3 | 88.6 | 88.3 | 87.2 |
| MMLU-Redux (EM) | 89.1 | 80.3 | 85.6 | 86.2 | 88.9 | 88.0 |
| MMLU-Pro (EM) | 75.9 | 66.2 | 71.6 | 73.3 | 78.0 | 72.6 |
| DROP (3-shot F1) | 91.6 | 87.8 | 76.7 | 88.7 | 88.3 | 83.7 |
| IF-Eval (Prompt Strict) | 86.1 | 80.6 | 84.1 | 86.0 | 86.5 | 84.3 |
| GPOA-Diamond (Pass@1) | 59.1 | 41.3 | 49.0 | 51.1 | 65.0 | 49.9 |
| SimpleQA (Correct) | 24.9 | 10.2 | 9.1 | 17.1 | 28.4 | 38.2 |
| FRAMES (Acc) | 72.3 | 65.4 | 69.8 | 70.0 | 73.5 | 80.5 |
