| Model                               | Parameter Count | Context Length | Model Type      |
| :---------------------------------- | :-------------- | :------------- | :-------------- |
| `llama-3-sonar-small-32k-online`  | 8B              | 28,000         | Chat Completion |
| `llama-3-sonar-small-32k-chat`    | 8B              | 32,768         | Chat Completion |
| `llama-3-sonar-large-32k-online`  | 70B             | 28,000         | Chat Completion |
| `llama-3-sonar-large-32k-chat`    | 70B             | 32,768         | Chat Completion |
| `llama-3.1-sonar-small-128k-online` | 8B              | 127,072        | Chat Completion |
| `llama-3.1-sonar-small-128k-chat`   | 8B              | 131,072        | Chat Completion |
| `llama-3.1-sonar-large-128k-online` | 70B             | 127,072        | Chat Completion |
| `llama-3.1-sonar-large-128k-chat`   | 70B             | 131,072        | Chat Completion |
| `llama-3-8b-instruct`  | 8B              | 8,192          | Chat Completion |
| `llama-3-70b-instruct`  | 70B             | 8,192          | Chat Completion |
| `mixtral-8x7b-instruct` | 8x7B            | 16,384         | Chat Completion |
| `llama-3.1-8b-instruct`   | 8B              | 131,072        | Chat Completion |
| `llama-3.1-70b-instruct`  | 70B             | 131,072        | Chat Completion |