OpenAI compatible API. Attested gateway. Public status.
Llama3 70B Instruct
All providers serving Llama3 70B Instruct via TrustedRouter.
1 URLbase_url migration
100smodels and routes
0prompt logs by default
meta-llama/llama-3-70b-instruct
Cerebras
| Publisher | Cerebras (cerebras) |
|---|---|
| Context | 8,192 tokens |
| Providers | |
| Endpoints | 2 endpoints |
| Modes | chat |
| Routes | prepaid |
Providers serving this model
Sorted by lowest combined prompt and completion price. Use
"provider": {"sort": "throughput"} in the request body
(or append :nitro to the model id) to route to the
fastest provider instead.
| Provider | Usage | Prompt | Completion | Attested | TR stores content | Provider policy |
|---|---|---|---|---|---|---|
Novita AI (novita) |
Credits | $0.561/1M | $0.814/1M | yes | yes | upstream varies |
Novita AI (novita) |
BYOK | $0.561/1M | $0.814/1M | yes | yes | upstream varies |
Endpoint JSON: https://api.trustedrouter.com/v1/models/meta-llama/llama-3-70b-instruct/endpoints