OpenAI compatible API. Attested gateway. Public status.

Meta: Llama 3.1 8B Instruct

All providers serving Meta: Llama 3.1 8B Instruct via TrustedRouter.

Verify gateway
1 URLbase_url migration
100smodels and routes
0prompt logs by default

meta-llama/llama-3.1-8b-instruct

Cerebras

All models

PublisherCerebras (cerebras)
Context131,072 tokens
Providers
Endpoints4 endpoints
Modes chat
Routes prepaid BYOK

Providers serving this model

Sorted by lowest combined prompt and completion price. Use "provider": {"sort": "throughput"} in the request body (or append :nitro to the model id) to route to the fastest provider instead.

Provider Usage Prompt Completion Attested TR stores content Provider policy
Novita AI (novita) Credits $0.022/1M $0.055/1M yes yes upstream varies
Novita AI (novita) BYOK $0.022/1M $0.055/1M yes yes upstream varies
Cerebras (cerebras) BYOK $0.198/1M $0.198/1M yes yes ZDR
Together (together) BYOK $0.198/1M $0.198/1M yes no ZDR

Sign in

Choose a sign in method.