OpenAI compatible API. Attested gateway. Public status.

DeepInfra

DeepInfra models on TrustedRouter with prices, routes, policy notes, and source links.

Verify gateway

1 URLbase_url migration

100smodels and routes

0prompt logs by default

`deepinfra`

No logs

All providers

Provider	DeepInfra
Models	8 public models
Prepaid routes	8
BYOK routes	8
Zero data retention	yes
Confidential compute	not claimed
Provider E2EE	not claimed
Policy note	Tracked as provider ZDR — DeepInfra documents memory-only handling with no storage of API content and no training on submitted API data. (Exception: requests to Google/Anthropic-backed models inherit those vendors' policies.) Policy source

Measured performance

320 samples

Continuously sampled across DeepInfra's routed models — p50 TTFT, throughput, and success rate. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.

p50 TTFT	679 ms
Throughput	—
Uptime	6.25%

Model	p50 TTFT	p50 TTFB	Throughput	Uptime	Config excluded	Samples
google/gemma-3-12b-it	552 ms	551 ms	—	12.73%	—	55
google/gemma-4-26b-a4b-it	648 ms	646 ms	—	4.44%	—	45
google/gemma-3-4b-it	679 ms	678 ms	—	8.00%	—	50
meta-llama/llama-3.1-70b-instruct	840 ms	738 ms	—	4.00%	—	25
google/gemma-3-27b-it	1090 ms	1087 ms	—	6.12%	—	49
qwen/qwen3.5-27b	1255 ms	1153 ms	—	6.00%	—	50
google/gemma-4-31b-it	—	—	—	0.00%	—	46

Full provider & model leaderboard.

Provider models

Models served by DeepInfra.

Each row links to pricing, provider, benchmark, and API pages for the model.

Model	Context	Endpoints	Prompt	Completion	Routes
`Qwen/Qwen3-Embedding-8B` Qwen3 Embedding 8B benchmarks performance api	32,000	2	$0.011/1M	selected route	prepaid BYOK
`google/gemma-3-12b-it` Google: Gemma 3 12B benchmarks performance api	131,072	2	$0.055/1M	$0.165/1M	prepaid BYOK
`google/gemma-3-27b-it` Google: Gemma 3 27B benchmarks performance api	131,072	2	$0.088/1M	$0.176/1M	prepaid BYOK
`google/gemma-3-4b-it` Google: Gemma 3 4B benchmarks performance api	131,072	2	$0.055/1M	$0.11/1M	prepaid BYOK
`google/gemma-4-26b-a4b-it` Google: Gemma 4 26B A4B benchmarks performance api	262,144	2	$0.077/1M	$0.374/1M	prepaid BYOK
`google/gemma-4-31b-it` Google: Gemma 4 31B benchmarks performance api	262,144	2	$0.143/1M	$0.418/1M	prepaid BYOK
`meta-llama/llama-3.1-70b-instruct` Meta: Llama 3.1 70B Instruct benchmarks performance api	131,072	2	$0.44/1M	$0.44/1M	prepaid BYOK
`qwen/qwen3.5-27b` Qwen: Qwen3.5-27B benchmarks performance api	262,144	2	$0.286/1M	$2.86/1M	prepaid BYOK