Model scorecard
Meta llama-3.1-70b-instruct
Composite 70.8/100 across quality, throughput, latency, price efficiency and usable context — measured through the gateway, not vendor-reported.
B+70.8/100meta/llama-3.1-70b-instructtext · 128k context
Capability
eval compositeQuality (blended eval)79
Category: cheap
Usable context6
128k advertised window
Serving
gateway measuredThroughput69
240 output tokens/s median
Time to first token83
100ms p50
Economics
at provider costPrice efficiency78
$0.60 per 1M output tokens
Quality per dollar100
llmcloud adds $0 to these token prices.
Suggested usage
Not a default pick today. It is a reasonable explicit choice when you need this vendor specifically, or as a failover target inside auto:cheap.
→ Full workload matrix