Model scorecard
Meta llama-3.1-8b-instruct
Composite 73.8/100 across quality, throughput, latency, price efficiency and usable context — measured through the gateway, not vendor-reported.
A73.8/100meta/llama-3.1-8b-instructtext · 128k context
Capability
eval compositeQuality (blended eval)68
Category: cheap
Usable context6
128k advertised window
Serving
gateway measuredThroughput100
380 output tokens/s median
Time to first token91
55ms p50
Economics
at provider costPrice efficiency100
$0.05 per 1M output tokens
Quality per dollar100
llmcloud adds $0 to these token prices.
Suggested usage
Not a default pick today. It is a reasonable explicit choice when you need this vendor specifically, or as a failover target inside auto:cheap.
→ Full workload matrix