Back to models
FastestChat Models

Groq

LLaMA 3.1 8B Instant

Ultra-fast responses for simple tasks at roughly 560 tokens per second.

Fast560 tok/s
Open AppBrowse All Models

Same provider

More from Groq

Groq

GPT-OSS 120B

Open-source GPT running on Groq LPU at roughly 500 tokens per second.

Groq

GPT-OSS 20B

Ultra-fast lightweight GPT running at roughly 1000 tokens per second on Groq LPU.

Groq

Compound Mini

Lightweight compound agent with tool use at roughly 450 tokens per second.

Groq

Compound

Groq compound AI system with tool use and web search.