Machine Learning — entry 006 of 24

Groq

Verified Jul 2026

Groq runs open models such as Llama, Mixtral, and Gemma on its own LPU inference hardware, exposing them through a REST API that's a near drop-in replacement for the OpenAI chat completions endpoint. Pricing is pay-per-token and varies by model (roughly $0.05-$3 per million tokens), with a free API key available to get started and no separate infrastructure fee. The console also offers batch processing at a 50% discount and prompt-caching discounts for repeated context.

llminferenceopenai-compatiblechat-completionslow-latency
AuthenticationAPI KeySign up with the provider to obtain credentials.
HTTPSSupportedTraffic is encrypted in transit.
CORSEnabledCallable directly from browser JavaScript.
PricingFreemiumA usable free tier exists, with paid plans for more volume.
FormatsJSONResponses can be requested as JSON.

GreatAPIs Score

Score75out of 100
Authentication15/25API key required
Pricing17/20Freemium tier available
Docs14/20Documentation URL provided
Formats9/15Single response format
Freshness20/20Verified within 6 months

Embed this badge

Scored 75 on greatapis.com
<a href="https://greatapis.com/api/groq/"><img src="https://greatapis.com/badge/groq.svg" alt="Scored 75 on greatapis.com"></a>

Auth quickstart

  1. Sign up with the provider to get an API key.
  2. Send it on every request as a headerAuthorization: <key>
  3. The exact header isn't documented — Authorization is a common default; confirm in the provider's docs.
Stored keyNo key stored

Your key is stored only in this browser (localStorage) and sent directly to the API — never to greatapis.