Groq

Groq offers extremely fast inference on popular open-source models. Its free tier works well with Coreply, making it a great starting point.

Groq’s free tier has rate limits. If you encounter errors on the free tier, check whether you’ve hit your rate limit before reporting an issue.

Setup

Get your API key

Go to console.groq.com/keys and create a new API key.

Enter your credentials in Coreply

Open Coreply’s settings and fill in the following values:

Field	Value
API URL	`https://api.groq.com/openai/v1/`
API Key	Your key from Groq
Model Name	See recommended models below

Choose a model

The following models are recommended for use with Coreply on Groq:

openai/gpt-oss-20b
llama-3.1-8b-instant
llama-3.3-70b-versatile

You’re welcome to try other models available in Groq’s model catalog.

⌘I