AnythingLLM API: FreeTheAI with Generic OpenAI
AnythingLLM uses FreeTheAI through its Generic OpenAI provider.
Steps
Open the LLM settings
Open Settings, then AI Providers, then LLM.
Choose Generic OpenAI
Set the provider to Generic OpenAI and fill in the values above.
Save
Press Save changes. Workspaces now answer with the FreeTheAI model.
How this guide was checked: Checked against AnythingLLM's source (Generic OpenAI options) on 2026-09-29.
Tips
- Keep embeddings on AnythingLLM's built-in embedder. FreeTheAI serves chat models only.
Troubleshooting
Which provider do I pick in AnythingLLM?
Generic OpenAI. The plain OpenAI provider always calls api.openai.com.
Common errors
- 401: the key is wrong or incomplete. Paste the whole key.
- 403: follow a provider of the model, or confirm your email.
- 404: the model ID or URL is wrong.
- 429: daily limit reached, or too many requests at once.