AnythingLLM Free API: FreeTheAI with Generic OpenAI
AnythingLLM uses FreeTheAI through its Generic OpenAI provider.
Before you start
- Create a free account and an API key. Create an account
- Check in once a day to unlock the free models. Daily check-in
- Pick a model ID from the models page. Browse models
Settings
- LLM Provider
Generic OpenAI- Base URL
https://api.freetheai.org/v1- API Key
your FreeTheAI key (ftai_..., 53 characters)- Selected Model
fta/zai/glm-5.3- Model context window
128000- Max Tokens
8192
Steps
Open the LLM settings
Open Settings, then AI Providers, then LLM.
Choose Generic OpenAI
Set the provider to Generic OpenAI and fill in the values above.
Save
Press Save changes. Workspaces now answer with the FreeTheAI model.
How this guide was checked: Checked against AnythingLLM's source (Generic OpenAI options) on 2026-09-29.
Tips
- Keep embeddings on AnythingLLM's built-in embedder. FreeTheAI serves chat models only.
Troubleshooting
Which provider do I pick in AnythingLLM?
Generic OpenAI. The plain OpenAI provider always calls api.openai.com.
Common errors
- 401: the key is wrong or incomplete. Paste the whole key.
- 403: check in for today, or confirm your email.
- 404: the model ID or URL is wrong.
- 429: daily limit reached, or too many requests at once.