---
title: "AnythingLLM API: FreeTheAI with Generic OpenAI"
description: "Use FreeTheAI as the LLM in AnythingLLM with the Generic OpenAI provider: base URL, key, model, context window, and max tokens."
url: https://freetheai.org/setup/anythingllm
language: en
updated: 2026-09-29
---

# AnythingLLM API: FreeTheAI with Generic OpenAI

AnythingLLM uses FreeTheAI through its Generic OpenAI provider.

## Settings

- LLM Provider: `Generic OpenAI`
- Base URL: `https://api.freetheai.org/v1`
- API Key: `your FreeTheAI key (ftai_..., 53 characters)`
- Selected Model: `glm-5.3`
- Model context window: `128000`
- Max Tokens: `8192`

## Steps

1. **Open the LLM settings.** Open Settings, then AI Providers, then LLM.
2. **Choose Generic OpenAI.** Set the provider to Generic OpenAI and fill in the values above.
3. **Save.** Press Save changes. Workspaces now answer with the FreeTheAI model.

## Tips

- Keep embeddings on AnythingLLM's built-in embedder. FreeTheAI serves chat models only.

## Troubleshooting

**Which provider do I pick in AnythingLLM?**

Generic OpenAI. The plain OpenAI provider always calls api.openai.com.

Checked: Checked against AnythingLLM's source (Generic OpenAI options) on 2026-09-29.