General chat clients

AnythingLLM

Self-hosted RAG and chat workspace.

AnythingLLM treats FreeTheAi as a `Generic OpenAI` provider. Type the alias, set the context window, save.

Base URL https://api.freetheai.xyz/v1
Recommended models bbg/moonshotai/Kimi-K2.6
Chat completions Streaming Tool calling
Get a free key Official docs GitHub repo
Step by step

Connect AnythingLLM to FreeTheAi.

  1. 1

    Open LLM Preference

    Click `Settings` in the sidebar, then `LLM Preference`.

  2. 2

    Pick Generic OpenAI

    Set `LLM Provider` to `Generic OpenAI` and fill in the form.

    text 
    Base URL: https://api.freetheai.xyz/v1
API Key: PASTE_YOUR_FREETHEAI_KEY
Chat Model Name: bbg/moonshotai/Kimi-K2.6
Token context window: 50000
  3. 3

    Save

    Hit save. AnythingLLM will use FreeTheAi for chat workspaces.

Recommended aliases

Models that pair well with AnythingLLM.

  • bbg/moonshotai/Kimi-K2.6
  • bbg/zai-org/GLM-5.1
  • wsf/kimi-k2.6

See the full live catalog at /models. Aliases are stable; pricing on the free tier stays $0.

Heads up

Common gotchas.

  • AnythingLLM does not auto-fetch the catalog for Generic OpenAI - you have to type the alias and context window manually.
  • The Embedding Preference tab is separate. Leave it on a working embedding provider unless FreeTheAi exposes embeddings on your plan.
Where to next

Keep building.

All setup guides Quickstart Cross-compatibility docs Model catalog Ask in Discord