Configuration

November 16, 2025 ยท View on GitHub

How to configure the Model to optimize it for your needs.

The configuration mostly depends on the model binding, for most cases is llama.cpp.

You can config the model by the following steps:

  1. Click on the settings button on the Catai chat WebUI:

    Settings Button

  2. Edit configuration (JSON file):

    If the model binding is node-llama-cpp or node-llama-cpp-v2, You can find the configuration here:

    LlamaContextOptions

    LLamaChatPromptOptions

    You can edit the systemPrompt of the chat too.

  3. Restart the server. Restart Button