Skip to main content

LLM Providers

Large Language Model (LLM) Providers are the core AI engines that give your workflows reasoning, comprehension, and text generation capabilities.

To manage your LLM providers, navigate to LLM Settings → LLM Providers from the main navigation menu. This screen lists all configured providers.

Creating an LLM Provider​

  1. Click the + Add New Provider button in the top-right corner.
  2. The Create LLM Provider dialog will appear.
  3. Provide a Name for the provider.
  4. Select the provider Type from the drop-down list. The required configuration fields (e.g., API Key, Base URL, Model) will change based on your selection.
  5. Toggle the Advanced switch to configure parameters like Temperature, Max Tokens, and Timeout to fine-tune the model’s behavior. (Optional)
  6. Ensure the Active toggle is enabled.
  7. Click Create.

Editing an LLM Provider​

  1. Click in the Action column.
  2. The Edit LLM Provider dialog will appear, prefilled with the existing information.
  3. Make the necessary changes.
  4. Click Update to save the changes.

Deleting an LLM Provider​

  1. Click in the Action column.
  2. A confirmation dialog will appear to prevent accidental deletion.
  3. Click Delete to permanently remove the LLM provider.