LLM7 Chat Model icon

LLM7 Chat Model

Use llm7.io or any OpenAI-compatible API as a chat model. Direct HTTP, no ChatOpenAI.

LLM7 Chat Model

AI-generated

Summary

Configure and instantiate a chat model connection to an OpenAI-compatible API (defaulting to llm7.io), specifying the API endpoint, model identifier, and generation options.

Inputs

  • Base URL (required) — The OpenAI-compatible API endpoint to send chat completion requests to.
  • API Key — API key for authentication; leave empty or type "unused" to use the llm7.io free tier.
  • Model (required) — Identifier of the model to use (e.g., default, fast, pro, gpt-4o-mini for llm7.io).
  • Options — Generation options including Temperature (creativity of output), Max Tokens (maximum response length), and Timeout in seconds for the API request.

Output shape

a single AI language model instance object wrapped inside a response object as { response: chatModel }

The returned object is a configured chat model instance that can be used to generate chat completions in subsequent workflow steps. The output does not contain the generated text itself but the model interface that manages generation.

Links

Discussion