NVIDIA NIM Chat Model icon

NVIDIA NIM Chat Model

For advanced usage with an AI chain or AI agent

NVIDIA NIM Chat Model

AI-generated

Summary

Returns a configured ChatOpenAI language model instance for the selected NVIDIA NIM model and options, to be used as the chat model input of AI Agent or AI Chain nodes.

Inputs

None.

Output shape

single

Output is named 'Model' and provides an AiLanguageModel (ChatOpenAI) instance.

Examples

Example 1: Use as language model in an AI Agent

Select a model (e.g., meta/llama-3.1-8b-instruct), adjust temperature, top P, penalties, max tokens, response format, timeout, and max retries via the Options collection.

Links

Discussion