Skip to content

LLMUnit

PropertyPatternTypeDeprecatedDefinitionTitle/Description
- implementationNoconstNo-LLMUnit
- modelNoReference[LLMModel]NoIn LLMModelOverview of LLMModel components
- temperatureNonumberNo-Temperature
- force_jsonNobooleanNo-Force Json
- max_tokensNointegerNo-Max Tokens
- connection_handlerNoReference[OpenAIConnectionHandler]NoIn OpenAIConnectionHandlerOverview of OpenAIConnectionHandler components

1. Property implementation

Typeconst
RequiredNo

Description: LLMUnit

Specific value: "LLMUnit"

2. Property model

TypeReference[LLMModel]
RequiredNo
Default{"implementation": "gpt-4-turbo"}
Defined inLLMModel

Description: Overview of LLMModel components

3. Property temperature

Title: Temperature

Typenumber
RequiredNo
Default0.3

4. Property force_json

Title: Force Json

Typeboolean
RequiredNo
Defaulttrue

5. Property max_tokens

Title: Max Tokens

Typeinteger
RequiredNo
Defaultnull

6. Property connection_handler

TypeReference[OpenAIConnectionHandler]
RequiredNo
Default{"implementation": "OpenAIConnectionHandler"}
Defined inOpenAIConnectionHandler

Description: Overview of OpenAIConnectionHandler components