"moonshot-v1-8k"
"moonshot-v1-8k"
Alias for model
Whether to stream the results or not. Defaults to false.
Optional apiAPI key to use when making requests. Defaults to the value of
MOONSHOT_API_KEY environment variable.
Optional frequencyFrequency penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on their existing frequency in the text, making the model less likely to repeat the same words verbatim. The default value is 0
Optional maxDifferent models have different maximum values. For example, the maximum value of moonshot-v1-8k is 8192. Defaults to 1024
Optional messagesMessages to pass as a prefix to the prompt
Optional nThe default value is 1 and cannot be greater than 5. In particular, when temperature is very small and close to 0, we can only return 1 result. If n is already set and > 1, Moonshot will return an invalid input parameter (invalid_request_error).
Optional presenceThere is a penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on whether they appear in the text, increasing the likelihood that the model will discuss new topics. The default value is 0
Optional stopOptional temperatureAmount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0, recommended 0.3
Optional topPTotal probability mass of tokens to consider at each step. Range from 0 to 1. Defaults to 1
Generated using TypeDoc
Interface defining the input to the MoonshotChatInput class.