Authorizations
Body
application/json
Optimodel request
Messages to use for the query
Model to use for the query
Available options:
llama_3_8b_instruct, llama_3_70b_instruct, llama_3_1_405b, llama_3_1_70b, llama_3_1_8b, claude_3_5_sonnet, claude_3_haiku, mistral_7b_instruct, mixtral_8x7b_instruct, gpt_4, gpt_3_5_turbo, gpt_4o, gpt_4_turbo, gpt_3_5_turbo_0125, gpt_4o_mini Speed priority of the query (low or high)
Available options:
low, high Temperature of the query
Max generations of the query
Whether to use json mode
Provider to use for the query
Available options:
openai, groq, bedrock, anthropic, together