Model Metrics
Model Query
Query optimodel via the Lytix SAAS
POST
Authorizations
Body
application/json
Messages to use for the query
Model to use for the query
Available options:
llama_3_8b_instruct
, llama_3_70b_instruct
, llama_3_1_405b
, llama_3_1_70b
, llama_3_1_8b
, claude_3_5_sonnet
, claude_3_haiku
, mistral_7b_instruct
, mixtral_8x7b_instruct
, gpt_4
, gpt_3_5_turbo
, gpt_4o
, gpt_4_turbo
, gpt_3_5_turbo_0125
, gpt_4o_mini
Whether to use json mode
Max generations of the query
Provider to use for the query
Available options:
openai
, groq
, bedrock
, anthropic
, together
Speed priority of the query (low or high)
Available options:
low
, high
Temperature of the query