Use Lytix to manage your evaluation and usage diretly with the OpenAI SDK. Gain access to models across providers and manage your usage and billing.

Quickstart

Prerequisite First create a lytix account here

Create a Lytix API Key

Start by creating and noting down a lytix api key. See instructions here

Update your OpenAI SDK

With 2 lines you can start using Lytix to manage your evaluation and usage.

🇪🇺 Note You will need to use https://eu.api.lytix.co/proxy/v1/openai if you are in the EU region.

Optional Fields

You can also track workflows, users and sessions to get a better understanding of your users and how they interact with your models.

  • sessionId: A unique identifier for the session.
  • userId: A unique identifier for the user.
  • workflowName: A unique identifier for the workflow. If this workflow does not exist, it will be created and can be viewed here

Using Models From Other Providers

Beyond the models available on the OpenAI API, Lytix also supports a range of other models from different providers. Just add the credentials for the model/provider and you can start using them immediately.

Then just update our model field to the model you want to use.

Passing in Credentials

To pass in credentials for a provider, you can add the credentials to the headers. The following is a list of credentils you can pass in:

  • mistralApiKey: The API key for the Mistral model.
  • openaiKey: The API key for the OpenAI model.
  • anthropicApiKey: The API key for the Anthropic model.
  • groqApiKey: The API key for the Groq model.
  • togetherApiKey: The API key for the Together model.

Bedrock To run models via bedrock, 3 headers are required:

  • awsAccessKeyId: The access key for the AWS account.
  • awsSecretKey: The secret access key for the AWS account.
  • awsRegion: The session token for the AWS account.

Supported Models & Providers

title

You can see the list of up to date models and providers here and clicking “Available Models”.