With a couple of lines of code, you can start using Lytix to manage your evaluation and usage via the Vercel AI SDK.

Prerequisite First create a lytix account here

Anthropic

Step 1: Install the SDK

Step 2: Update You Client

๐Ÿ‡ช๐Ÿ‡บ Note You will need to use https://eu.api.lytix.co/proxy/v1/anthropic if you are in the EU region.

Step 3: Start Querying

OpenAI

Step 1: Install the SDK

Step 2: Update You Client

๐Ÿ‡ช๐Ÿ‡บ Note You will need to use https://eu.api.lytix.co/proxy/v1/openai if you are in the EU region.

Step 3: Start Querying

Extra Headers

When querying you can pass the following headers to the client:

  • workflowName - The name of the workflow to create (see workflow setup for more information)
  • userId - The id of the user
  • sessionId - The id of the session to group calls together
  • cacheTTL - The number of seconds to cache the response for. Please see caching to setup your cache.