Use Lytix to manage your evaluation and usage diretly with the Gemini SDK. Gain access to models across providers and manage your usage and billing.
Note Currently this is only supported for the Typescript Gemini SDK.

​
Quickstart

Prerequisite First create a lytix account here

​
Create a Lytix API Key

Start by creating and noting down a lytix api key. See instructions here

​
Install the Gemini SDK

Typescript
npm install @google/generative-ai

​
Initialize the GoogleGenerativeAI client

Typescript
import { GoogleGenerativeAI } from "@google/generative-ai";

const genAI = new GoogleGenerativeAI(
  "$GEMINI_API_KEY"
);

​
Initialize the Gemini Model with the Lytix Proxy

Typescript
const customHeaders = new Headers({
  "lx-api-key": "$LYTIX_API_KEY",
});

const requestOptions = {
  customHeaders: customHeaders,
  baseUrl: "https://api.lytix.co/proxy/v1/gemini",
};

const model = genAI.getGenerativeModel(
  {
    model: "$GEMINI_MODEL",
  },
  requestOptions
);
🇪🇺 Note You will need to use https://eu.api.lytix.co/proxy/v1/gemini if you are in the EU region.

​
Invoke the Model 🚀

Typescript
const result = await model.generateContent([
  "Hello world!"
]);

const response = result.response;
const text = await response.text();

​
Optional Fields

You can also track workflows, users and sessions to get a better understanding of your users and how they interact with your models.
  • sessionId: A unique identifier for the session.
  • userId: A unique identifier for the user.
  • workflowName: A unique identifier for the workflow. If this workflow does not exist, it will be created and can be viewed here
const customHeaders = new Headers({
  "lx-api-key": "$LYTIX_API_KEY",
  // Add your sessionId to track sessions
  "sessionId": "1234567890",
  // Add your userId to track users
  "userId": "sid@lytix.co",
  // Add your workflowName to track workflows
  "workflowName": "test-workflow",
});

// ...The rest of your code as normal

​
Saving Video Responses

Please see our Video Integration Guide for more information.

​
Using Models From Other Providers

Coming soon. ⚡