Use Lytix to manage your evaluation and usage diretly with the Gemini SDK. Gain access to models across providers and manage your usage and billing.

Note Currently this is only supported for the Typescript Gemini SDK.

Quickstart

Prerequisite First create a lytix account here

Create a Lytix API Key

Start by creating and noting down a lytix api key. See instructions here

Install the Gemini SDK

Typescript
npm install @google/generative-ai

Initialize the GoogleGenerativeAI client

Typescript
import { GoogleGenerativeAI } from "@google/generative-ai";

const genAI = new GoogleGenerativeAI(
  "$GEMINI_API_KEY"
);

Initialize the Gemini Model with the Lytix Proxy

Typescript
const customHeaders = new Headers({
  "lx-api-key": "$LYTIX_API_KEY",
});

const requestOptions = {
  customHeaders: customHeaders,
  baseUrl: "https://api.lytix.co/proxy/v1/gemini",
};

const model = genAI.getGenerativeModel(
  {
    model: "$GEMINI_MODEL",
  },
  requestOptions
);

🇪🇺 Note You will need to use https://eu.api.lytix.co/proxy/v1/gemini if you are in the EU region.

Invoke the Model 🚀

Typescript
const result = await model.generateContent([
  "Hello world!"
]);

const response = result.response;
const text = await response.text();

Optional Fields

You can also track workflows, users and sessions to get a better understanding of your users and how they interact with your models.

  • sessionId: A unique identifier for the session.
  • userId: A unique identifier for the user.
  • workflowName: A unique identifier for the workflow. If this workflow does not exist, it will be created and can be viewed here

Saving Video Responses

Please see our Video Integration Guide for more information.

Using Models From Other Providers

Coming soon. ⚡