Use Lytix to manage your evaluation and usage diretly with the Gemini SDK. Gain access to models across providers and manage your usage and billing.

Note Currently this is only supported for the Typescript Gemini SDK.

Quickstart

Prerequisite First create a lytix account here

Create a Lytix API Key

Start by creating and noting down a lytix api key. See instructions here

Install the Gemini SDK

Typescript

npm install @google/generative-ai

Initialize the GoogleGenerativeAI client

Typescript

import { GoogleGenerativeAI } from "@google/generative-ai";

const genAI = new GoogleGenerativeAI(
  "$GEMINI_API_KEY"
);

Initialize the Gemini Model with the Lytix Proxy

Typescript

const customHeaders = new Headers({
  "lx-api-key": "$LYTIX_API_KEY",
});

const requestOptions = {
  customHeaders: customHeaders,
  baseUrl: "https://api.lytix.co/proxy/v1/gemini",
};

const model = genAI.getGenerativeModel(
  {
    model: "$GEMINI_MODEL",
  },
  requestOptions
);

🇪🇺 Note You will need to use https://eu.api.lytix.co/proxy/v1/gemini if you are in the EU region.

Invoke the Model 🚀

Typescript

const result = await model.generateContent([
  "Hello world!"
]);

const response = result.response;
const text = await response.text();

Optional Fields

You can also track workflows, users and sessions to get a better understanding of your users and how they interact with your models.

sessionId: A unique identifier for the session.
userId: A unique identifier for the user.
workflowName: A unique identifier for the workflow. If this workflow does not exist, it will be created and can be viewed here

const customHeaders = new Headers({
  "lx-api-key": "$LYTIX_API_KEY",
  // Add your sessionId to track sessions
  "sessionId": "1234567890",
  // Add your userId to track users
  "userId": "sid@lytix.co",
  // Add your workflowName to track workflows
  "workflowName": "test-workflow",
});

// ...The rest of your code as normal

Saving Video Responses

Please see our Video Integration Guide for more information.

Using Models From Other Providers

Coming soon. ⚡

Get Started

API Keys

Proxy

Image & Video

Async Logging

Testing

Users

Metadata

Workflows

Datasets

Caching

Playground

Alerts

Bot Evaluation

Prompts

Integrations

Guardrails

Custom Errors

Custom LLM Tracing

CLI

Gemini Integration

Quickstart

Create a Lytix API Key

Install the Gemini SDK

Initialize the GoogleGenerativeAI client

Initialize the Gemini Model with the Lytix Proxy

Invoke the Model 🚀

Optional Fields

Saving Video Responses

Using Models From Other Providers

​Quickstart

​Create a Lytix API Key

​Install the Gemini SDK

​Initialize the GoogleGenerativeAI client

​Initialize the Gemini Model with the Lytix Proxy

​Invoke the Model 🚀

​Optional Fields

​Saving Video Responses

​Using Models From Other Providers

Quickstart

Create a Lytix API Key

Install the Gemini SDK

Initialize the GoogleGenerativeAI client

Initialize the Gemini Model with the Lytix Proxy

Invoke the Model 🚀

Optional Fields

Saving Video Responses

Using Models From Other Providers