Workflows are ways to group and analyze your LLM data. Not all calls to a given model should be evaluated the same way, so workflows allow you to define different evaluation criteria for different models.

In addition to high level metrics, workflows also allow you to define custom evaluation criteria that you can use to evaluate your LLM data.

Setup A Workflow

Workflows are created when data is first pushed and tagged with a given workflow name. There are two ways to create a workflow:

Use an API Key

Use an API key to automatically push data to a workflow. Learn more here.

Use Optimodel to push data to a workflow (see code below)

Use the native OpenAI client to push data to a workflow