Datasets are ways to group and save LLM interactions. You can use datasets to save important interactions, or start to create a library of events to use for training, evaluation, and more.
Automatically Adding Certain Evaluations to a Dataset
You can automatically add certain evaluations to a dataset by setting up a rule on the evaluation itself.This will automatically add evaluations that meet the given critera to the dataset. This is helpful if you are trying to collect data to fine tune a model
You can setup a webhook to be called when an interaction is added to a dataset. This is useful if you are trying store data in an external system.You can do this by clicking the dataset settings, and entering a webhook URL.The body of the webhook is as follows: