LLM IO Event
How to trace the duration of your LLM interactions
Prerequisite Please see here to get and set your API Key environment variable.
Install the Lytix NPM package
LLM Model Input Output Collection
Lytix supports automatically collecting the input and output of LLM models. To do this you can use the following
Lytix will automatically process the input and output of the LLM model and push the metrics to the Lytix platform. You can see your model metrics in the Lytix platform here.
LLM Model Trace Collection
Lytix also supports capturing trace information (e.g. duration) for the LLM model. To do this you can use the following
You’ll now see the model duration trace in the Lytix platform here.