LLM IO Event
How to trace the duration of your LLM interactions
Prerequisite Please see here to get and set your API Key environment variable.
Install the Lytix pip package
Make sure to set your API key e.g. export LX_API_KEY=...
Capture Model Trace
Lytix also supports capturing trace information (e.g. duration) for the LLM model. To do this you can use the following
You’ll now see the model duration trace in the Lytix platform here.
Examples
To see all examples please check the Github repo here