Optimodel
Prerequisite Please see here to learn more about how to use Optimodel with Lytix.
cacheTTL
parameter. This is a value in seconds
OpenAI Client
Prerequisite Please see here to learn more about how to use OpenAI with Lytix.
cacheTTL
header when making your request. This is a value in seconds.
Viewing Cache Hits
You can view the cache hits on the Lytix dashboard here