Prerequisite Please see here to learn more about how to use Optimodel with Lytix.
To set a TTL for your query, just pass the extra cacheTTL parameter. This is a value in seconds
Copy
from optimodel import queryModel, listModels, ModelMessage, ModelTypesprompt = "Hello How are you?"response = await queryModel( ...All the same params # Just add this extra param cacheTTL=60*1 # 1 minute)print("Got response:", response)