FAQ | Can I use the cache to reduce the cost? #
The LLM Mesh provides caching capabilities that an administrator can configure at the LLM connection level. By caching responses to common queries, the LLM Mesh avoids unnecessary re-generation of answers, reducing avoidable costs.
To enable the use of cache:
-
In the Administration panel > Connections , select your LLM connection or create a new one ( New connection > LLM Mesh ).
-
Under Usage Control , check the Caching option.
