Function set_llm_cache

Source
pub fn set_llm_cache(cache: Option<Box<dyn BaseCache>>) -> Result<()>
Expand description

Set the global LLM cache

§Arguments

  • cache - The new LLM cache to use. If None, the LLM cache is disabled.

§Returns

A Result indicating success or failure

§Panics

This function will panic if init_globals() has not been called first.