LLM Mesh

Configuration

These are the settings for the features and capabilities in Dataiku allowing you to leverage Large Language Models (LLM) for building your AI-powered applications. These include:

  • Prompt studios
  • Prompt recipes
  • Text classification and summarization recipes
  • Retrieval-augmented models and embedding recipes
  • LLM connections

Retrieval augmented generation

It is recommended to use the dedicated internal code env for retrieval augmented generation. The internal code env for retrieval augmented generation has not been installed yet. Contact your admin to install it. Install it in the Administration Settings.

PII Detection

It is recommended to use the dedicated internal code env for PII detection. The internal code env for PII detection has not been installed yet. Contact your admin to install it. Install it in the Administration Settings.

Hugging Face

Applies per process.
In seconds. Works as a TTL if there is only 1 instance.

Evaluation recipes

See documentation for required packages

Embed documents recipes

Use this connection by default for new managed output folders, even if a better contextual connection could be selected (for example, same as input)

Agents

Defines who is authorized to create, update and delete local MCP client tools. Using local MCP client tools is always allowed for all users.

Auditing

These settings control auditing for cases when there is no associated connection, notably for agents

Write completion traces to audit log. Strongly increases audit log size.

Trace

Project
Web app

Cost control

Rate limiting