Engines & Connections

Datasets creation settings

Most of these settings can be overridden on a per-project basis

Preferred fallback connection

Use this connection by default for new managed output datasets when no proper contextual connection can be selected (for example, recipe from an "Uploaded" dataset).

Preferred connection (forced)

Use this connection by default for new managed output datasets, even if a better contextual connection could be selected (for example, same as input)

Preferred connection for uploads

Use this connection by default for uploaded datasets

Preferred storage formats

Comma-separated list of ordered (most preferred to least preferred) storage formats.

Default virtualizable

Should datasets be created as virtualizable (for Spark pipelines)

Uploads in default location

Should uploaded datasets be allowed in the main DSS data dir (i.e. without a target connection) ?

Recipe engines

These settings can be overridden on a per-project basis

Control which datasets or recipes are displayed for creation

These settings only apply in the web interface and for creating new objects. They are meant to avoid showing options that are not technically applicable on this instance / for this user or project. Existing objects will always be displayed, and hidden objects may still be creatable through the python API, or when importing existing projects for example.

Deactivate dataset type if connection not available

Deactivated dataset types are hidden or disabled in the UI. If a user could create a connection supporting this dataset type, it will not be deactivated (applies to admin users, or to user having the authorization to create personal connections)

Hide following dataset types

Selected dataset types are hidden in the new dataset menu of the flow, and in the new dataset page. Some of this options are not really dataset types, but more generic ways of creating datasets or containers.

Show traditional Hadoop

Should DSS show options to create Hive and Impala code recipe, Hive datasets and Hive notebook

Show R recipe & notebook

Should DSS show options to create R and SparkR code recipe and R notebook

Show Scala recipe & notebook

Should DSS show options to create Scala code recipe (including streaming if activated) and Scala notebook