HDFS
DSS can connect to filesystems based on the “Hadoop Filesystem” API to
-
Read and write datasets
-
Read and write managed folders
Compatible filesystems
DSS can read/write from any kind of Hadoop Filesystem and has been tested with the following URL schemes:
-
hdfs://
-
maprfs://
-
s3a://
-
wasb://
-
adl://
Note
DSS collectively refers all “Hadoop Filesystem” URIs as the “HDFS” dataset, even though it supports more than
hdfs://
URIs
For more information about connecting to Hadoop filesystems and connection details, see Hadoop filesystems connections (HDFS, S3, EMRFS, WASB, ADLS, GS) .