TDV Azure Data Lake Adapter

TDV supports the following Cloud based File Systems:

Amazon S3
Microsoft Azure Data Lake Storage
Local File Storage
Google Cloud Storage

This topic describes the configuration of the Azure Data Lake Storage adapter. Refer to the corresponding Adapter guides for details on how to configure those.

The File formats supported for Azure Data Lake adapter are:

Delimited file format
Parquet file format

Note: The delimited file format is a flat file format while the Parquet files can store data in a hierarchical format also. If the “Infer Schema” option is selected for the data source, TDV will infer the schema and datatypes of each column based on the data in the file.

In this chapter, the following topics are discussed:

Connecting to Azure Data Lake Data Source

Data Type Mapping

Supported Functions