Data Model

The adapter leverages Spark Thrift to enable bidirectional SQL access to SparkSQL data. Spark version 1.6 and above are supported.

Discovering Schemas

The SparkSQL Adapter dynamically obtains the SparkSQL schemas; reconnect to pick up any metadata changes, such as added or removed columns or changes in data type.