Apache Spark SQL Data Types


When you are setting up a connection to an external data source, Spotfire needs to map the data types in the data source to data types in Spotfire. See below for a list of the different data types that Spotfire supports and the applied data type mappings when working with an Apache Spark SQL database.

Apache Spark SQL Data Type

Spotfire Data Type

Comment

BINARY

Binary

 

BOOLEAN

Boolean

 

TIMESTAMP

DateTime

 

TINYINT

Integer

 

SMALLINT

Integer

 

INT

Integer

 

BIGINT

LongInteger

 

DOUBLE

Real

 

FLOAT

SingleReal

 

STRING

String

 

DECIMAL (precision (p), scale (s))

When p = 0 and s = 0: Currency

When p <= 9 and s = 0: Integer

When p <=18 and s = 0: LongInteger

When p <= 15: Real

Else: Currency

Note: DECIMAL columns from temporary tables/views are always mapped to the Spotfire data type Currency, because their precision (p, s) is unlimited (0, 0).

Any other data types are not supported.

See also:

Details on Apache Spark SQL Connection

Supported Functions