Apache Spark SQL Data Types


When you are setting up a connection to an external data source, Spotfire needs to map the data types in the data source to data types in Spotfire. See below for a list of the different data type mappings applicable when working with an Apache Spark SQL database.

Apache Spark SQL Database Type

Spotfire Data Type

Supported

TINYINT

Integer

Yes

SMALLINT

Integer

Yes

INT

Integer

Yes

BIGINT

LongInteger

Yes

FLOAT

SingleReal

Yes

DOUBLE

Real

Yes

DECIMAL (precision (p), scale (s))

When p = 0 and s = 0: Currency

When p <= 9 and s = 0: Integer

When p <=18 and s = 0: LongInteger

When p <= 15: Real

Else: Currency

Note: DECIMAL columns from temporary tables/views are always mapped to the Spotfire data type Currency, because their precision (p, s) is unlimited (0, 0).

Yes

BOOLEAN

Boolean

Yes

STRING

String

Yes

TIMESTAMP

DateTime

Yes

See also:

Details on Apache Spark SQL Connection

Supported Functions