Home > Apache Spark SQL > Details on Apache Spark SQL Connection

Details on Apache Spark SQL Connection


This dialog is used to configure a connection to an Apache Spark SQL database, and to Databricks Cloud. You can choose whether to analyze data in-database, or to import it into your analysis.

Note that you need to install a driver on your computer to access the Apache Spark SQL connector. See the system requirements at http://support.spotfire.com/sr_spotfire_dataconnectors.asp to find the correct driver. You can also view Getting Started with Connectors to learn more about getting access to connectors in Spotfire.

  1. Select Tools > Manage Data Connections.

  2. Click Add New > Data Connection and select Apache Spark SQL.

  1. Select File > Add Data Tables.

  2. Click Add.

  3. Select Connection To > Apache Spark SQL.

apache_spark_connection_d.png

Option

Description

Server

The name of the server where your data is located. To include a port number, add it directly after the name preceded by colon.

Example with port number:
MyDatabaseServer:10001
Note: The Apache Spark SQL connector supports only Spark Thrift Server.

Authentication method

The authentication method to use when logging into the database. Choose from

  • No authentication

  • Kerberos

  • Username

  • Username and password

  • Username and password (SSL)

Host FQDN

[Only applicable when Kerberos authentication is selected.]

The fully qualified domain name of the Spark Thrift Server host. For more information about the host FQDN, contact your Apache Spark SQL system administrator.

Service name

[Only applicable when Kerberos authentication is selected.]

The Kerberos service principal name of the Spark server. For example, "spark". For more information about the service name, contact your Apache Spark SQL system administrator.

Realm

[Only applicable when Kerberos authentication is selected.]

The realm of the Spark Thrift Server host. Leave blank if a default Kerberos realm has been configured for your Kerberos setup. For more information about the realm, contact your Apache Spark SQL system administrator.

Username

The name of the user account you wish to use when logging into Apache Spark SQL.

Password

The password for the specified username.

Allow common name host name mismatch

[Only applicable when Username and password (SSL) authentication is selected.]

Select this check box if it should be allowed that the certificate name does not match the host name of the server.

Connect

Connects you to the specified server and populates the list of available databases.

Database

Select the database of interest from the drop-down list.

See also:

Apache Spark SQL Data Types

Supported Functions