Spotfire Data Virtualization (SDV) 8.9.0

Open Documentation

View Release Notes

Spotfire Data Virtualization 8.9 includes features and enhancements in the following areas:

• Data Staging

• Core, Scalability & Performance

• Governance & Security

• Usability

• Data Delivery & Drivers

• Data Sources & Adapters

• Platform Support

Data Staging

Data Staging & Dashboard

• Data Staging transforms the definition of a “data source” to a more comprehensive and flexible concept: a “data store.” Staging enables connections to your data stores to be used as both sources (where data is pulled from) and destinations (where data is sent to). Move your clean, blended, and transformed data to a staged data source using the “Staging Operator” within the Web UI Flow editor. Configure retention periods for your staged data, and set rules for handling changes in staging workflows and failures. Lastly, monitor all staging actions with an interactive, drill-down dashboard in the Monitoring tab.

  • This powerful new feature introduces flexibility and agility for all self-service users, while maintaining governance from your IT organizations

  • Read more in the Web UI User Guide.

Core, Scalability, & Performance

Support for New Data Types

• Geospatial support: Geometry is now available for use in SDV query engines in SQL script, which includes Points, LineString, Polygon, GeomCollection, and GEOGRAPHY with SRID 4326.

• Geospatial functions are also supported in DB2, SQL Server, Oracle, and MySQL. Performance Improvements

• Improved performance for top-N queries: We've introduced better performance for queries using the LIMIT and ORDER BY clauses. The DV engine stops the query to only retrieve the request

Core Enhancements

• Runtime notes: Additional runtime notes and logging were added to the execution plan for enhanced troubleshooting of native bulk loading.

• Additional custom functions: The following built-in procedures are now available as custom functions and can be used in SQL queries for dynamic security on specific rows or views of data. 

  • TestUserIdentity (tests if current identity matches the one specified)

  • CurrentUserName (returns the current user’s username)

  • CurrentUserDomain (returns the current user’s domain)

• Increased Mail Content Length: The maxim um length of the Content parameter in the SendEmail procedure has been increased to the value of Integer.MAX_VALUE.

  • The corresponding system definition is now configured with the LONGVARCHAR data type.

• New Deployment Metrics:

  • The GetConfigurationProperties resource returns key deployment metrics for all server nodes in a cluster, including:

    • Host Name

    • Total System Memory

    • Port

    • Total Available Memory

    • Processing Cores

  • The SetConfigurationProperties sets the specified configuration property to the specified value on a stand-alone node or all server nodes in a cluster.

  • The SYS_CONFIG system table captures the key deployment metrics for all server nodes in a cluster.

• Data source capabilities: Data source capabilities are now accessible via the GetDataSourceCapabilities built-in procedure

Governance & Security

• Deployment Report: 

  • A deployment report is enabled with SDV. The static report contains a snapshot of the DV architecture, including:

    • System Resources (number of cores, clusters, server heap size, etc.)

    • Data Sources

    • Caches

    • Non-composite domains

    • Version Control System information

  • The GenerateDeploymentReportTrigger will be required to be enabled upon installation, and will periodically send the deployment report to a Spotfire product e-mail to help the product team prioritize development towards the highest utilized deployment scenarios.

• Client Applications: Users can now identify which client applications are connected to SDV in both Studio and in Web Manager.

  • Client applications are stored in SYS_SESSIONS in System Databases.

• Support for Passthrough Key Pair Authentication: Key Pair Authentication can be used as an authentication method for Snowflake instances, introducing flexibility for all supported authentication methods and powering hybrid authentication requests.

  • Pass-through login can also be enabled.

• Service Accounts: A new configuration, “Studio users Use Service Accounts,” can be set at the global or data-source level to use service account credentials on the data source instance and bypass pass-through.

• Standardized pass-through login behavior: Enabling statistics from the Cardinality Statistics Tab is now possible for service accounts, even when pass-through login is enabled.

• Kerberos Single-Sign On Support: Once a user logs into Studio via Kerberos SSO, the SDV server will automatically use their delegated credentials to connect to the underlying database

• Fetch access tokens: Users who log in via OAuth proxy log-in via Studio are now able to access fetch access tokens for seamless login.

Usability

• Highlighted columns: Selected columns are now highlighted visually to improve navigation, increase readability and support quick data validation.

• Cancel Cache refresh access: Users with “Modify All Status” rights can now use the cache refresh cancellations. 

• Landing Browser Page Configuration: The landing page for web browsers can now be configured to be either:

  • Web Manager

  • Web UI

Data Delivery & Drivers

• Support for IPv6: SDV now supports IPv6 for all client drivers (including ADO.NET, ODBC, and JDBC) and DV components (Studio, Web Manager, and Web UI)

• ODATA to SQL Mapping Optimizations: ODATA queries have now been translated to better optimize calls to the data sources, including for the functions STARTSWITH, ENDSWITH, and SUBSTRINGOF.

Data Sources & Adapters

• Snowflake: Data Ship Join and Bulk Loading support is now available for the CData Snowflake adapter

  • SnowSQL is required to enable bulk loading.

• Data Source Toolkit Adapters: Data Ship Join & Bulk Loading frameworks have been added to the Data Source Toolkit (DST) adapters

• Greenplum, MySQL, PostgreSQL, and Sybase IQ: Bulk Loading support is now available.

• Support for Excel and worksheets in automated introspection of new files: New Excel file and worksheet filters added to “Detect New Resources During Re-Introspection” option to detect new Excel files and new worksheets in existing Excel files.

• Multi-table caching: During multi-table caching, DV now proactively detects data store capabilities and disables indexes when it is not applicable to the data source.

Platform Support

• Support for OpenJDK 21.0.9 LTS 

• SDV Repository was upgraded to PostgreSQL 17.8

• Support for OEL/RHEL/Alma Linux/Rocky Linux 8.10+

• Support for Microsoft Windows Server 2022 

• Support for Windows 11