Live Datamart New and Noteworthy

This topic summarizes the history of significant changes in TIBCO® Live Datamart and TIBCO LiveView Desktop™ as of release 10.2.1.

For installation and compatibility information for the current release, see the Installation Guide.

New in Live Datamart 10.2.1

This section lists the new and noteworthy features of TIBCO® Live Datamart 10.2.1 and its component products.

See Fixed in LiveView 10.2.1 for a list of issues resolved in this release.

New Features

Live Datamart 10.2.1 adds the following updates and new features:

LiveView .NET Client API Reinstated

The LiveView .NET API, which was previously available in Live Datamart 2.x but not Live Datamart 10.x, is now reinstated and fully supported on Windows platforms. See LiveView .NET Client API Location for more information regarding the API.

Bundled LiveView Version Updated

The version of LiveView Web Developer Edition included with Live Datamart was updated to release 1.3.2.

Data Source Aggregation Options Enhanced in LiveView Configuration File Editor

Two fields were added to the aggregation option to configure the Data Table lvconf file type:

  • Group By

  • Define Pivot Table

See Aggregation Field for an explanation of field usage.

Changes in Functionality

There are no functionality changes to Release 10.2.1.

Deprecated Features

This release does not include any deprecations.

Migration and Compatibility

There are no migration or compatibility issues related to upgrading to Release 10.2.1.

New in Live Datamart 10.2.0

This section lists the new and noteworthy features of TIBCO® Live Datamart 10.2.0 and its component products.

See Fixed in LiveView 10.2.0 for a list of issues resolved in this release.

New Features

TIBCO Live Datamart® 10.2.0 adds the following updates and new features:

Multiple Fragment Launch Support

Live Datamart 10.2 supports the launching of more than one LiveView fragment in Studio, as reported for EventFlow fragments. The Studio features that support multiple launches are described on this page.

Important

You can run more than one LiveView project at the same time from different LiveView projects only.

Live Datamart 10.2.0 does NOT support running the same LiveView project more than one at a time. This is because access to the database that stores user authentication and alert configuration information is not configured for access from multiple LiveView instances. Running more than one instance of the same LiveView project may result in data loss.

This limitation is expected to be lifted in a future release.

REST API

This release adds a REST API for Live Datamart in addition to the existing Java, JavaScript, and .NET Client APIs. See LiveView Server REST API for more information.

GROUP-BY Modifiers Supported in LiveQL Statements

LiveQL statements to query Live Datamart servers can now use GROUP-BY modifiers that use a StreamBase expression, instead of just grouping by column names. See LiveQL Syntax Reference for more information. To support the enhancement, the QueryModel interface was changed. getOrderBy and getDirection are replaced with getOrderDefinition(). A new method, getQueryLanguage was also added.

When using the LVConf Editor, you must use the Source tab to manually add a GROUP BY modifier that uses an expression. When you return to a forms-based view, an error message displays that you can ignore. The Editor is expected to be updated in a future release.

New Python Sample

This release adds a Python sample, which demonstrates the LiveView REST API using simple Python scripts.

Changes in Functionality

The following functionality change occurred since release 10.1.1.

HOCON Security Changes

See Migration and Compatibility, below.

Deprecated Features

This release does not include any deprecations.

Migration and Compatibility

Refer to the following for migration information when upgrading a prior release to 10.2.0.

Any sub-folder element in LiveView lvconf Now Ignored on Upgrade

When converting LiveView 2.x projects to 10.2.0, any sub-folder element in a 2.x lvconf file is now safely ignored and removed.

HOCON Security Changes

The security configuration HOCON type was significantly updated, with changes to better support LiveView and TIBCO LiveView™ Web security. As a result, you must update any LiveView 10.1.x projects configured for authentication to the new configuration format. See the Configuration Guide page for security, as well as:

The LiveView Authentication and LiveView Web samples were updated to use the new security configuration and can serve as references. See README files for those samples.

New in Live Datamart 10.1.1

This section lists the new and noteworthy features of TIBCO® Live Datamart 10.1.1 and its component products.

See Fixed in LiveView 10.1.1 for a list of issues resolved in this release.

LiveView New Features and Updates

This release does not introduce new features or updates beyond what is described in the link shown above.

New in Live Datamart 10.1.0

TIBCO® Live Datamart is re-introduced to the StreamBase product line as of release 10.1.0. This section lists the new and noteworthy features of TIBCO Live Datamart 10.1.0 and its component products.

See Fixed in LiveView 10.1.0 for a list of issues resolved in this release.

LiveView New Features and Updates

LiveView Web Included in Live Datamart 10.1.0

Live Datamart now includes TIBCO LiveView™ Web Standard Edition, which is licensed for limited use as described in License Considerations.

To configure LiveView Web 1.2.1 to work with Live Datamart 10.1.0, please consult the LiveView Web documentation.

Author-Time High Availability Tables Supported

Live Datamart now supports configuring Author-Time high-availability tables that are backed by multiple Live Datamart instances and that automatically reissue queries from fallen servers. This is configured by adding multiple remote URIs to the existing remote table feature. See Multiple Remote Data Layer Back Ends for more information.

LiveView Sample Support

With the re-introduction of Live Datamart into StreamBase 10.1.0, the following LiveView samples are now available in StreamBase 10 Maven format, and are known to work:

lv_sample_alerting_advanced lv_sample_minimal
lv_sample_author_time_agg lv_sample_panomaps
lv_sample_custom_id_generation lv_sample_preprocessor
lv_sample_desktop_custom_view lv_sample_publisher
lv_sample_field_rules lv_sample_sbd_table
lv_sample_helloliveview lv_sample_services_only
lv_sample_java_clientapi lv_sample_transform
lv_sample_javascript  

The following LiveView samples are also provided, but have not been fully tested:

lv_sample_activespaces lv_sample_ftl_recovery
lv_sample_auth lv_sample_jdbc_table
lv_sample_dotnet lv_sample_kafka_recovery
lv_sample_ems_recovery  
Additional Information Provided in LVSessionQueries Table

The LVSessionQueries table has a new column named RemoteServer. This column provides table-specific information to help identify which remote server is running the query. This column is null for local LiveView tables.

LiveView Publisher Interface Change

The LiveView Publisher interface has changed. Publishers must now implement an output stream called PublisherStateOut that reports on publisher status during recovery. See Recovering Data to the Server for more details.

Pivot Query Support

Live Datamart now supports pivot queries to create pivot tables. See Creating Pivot Tables to learn more. To illustrate this feature, the Hello LiveView sample was updated to include a Pivot Queries perspective, from which you can run pivot queries on the ItemSales table.

Permissions Behavior Change

When authentication is enabled, Live Datamart now implements tighter control over listing tables. Therefore, you must provide list privileges to the table you are going to publish to. For more information about Live Datamart privileges, see Runtime Security Configuration.

JDBC lvconf Type Deprecated

The JDBC Table lvconf type is deprecated and was removed from the LiveView Configuration File Editor. Instead, use the External Server Connection lvconf file type and select JDBC from the drop-down list.

XML Attributes Deprecated in LiveView lvconf files; Legacy Static Aggregation Removed

Compared to StreamBase 7, the XML structure in StreamBase 10.1.0 for the Application and Publisher lvconf types was changed as follows:

  • The attribute sub-folder was removed.

  • The attribute filename is deprecated and replaced with module.

  • The attribute module takes a fully qualified module name with no extension.

In addition, the legacy static aggregation implementation, which was deprecated as of Live Datamart 2.0, is now removed.

JQuery Atmosphere Plugin Removed; Atmosphere JavaScript Library Upgraded

As announced in the Live Datamart 2.1.2 New and Noteworthy, the JQuery version of Atmosphere (jquery.atmosphere.js) was deprecated in favor of the pure JavaScript version, atmosphere.js. As of Live Datamart 10.1.0, the JQuery plugin is now removed.

In addition, the Atmosphere JavaScript library was upgraded on the client side to match the LiveView Server side, which is version 2.4.3.

New in Live Datamart 2.2.2

This section lists the new and noteworthy features of TIBCO® Live Datamart 2.2.2 and its component products.

See Fixed in LiveView 2.2.2 for a list of issues resolved in this release.

LiveView New Features

Kerberos Support Added

This release adds support for connecting to Liveview servers in a Kerberos-managed authentication environment. See LiveView Authentication and Authorization for Kerberos for more information.

REST API

This release adds a REST API for Live Datamart in addition to the existing Java, JavaScript, and .NET Client APIs. See LiveView Server REST API for more information.

GROUP-BY Modifiers Supported in LiveQL Statements

LiveQL statements to query Live Datamart servers can now use GROUP-BY modifiers that use a StreamBase expression, instead of just grouping by column names. See LiveQL Syntax Reference for more information.

To support the enhancement, the QueryModel interface was changed. getOrderBy and getDirection are replaced with getOrderDefinition(). A new method, getQueryLanguage was also added.

When using the LVConf Editor, you must use the Source tab to manually add a GROUP BY modifier that uses an expression. When you return to a forms-based view, an error message displays that you can ignore. The Editor is expected to be updated in a future release.

New Python Sample

This release adds a Python sample that demonstrates the LiveView REST API using simple Python scripts.

Changes in Functionality

Impure Functions in LiveQL WHERE Clauses

Impure functions in the WHERE clause of a LiveQL query can deliver unexpected query results. An impure function is one that can return different results when it is called with identical parameters, such as now() and random(10). LiveView now immediately throws an error for queries that use impure functions in the WHERE clause.

Although not recommended, you can disable this behavior by setting the system property liveview.allow.impure.inwhere to true.

Author-time Aggregation Sample Updated

The LiveView Author-time Aggregate sample now includes an example of the GROUP BY feature.

Deprecated Features

This release does not include any deprecations.

Migration and Compatibility

This release does not include any migration issues.

New in Live Datamart 2.2.1

This section lists the new and noteworthy features of TIBCO® Live Datamart 2.2.1 and its component products.

See Fixed in LiveView 2.2.1 for a list of issues resolved in this release.

LiveView New Features and Updates

LiveView Publish Output Adapter Interface Change

The LiveView Publisher interface changed in release 2.2.0 as described in LiveView New Features and Updates.

LiveView System Table Field Name Changes

Two field names changed in the LiveView system table, LVTableColumns. The Table field is now TableName; Name is now ColumnName. See LVTableColumns.

One field name changed for the LiveView system table, LVTables: Group is now TableGroup. See LVTables.

LiveView Permission Added

This release adds sbinfo to the list of settable permissions for LiveView server authentications. See LiveView Privilege Settings.

LiveView Java Client API Updated

The QueryConfig interface now has setters for PIVOT query components to better support the builder pattern when configuring a query.

The getConfig() method was introduced in the Query interface that returns the QueryConfig object containing parsed information, including table, predicate, and the query string.

New in Live Datamart 2.2.0

This section lists the new and noteworthy features of TIBCO® Live Datamart 2.2.0 and its component products.

See Fixed in LiveView 2.2.0 for a list of issues resolved in this release.

LiveView New Features and Updates

Use TIBCO LiveView Desktop 2.3.0 with Live Datamart 2.2.0

TIBCO LiveView™ Desktop's release numbering is skipping ahead to release 2.3.0. Please use TIBCO LiveView Desktop 2.3.0 as a client for Live Datamart 2.2.0 servers. You can download LiveView Desktop 2.3.0 from edelivery.tibco.com.

Author-Time High Availability Tables Supported

Live Datamart now supports configuring Author-Time high-availability tables that are backed by multiple Live Datamart instances and that automatically reissue queries from fallen servers. This is configured by adding multiple remote URIs to the existing remote table feature. See Multiple Remote Data Layer Back Ends for more information.

Pivot Query Support

Live Datamart now supports pivot queries to create pivot tables. See Creating Pivot Tables to learn more. To illustrate this feature, the Hello LiveView sample was updated to include a Pivot Queries perspective, from which you can run pivot queries on the ItemSales table.

Attribute Added to External Connection lvconf Files

An Ignore attribute was included for the external connection lvconf type. The optional attribute is Boolean. When set to true, all tables from the external connection that match this mapping are ignored and not listed. For more information, see Table Mappings and Filtered Data Aliases.

lv-client Command Option Added

The lv-client -c option with the select command has changed its output format slightly. The final line of output was a summary of the number of rows returned that looked like "Rows = X". This summary line now looks like "# Rows = X", which will allow most CSV readers to simply ignore that line, and avoid generating an error.

Permissions Behavior Change

When authentication is enabled, Live Datamart now implements tighter control over listing tables. Therefore, you must provide list privileges to the table you are going to publish to. For more information about Live Datamart privileges, see LiveView Authentication and Authorization.

LiveView Publish Output Adapter Interface Change

The LiveView Publisher interface was changed in release 2.2.0 such that Publishers from earlier releases must be modified to avoid LiveView Server failing to start. Such failures have entries like the following in the Console view:

date time INFO  LVInfoInit - Loaded embedded publisher 
ItemsSalesPublisher
date time WARN SbAdminOperator - Resume 
com.streambase.sb.containters.ContainerConnectionException: Cannot find 
destination: ItemsSalesPublisher.ServerStateIn in container 
ItemSalesPublisher

Starting with release 2.2.0, a new input stream, ServerStateIn, and an output stream, PublisherStateOut, were added to the LiveView Publisher interface. You must regenerate the Publisher interface for your LiveView project. In addition, in your EventFlow module, at minimum, you must add a Map operator that connects the new input stream to the new output stream, and sets CurrentState to RECOVERY_COMPLETE. Further details on this change are described in Recovering Data to the Server.

Jetty Upgraded

To address a potential HttpParser vulnerability, Jetty Web Server was upgraded to version 9.3.14. See this link for more information regarding the vulnerability.

JQuery Plugin Removed; Atmosphere JavaScript Library Upgraded

We announced in the Live Datamart 2.1.2 New and Noteworthy that the JQuery version of Atmosphere (jquery.atmosphere.js) was deprecated in favor of the pure JavaScript version, atmosphere.js. As of Live Datamart 2.2.0, the JQuery plugin is now removed.

JDBC lvconf Type Deprecated

The JDBC Table lvconf type is deprecated and was removed from the LiveView Configuration File Editor. Instead, use the External Server Connection lvconf file type and select JDBC from the drop-down list of external data source types.

Static Aggregation No Longer Supported

The legacy static aggregation implementation, which was deprecated in Live Datamart 2.0, is now removed. Consequently, the deprecated conflate-data attribute that pertains to static aggregation tables is also removed.