This release contains the following new features and enhancements:
A new option is available that bypasses any data model validation rules or constraints, and imports, or transfers data as is. This option can be used in a data management architecture that includes landing, staging, and master zones. If the same data model is shared across all zones, constraints could prevent data from successfully importing into the landing zone. Forcing the import or transfer provides a workaround to this issue.
Load performance was improved for the options screen in instances where many related tables are included.
Support for templates was added when using the SQL import or export services in workflows and perspectives.
To improve readability, the data model variant name display format was updated.
Previously, if the Delimiter field was left blank, the add-on automatically applied a default double-quote delimiter. This behavior was changed so that if left empty, no delimiter is applied unless data includes a special formatting character, such as a line break, or field separator. In these cases, the default double-quote delimiter is automatically applied.
The Apache Commons Compress library was updated to version 1.26.
This release includes the following closed issues:
[DINT-4970] The current logic to handle inserts and updates can impact customer defined triggers.
[DINT-5124] An error occurs when exporting Excel due to exceeding the browser's storage restrictions.
[DINT-5137] The Mapping screen is unresponsive when exporting at the dataset level with a large number of table mappings.
This release contains the following known issues:
[DINT-4339] A JNDI data source cannot be configured when EBX® is deployed on a WebLogic, or JBoss server.
[DINT-5113] When using a cross reference function during import, and the data source's configured lookup field contains missing or empty values, the add-on creates duplicate records.
Fonts are no longer shipped with the JDK 11. Font rendering in Java 11 JVMs now uses pre-installed operating system fonts. This can cause issues in Linux environments when exporting Excel files. As a workaround, you can install the fontconfig package.
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
This release contains the following new features:
Permission settings for add-on import, export, and transfer services are now available to apply in a global context.
When exporting data from related tables, the formatting and label options are now applied to the related tables.
A new option was added to the following transformation functions to split the output into separate records:
Direct split string
Split to a multi-valued field
Combine multiple fields (new)
The new Combine multiple fields transformation function was added. This function takes input from single and multi-valued fields and outputs the values combined in a single field, or into separate records.
Performance was improved for the Options screen for instances where there a large number of related tables.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains the following known issues:
[DINT-4339] A JNDI data source cannot be configured when EBX® is deployed on a WebLogic, or JBoss server.
Fonts are no longer shipped with the JDK 11. Font rendering in Java 11 JVMs now uses pre-installed operating system fonts. This can cause issues in Linux environments when exporting Excel files. As a workaround, you can install the fontconfig package.
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
This release contains the following new features:
When creating a custom transformation using the add-on's API, the following information can now be included on inputs and outputs: name, description, and data type. This input can be used to help business users understand the transformation's purpose and its usage.
It is now possible to choose whether dataspace snapshots are included when exporting related data using the new Export data from snapshots option.
When exporting related data, it is now possible to select the individual related tables to export.
The manner in which the add-on handles permissions was updated. The changes mainly impact behavior related to records that are hidden due to permission settings. The add-on no longer blocks data integration processes when encountering an exception related to permissions. Instead, only invalid records are rejected and valid records are still processed. Additionally, the general behavior was made more consistent between datasets and tables.
Version 3.3.1 of the Apache Kafka client library was removed.
This release contains the following closed issues:
[DINT-4251] Related data from a child dataspace is exported when it should not be.
[DINT-4657] An error displays when importing a CSV file using a template where the default value of Concatenate String transformation is an empty string.
[DINT-4716] The dataspace is locked when transferring data to multiple target tables.
This release contains the following known issues:
[DINT-4339] A JNDI data source cannot be configured when EBX® is deployed on a WebLogic, or JBoss server.
Fonts are no longer shipped with the JDK 11. Font rendering in Java 11 JVMs now uses pre-installed operating system fonts. This can cause issues in Linux environments when exporting Excel files. As a workaround, you can install the fontconfig package.
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
This release contains the following new features:
You can now import XLSM files.
An administrator can now define the default values used in import, export, and transfer operations.
The number of updated and skipped records is now included in the import and transfer service results summaries.
Statistics are now available when transferring data at the table level.
A new built-in transformation function is available that allows you to define different list separators for different fields.
Names, descriptions, and data types were added to the add-on's built-in transformation functions. These values are now read-only.
This release contains no updated to third-party libraries.
This release contains the following closed issues:
[DINT-4226] The template cannot be saved after changing and publishing the data model.
[DINT-4246] The cell function instead of the cell value is imported when importing Excel.
[DINT-4271] File names that include Chinese characters do not display correctly in exported CSV and Excel files.
[DINT-4307] A scheduled workflow job fails due to database connection issues.
[DINT-4417] The SQL template cannot be loaded when configuring the JNDI in the context.xml file.
[DINT-4435] A large dataset cannot be imported from Excel.
This release contains the following known issues:
[DINT-4339] A JNDI data source cannot be configured when EBX® is deployed on a WebLogic, or JBoss server.
Fonts are no longer shipped with the JDK 11. Font rendering in Java 11 JVMs now uses pre-installed operating system fonts. This can cause issues in Linux environments when exporting Excel files. As a workaround, you can install the fontconfig package.
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: March 2023
This release contains the following new features:
The add-on was updated to ensure compatibility with the new TIBCO EBX® staging feature. This feature allows you to migrate configuration settings between environments. Settings available to migrate from the add-on include database and data model connections and user-defined data integration templates.
Add-on service memory usage was optimized to improve performance.
When importing data you can use the new simulation feature to preview import results. This allows you to test the data and correct any potential errors prior to importing.
The add-on now maintains Options and Mapping screen states, eliminating the need to reconfigure settings when switching between them.
The add-on's API was updated to support record filters on EBX® source tables.
When performing data integration tasks through a database connection, the following additional data types are now supported:
BigInt Identity
DateTime 2
When connecting to a database, the add-on now supports the use of Windows credentials.
This release contains no changes in functionality.
This release contains no updated to third-party libraries.
This release contains the following closed issues:
[DINT-3657] The Close button is duplicated in the Excel import result screen when using the service in a perspective.
[DINT-4014] Unexpected errors are not handled in user services.
[DINT-4013] Misleading error logs can be generated when exporting files.
[DINT-1715] The warning message is missing when the Import mode is set to Replace all content.
[DINT-3117] An Ajax error occurs when loading an SQL data source when its name was changed in configuration settings.
This release contains the following known issues:
Fonts are no longer shipped with the JDK 11. Font rendering in Java 11 JVMs now uses pre-installed operating system fonts. This can cause issues in Linux environments when exporting Excel files. As a workaround, you can install the fontconfig package.
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: February 2023
This release was updated to ensure compatibility with TIBCO EBX® Add-ons Bundle version 5.6.1.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains the following known issues:
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: November 2022
This release contains no new features.
This release contains no changes in functionality.
The Excel-streaming-reader library was upgraded to version 4.0.4.
This release contains no closed issues.
This release contains the following known issues:
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: September 2022
This release contains the following new features:
API updates include:
The creation of custom services for SQL import and export. A custom script task can be created and used in workflows.
All triggers and blocking constraints can be turned off when running add-on services.
During a data integration operation, valid records are persisted in EBX®, whereas invalid records are skipped and listed in an error file after the operation. In the file, a column is added that shows the relevant error message for each record.
If there is invalid data found during an import, a new option enables the download of a file containing the invalid data. A column is added that shows the relevant error message for each record.
A connection with TIBCO Data Virtualization can be created to integrate data between TDV views and a TIBCO EBX® data model.
Custom date and date/time patterns can now be created and used with CSV import and export services.
Additional information about data integration services is now included in the add-on's logs.
Error log performance is improved.
When using a custom workflow script task:
The Template parameter now accepts the template's UUID or name as valid input.
When using a template with a custom workflow script task, transformation function parameters can be overridden.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains the following closed issues:
[DINT-3161] Excel file cells are incorrectly formatted when exporting numeric fields.
[DINT-3397] The database connection test does not work when the URL contains a special character.
[DINT-3405] The Transform table shows all cross reference transformations as having an error.
[DINT-3427] Add-on services do not work if a connection is created with a TIBCO Data Virtualization server view that has no schema.
[DINT-3431] When importing Excel at the dataset level, the execution order is not consistent with the Excel sheet order.
[DINT-3441] A template created from a temporary dataspace cannot be used.
This release contains the following known issues:
When exporting to SQL with TDV, if any error occurs, the operation is cancelled.
Due to a limitation in Excel, long fields with the number data type display all numbers past the 16th place as a 0.
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: July 2022
When defining a custom cross reference transformation via the API or script task, the Ignore lookup failure parameter can be defined.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
[DINT-3317] It is not possible to call an existing template via the API for workflow script task.
This release contains the following known issues:
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: June 2022
This release contains the following new features:
You can save templates for SQL import and export operations.
When importing SQL, you can import from configured database views.
When exporting to Excel or CSV at the table level, you can include data from related tables.
You can include Primary Key, Foreign Key and Enumeration labels when exporting to CSV, Excel and SQL. Excel export also allows you to export Static Enumeration labels.
You can specify the Date and Date/time formats when importing CSV.
You can use the API to create custom transformation functions. These transformation functions will be available for business users to add to mappings in the user interface.
Support is now included for data model variants for the TIBCO EBX® Match and Merge Add-on in the Export SQL service.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains the following closed issues:
[DINT-3100] An error occurs when using the Export CSV service with the Export Label from Foreign Key options selected.
[DINT-3186] An error occurs when exporting data.
This release contains the following known issues:
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
When creating a custom transformation function, you must use a predefined data type for its input and output fields.
Released: April 2022
This release contains the following new features:
The performance for SQL export was improved.
You can now use the API to:
Configure import, export, and transfer operations on any table or dataset that is based on the same data model.
Execute the template API at the dataset level.
Configure the template API on any dataset based on the same data model.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains the following known issues:
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
Released: March 2022
You can now use import, export, and transfer functionality in workflow services and perspective actions. The add-on specific services and actions begin with [ebx-addon-dint]. There are two options for each import, export and transfer type—one to apply to tables and one for datasets.
This release contains the following changes in functionality:
When saving a template, the position of tables, transformation functions, and links in the Mapping screen are now stored. When the template is loaded, the components display according to the state of the most recent save.
Template names must now be unique.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains the following known issues:
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
Released: February 2022
This release contains the following new features:
You can now import from and export to SQL databases. An administrator must configure the connection to the database and connection between the database and data model. See the User Guide for more information.
The cross-reference transformation function contains the new Ignore lookup failure option. When enabled, records are imported and exported even when the cross-reference lookup does not find a corresponding value. If left disabled, records these records are not imported.
This release includes the following changes in functionality:
Behavior during import at the table level was updated to ensure consistency when importing an empty file.
Templates are now available for use on tables from the same data model, regardless of their location.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains the following known issues:
Importing and exporting SQL: Read and write is not possible with the Timestamp data type with MS SQL Server.
Configuring a schema using the JNDI configuration in your web server is not supported.
Released: December 2021
This release includes no new features.
This release includes no changes in functionality.
This release contains no changes to third-party libraries.
This release contains the following closed issue: [DINT-2853] Validate table name inputs.
This release contains no known issues.
Released: November 2021
This release includes:
Support for multi-table import, export and transfer operations at the dataset level. Additionally, when exporting from a dataset, you can now add target tables. This allows you to export data from one table to multiple locations. See the User Guide for more information about this feature.
When importing or exporting with Excel, the new List separator option allows you to define a separator for lists.
This release contains no changes in functionality.
This release contains no changes to third-party libraries.
This release contains no closed issues.
This release contains no known issues.
Released: September 2021
This release includes no new features.
This release contains no changes in functionality.
The Apache Streaming Excel Reader library was upgraded to version 3.1.1.
This release contains the following closed issue: [DINT-2589] An exception is thrown when multiple cross reference transformations are used in a TableMapping.
This release contains no known issues.
Released: July 2021
This release includes the following new features:
You can now transfer data between EBX® tables.
When exporting, you can now add, edit, and remove target fields in the Mapping screen.
When working with templates, you can now:
Set user permissions to view, modify and delete templates.
Save copies of templates.
The new Digital asset UUID lookup transformation function allows you to perform a bulk import operation to attach digital assets to records. Note that instructions for this process are contained in the TIBCO EBX® Digital Asset Manager Add-on documentation.
A public API has been provided that allows you to import, export and transfer data. See the Java API documentation for more information.
Tables in the Mapping screen now display data type and cardinality next to each field.
This release contains no changes in functionality.
This release contains no closed issues.
This release contains no known issues.
Released: June 2021
This release contains the following updates:
The First row contains header label was changed to Include column headers for Excel export and Includes column headers for Excel import. When selecting Yes for this option during import, you are now prompted to enter the starting location of table data.
When exporting Excel the two rows at the beginning of the file were removed.
The following library updates were made:
The Apache Commons BeanUtils library was upgraded to version 1.9.4.
The Apache CFX and HttpClient libraries were removed.
[DINT-2261] A documentation issue was corrected.
Released: March 2021
The TIBCO EBX® Data Exchange Add-on (New) allows you to integrate data from a source location into a target. Additionally, it can transform the data to meet business and technical requirements of disparate applications and systems.
This release allows you to import and export using CSV and Excel formats at the TIBCO EBX® table level. No configuration is required to initiate an import or export operation. The add-on provides the following graphical elements and features to support import and export:
Automatic mappings are generated between source and target fields. Data mappings display as lines between source and targets. Where possible, the add-on generates these automatically and adds basic transformations if required. It will also alert you visually to possible errors or warnings.
Drag and drop functionality to create mappings and transformations when required.
Pop-up editors to define transformation functions. The add-on includes several built-in transformation functions to cover common use cases.
Templates that save mappings and other configuration options for reuse.
The following list provides links to additional topics and tasks:
Introduction to the add-on | For a more in-depth overview of the add-on and your potential interaction with it, see About the add-on |
Importing | For an introduction to the import process, see Import overview. For instructions on importing, see Importing to a table. |
Exporting | For an introduction to the export process, see Export overview. For instructions on exporting, see Exporting a table. |
Mapping and transformations | Map and transform overview provides a look at how the add-on implements the concepts of mappings and transformations. Mapping interface reference highlights the user interface used for mapping and transformation tasks during data integration. Additionally, it provides an example of using a transformation function. You can refer to Transformation function reference to see a list and description of the add-on's built-in transformation functions. |