Deduplicating Data
Use the dedup (deduplication) function to check duplicate records.
Note: For the enterprise edition, you have to configure a connection to the TIBCO® Patterns server before using the dedup function.
You can either create a switchable group of columns or select the columns that you want to check duplicates. This example shows how to create a switchable group for deduplicating data.
Procedure
Result
![](GUID-192D5B49-0097-484F-913A-A4046A4A1A70-display.png)
Column Name | Data Type | Hint |
---|---|---|
dedup_isLead | Boolean | true: This row is the first found row in the group.
false: This row is not the first found row in the group |
dedup_group | Integer | 0: This row is a unique row.
>0: This row is in a duplicated group. |
dedup_rowIndex | Integer | The value is the original row index. |
Copyright © Cloud Software Group, Inc. All rights reserved.