Merge Files in Gold Standard

If there are differing files—visualizations or data tables—in the comparison export and the gold standard, they will be shown in the Comparison Results dialog as failed. For each of the files, the difference must be handled in one of the three ways described below. After handling each of the differing files, a new gold standard is created by merging the original gold standard with the comparison export.

The Three Ways to Handle Differences:

1. Keep the file from the original gold standard in the new gold standard.

   Comment: Select this option if the file in the comparison export is considered to be incorrect. This means that the new gold standard will be the same as the old gold standard for this file.

2. Append the file from the comparison export to the gold standard to use both files in the new gold standard.

   Comment: Select this option if the file in the comparison export, as well as the file in the gold standard, are deemed to be correct. For example, if different thousands separators are used on different installations the file versions may not be identical, but both can be correct. For more information, see Multiple File Versions below.

3. Replace the file in the original gold standard with the comparison file.

   Comment: Select this option if the file in the comparison export is deemed to be correct and that the file in the original gold standard is no longer correct.

New and Removed

If files have been added or removed in the analysis, shown as new and removed in the Comparison Results dialog, they cannot be merged to a new gold standard as the actual analyses, not just the files in the exports, differ. If this is the case, a new export and gold standard should be created from the new analysis. When the new gold standard is created only the files that differed, or were added to the analysis, must be verified.

Multiple File Versions

If files are appended to a gold standard, as described in option 2 above, multiple versions of that file will be used in the new gold standard. That is, two or more versions of that file are deemed to be correct despite the differences. This means that if any new comparison export files match either of the variants, they will be verified as the same as the gold standard. If any files in a comparison export differ from a file that has multiple versions in the gold standard, the Compare Files and Segments dialog is displayed when the files are to be compared in the Comparison Results dialog. In that dialog the differing file can be compared with either of the versions in the gold standard.

When there are multiple files in the gold standard, each of these files is annotated with a rising number in the export report for the gold standard. It is possible to limit how many of these versions are to be shown in the export report. For more information, see Settings.

Note: If there are multiple versions of a file in the gold standard, a differing file in the comparison export cannot replace these, only be appended to the gold standard.