When a workflow that contains Spark operators is run, the results are not shown by default. This enables the workflow to run faster. You can see the results for individual operators available for Spark Node Fusion under the following conditions.
When you run the workflow from the top menu, the workflow preview page, a scheduled job, or an API call, you can see results as follows:
If
Store Results is set to false, only summary information about column names and data types is displayed in the operator preview.
If
Store Results is set to true, preview output is displayed in the
Results panel.
When you run the workflow by clicking
Step Run from the lower menu, or from the right-click option, you can see results as follows:
If
Store Results is set to either true or false, you can see the preview output in the
Results panel. This can be useful for debugging while you are building workflows.
For more information, see Convert to Spark/Revert to Non-Spark.
