Retrieving Data in the Subset Mode

When the result set of a retrieve is very large, you can retrieve subsets of the result set and iterate until the entire result set is processed.

To retrieve subsets, you must use a Repeat loop scope to iterate through the entire result set:

Procedure

Create a Salesforce Retrieve All activity.
Specify the fields on the General tab and create a retrieve that returns multiple rows.
Set the ProcessInSubsets element of the Input tab to true .
Set the subsetSize element of the Input tab to the maximum number of messages you want to process for each execution loop.
Right-click the SalesforceQueryAll activity icon, and then click Create Group > Scope from the pop-up menu to create a scope containing the activity.
A cyclic line and a curve with an arrow appear around the SalesforceQueryAll activity icon.
Click the cyclic line to select it.
Select Repeat from the Scope Type list on the General tab, and specify an index name.
The loop exits when the entire result set has been consumed. You can set the condition of the loop by editing the lastSubset element on the Output tab.

Note: The previous procedure is a general guideline for creating a loop scope to process a large set of records. You might want to modify the procedure to include additional processing of the records, or you might want to change the XPath expressions to suit your business process.