Delta Publishing Mode

When Delta Publishing mode is enabled, the parser activity checks the input file on a preconfigured timer interval, and copies any new data to a work file, and then processes and parses it.

To better explain the mechanism of Delta Publishing mode, the following example is used.

The input file is shown as follows: 

Order, ID41678, 20May2000
Item, GigaWidget, 60, $75
Item, MegaBucket, 48, $125
Customer, Hopkins Associates, ID26490
Order, ID41680, 20May2000
Item, Rt.Clopper, 40, $100
Item, Lt.Clopper, 50, $100
Customer, Jersey WebInovaters, ID46786

When using Delta Publishing mode, you have to consider the following two conditions:

  • Each line

    Each line might be processed in the input file by another application at intervals. The intervals are set at three times of the polling interval that you have set in the Delta Flush Interval tab. When a line is parsed as one message in Delta Publishing mode, the intervals are reset.

  • Each complete message

    A complete message is processed in the input file at intervals. The intervals are set at three times of the polling interval you have set in the Delta Flush Interval tab. In this example, according to Input Schema, Order is the root record, so the first 4 lines form a complete message, and the last 4 lines form another complete message.

    In Delta Publishing mode, the plug-in cannot recognize where the next complete message starts, and the data is processed in the input file by another application continuously. If no data is processed in the input file at the specified intervals (3 times of the polling interval), the last 4 lines are parsed as a complete message.

    After the last 4 lines are parsed as a complete message in Delta Publishing mode, other data appended to the last line is not allowed. For example, after parsing the last 4 lines as a complete message, it is not allowed to append data to line 8 as follows: Customer, Jersey WebInovaters, ID46786 fdsfdsfds