Extractor Options

You can maintain good system performance when extracting data during a transform from an SAP ODP source object by setting options on the Extractor Options tab. This can be a BW extractor or a generic extractor created by the IBP add-on in S/4HANA or SAP ECC.

The Extractor Options tab appears when you edit a data flow and then select on an input field.

Extractor options apply to any ODP source directly or through an embedded data flow.

The following table describes the extractor options:

Extractor option

Description

Package size

Indicates the maximum number of rows the extractor reads from the source and loads into memory at one time. Once the system processes and loads these rows to the target, it reads the next set of rows. By limiting the number of rows, less memory is used. Default is 1,000.

Initial load

For changed-data capture (delta loads), indicates whether to reload all the data on a subsequent run.

  • Yes: Returns a full extraction

  • No: Returns only data that has changed since the last run

If you change the filter properties for an ODP source, reset the job by running it with the source option Initial load set to Yes. Then you perform subsequent runs with Initial load set to No.

Extract from datetime

Indicates a specific date and time for when to extract changed data. Select a predefined global variable of type datetime. If the datetime value is the same as the value from the last execution, or falls before the value from the last execution, the system repeats the last changed-data extraction.

If the datetime value is later than the value from the last execution, the system returns the new data.
Example
Yesterday the job ran with a datetime value of 2020.01.28 03:00:00, however there was a problem in the last execution. To reload the same data again, keep the datetime value the same.

To get new changes, use a later value, for example 2020.01.29 03:00:00.

Parallel process threads

Specifies the number of threads used to read the data. For example, if you have four CPUs on your Agent machine, enter 4 to maximize performance.

Note
We recommend that you don't use this option. Setting a value can cause the software to go into recovery mode after the first iteration, resulting in sending the same rows repeatedly.