Extractor Options
You can maintain good system performance when extracting data during a transform from an SAP ODP source object by setting options on the Extractor Options tab. This can be a BW extractor or a generic extractor created by the IBP add-on in S/4HANA or SAP ECC.
The Extractor Options tab appears when you edit a data flow and then select on an input field.
Extractor options apply to any ODP source directly or through an embedded data flow.
The following table describes the extractor options:
Extractor option |
Description |
|---|---|
Package size |
Indicates the maximum number of rows the extractor reads from the source and loads into memory at one time. Once the system processes and loads these rows to the target, it reads the next set of rows. By limiting the number of rows, less memory is used. Default is 1,000. |
Initial load |
For changed-data capture (delta loads), indicates whether to reload all the data on a subsequent run.
If you change the filter properties for an ODP source, reset the job by running it with the source option Initial load set to Yes. Then you perform subsequent runs with Initial load set to No. |
Extract from datetime |
Indicates a specific date and time for when to extract changed data. Select a predefined global variable of type datetime. If the datetime value is the same as the value from the last execution, or falls before the value from the last execution, the system repeats the last changed-data extraction. If the datetime value is later
than the value from the last execution, the system returns the
new data.
Example Yesterday the job ran with a datetime
value of 2020.01.28 03:00:00, however there was a problem in
the last execution. To reload the same data again, keep the
datetime value the same.To get new changes, use a later value, for example 2020.01.29 03:00:00. |
Parallel process threads |
Specifies the number of threads used to read the data. For example, if you have four CPUs on your Agent machine, enter 4 to maximize performance. Note We recommend that you don't use this option.
Setting a value can cause the software to go into recovery mode
after the first iteration, resulting in sending the same rows
repeatedly. |