Set Handling for Data Records with Errors

To write data records with errors to the error stack, so that they can be updated to the target of the data transfer process once the error has been resolved, a number of settings have to be made in the data transfer process.

Context

In the default setting, error handling is completely deactivated (option Terminate request; no record tracing; no updating). This setting produces the best performance in all cases where the data quality is satisfactory, and the data flow has been tested. If a request contains an error, the Activate Monitoring Automatically checkbox, which is set by default in this case, causes the DTP to be executed again with the Terminate request; First record with errors is traced; No updating option. This option provides better troubleshooting, as it makes it possible to trace back to the source in order to find out which data record caused the error.

We recommend activating error handling if errors occur during execution of the DTP. If error handling is activated, the data records with errors are written to the error stack, where they can be corrected before being written to the data target using an error DTP.

Procedure

  1. Define the key fields for the error stack on the Extraction tab page by pressing Semantische Groups(Semantische Groups).

    This setting is only relevant if you are transferring data to DataStore objects with data fields that are overwritten. If errors occur, all subsequent data records with the same key are written to the error stack along with the incorrect data record; they are not updated to the target. This guarantees the serialization of the data records, and consistent data processing. The serialization of the data records and thus the explicit definition of key fields for the error stack is not relevant for targets that are not updated by overwriting.

    The default value and possible entries for the key fields of the error stack for DataStore objects that overwrite are shown below:

    Default Value/Possible Entries Which Fields in the Source?

    Default value for the key fields of the error stack (fields selected by the system)

    All fields in the source that are uniquely assigned to a key field of the target. This means all fields in the source that are directly assigned to a key field of the DataStore object in the transformation.

    Fields that can also be selected as key fields for the error stack

    Fields in the source that are assigned to key fields of the DataStore object, but whose assignment is not unique.

    An assignment is not unique if it is not a direct assignment. If the assignment is direct, it is also considered to be not unique if there is a start or end routine.

    Fields that cannot be selected as key fields for the error stack

    Fields in the source that are assigned to a non-key field of the target, to a data field in the DataStore object.
  2. On the Update tab page under Error Handling, specify how you want the system to respond to data records with errors.
    For error handling, the following options are available. The main difference between them is how the status of the request is set once all data packages have been processed:
    • Request red; Write error stack; Update valid records
    • Request green; Write error stack; Update valid records
  3. Specify the acceptable number of invalid records for error handling. If more than this specified number of errors occur, the transfer is terminated.
  4. Make the settings for the temporary storage by choosing Start of the navigation pathGoto Next navigation step Settings for Temporary StorageEnd of the navigation path.
    The temporary storage supports you with troubleshooting and when restarting the load process. In these settings, you specify the processing steps after which you want the system to temporarily store the DTP request (such as extraction, filtering, removing new records with the same key and transformation). You also specify when the temporary storage should be deleted. This can be done either after the request has been updated successfully to the target, when the request is deleted or a specified amount of time after the request is processed. Under Level of Detail, you specify how you want to track the transformation.
  5. Once the data transfer process has been activated, create an error DTP on the Update tab page and include it in a process chain or start manually if errors occur.
  6. Analyze the error and correct the data records with errors in the error stack.
  7. Execute the error DTP manually or via a process chain.
Related Information