Creating Data Transfer Processes 

Use

You use the data transfer process (DTP) to transfer data from source objects to target objects within BI. You can also use the data transfer process to access InfoProvider data directly. 

Prerequisites

You have determined the dataflow between the source and target object using transformations.

Procedure

Creating Data Transfer Processes Using Process Chains

You are in the plan view of the process chain in which you want to include a data transfer process as a process.

The process type Data Transfer Process is available in the Load Process and Postprocessing process category.

...

       1.      Use Drag&Drop or double-click to include the process in the process chain.

       2.      To create a data transfer process as a new process variant, enter a technical name and choose Create.

The dialog box for creating a data transfer process appears.

       3.      Select the type of data transfer process:

For VirtualProviders, the only available option is DTP for Direct Access. For more information, see Creating Data Transfer Processes for Direct Access.

For DataStore objects, choose Standard DTP and DTP for Real-Time Data Acquisition. For more information, see Creating Data Transfer Processes for Real-Time Data Acquisition.

       4.      Select the source object type and the object from which you want to transfer data into the target. If only one source object exists, this is selected by default.

       5.      Choose Continue.

       6.      The data transfer process maintenance screen appears.

The header data for the data transfer process shows the description, ID, version, and status of the data transfer process, along with the delta status.

       7.      On the Extraction tab page, determine the parameters:

                            a.      Choose the extraction mode.

You can choose full mode or delta mode. You do not need to initialize the delta process explicitly for the delta transfer.

                            b.      If necessary, determine filter criteria for the delta transfer.

This means that you can use multiple data transfer processes with disjunctive selection conditions to transfer small sets of data from a source efficiently into one or more targets, instead of transferring large volumes of data. You can specify individual selections, multiple selections, intervals, selections based on variables, or routines. Choose Change Selection to change the list of InfoObjects that can be selected.

                            c.      Apply further settings, which are dependent on the source object.

       8.      On the Update tab page, determine the parameters:

                            a.      Apply settings for error handling: Determine how the system updates the valid records when errors occur, the number of errors allowed before the load process terminates, whether the load process should be judged to contain errors if records are being aggregated, sorted, or added during the transformation.

                            b.      Under Semantic Groups determine the key fields for the error stack. See Error Stack.

       9.      Make the settings for the temporary storage by choosing Goto   ®  Settings for DTP Temporary Storage. Here you determine the steps in the process run of the program after which you want to store data to the temporary storage, the level of detail to which you want to store data, and when you next want to delete the temporary storage.

   10.      On the Execute tab page, determine the parameters:

On this tab page, the process flow of the program for the data transfer process is displayed in a tree structure.

                            a.      Specify the status that you want the system to adopt for the request if warnings are displayed in the log.

                            b.      Specify how you want the system to determine the overall status of the request.

The system automatically determines the processing mode for the background processing of the respective data transfer process.

   11.      Check the data transfer process, save and activate it.

Choose Goto ®  Overview of DTP to display information on the source and target objects, the transformations, and the last changes to the data transfer process.

Choose Goto ®  Batch Manager Settings to make settings for parallel processing with the data transfer process.

Choose Goto  ® WHM Statistics Settings to make settings for runtime measurements with data transfer processes.

Creating Data Transfer Processes from the Object Tree in the Data Warehousing Workbench

The starting point when creating a data transfer process is the target into which you want to transfer data. In the Data Warehousing Workbench, an object tree is displayed and you have highlighted the target object.

...

       1.      In the context menu, choose Create Data Transfer Process.

The dialog box for creating a data transfer process appears.

Proceed as described in step three and onwards in the procedure for creating a data transfer process using a process chain.

Result

When you go back to process chain maintenance, the data transfer process of the plan view is displayed and you can include it in your process chain. When you activate and schedule the chain, the system executes the data transfer process as soon as it is triggered by an event in the predecessor process in the chain.

If you do not include the data transfer process in a process chain, you can execute it in the background.

If you want to execute a standard data transfer process in debug mode, choose Serially in Dialog Process (for Debugging) as the processing mode on the Execute tab page. In this case, you can determine breakpoints in the overview for the process flow of the program.