Creating Data Transfer Processes for Real-Time Data Acquisition

Use

You use the data transfer process (DTP) for real-time data acquisition to transfer data from the source (PSA or ODP) to the InfoProvider (DataStore object (classic), HybridProvider, or InfoObject). In the DataStore object, the data is available for use in reporting.

Prerequisites

You have used transformations to create the data flow between the DataSource and the InfoProvider.

The DataSource is delta enabled and supports real-time data acquisition.

If you load master data into an InfoObject using real-time data acquisition, the InfoObject must support real-time data acquisition. You can make this setting in InfoObject maintenance. For more information, see Tab Page: Master Data/Texts.Tab Page: Master Data/Texts

The selections for the data transfer process do not overlap with selections in other data transfer processes.

Procedure

The starting point when creating a data transfer process is the InfoProvider into which you want to transfer data. In the Data Warehousing Workbench, an object tree is displayed and you have highlighted the InfoProvider.

In the context menu, choose Create Data Transfer Process.
In the dialog box that appears, select DTP for Real-Time Data Acquisition as the DTP Type .
As the source object, select the DataSource from which you want to transfer data to the InfoProvider.

The input help for the source object shows the selection of DataSources that already exist in the data flow for the InfoProvider. Using the List button, you can select a DataSource from the complete BW DataSource list.
Choose Continue.

The data transfer process maintenance screen appears.

The header data for the data transfer process shows the description, ID, version and status of the data transfer process, along with the delta status.
Define the parameters on the Extraction tab page:
1. Delta is chosen as the extraction mode for real-time data acquisition.
2. If required, you can use to define filter criteria for the data transfer.
  
  This means that you can use multiple data transfer processes with disjunctive selection conditions to efficiently transfer small sets of data from a source into one or more targets, instead of transferring large volumes of data. You can specify individual selections, multiple selections, intervals, selections based on variables, or routines. Choose Change Selection to change the list of InfoObjects that can be selected.
  
  The icon next to the pushbutton indicates that predefined selections exist for the data transfer process. The tool tip for this icon displays the selections as a character string.
3. Semantic grouping is not used for real-time data acquisition. The data is read from the source in packages.
4. Only for extraction from an ODP: Under Package Size, you can define the number of data records in the data package.
5. Only for extraction from an ODP: Maintain the RDA Threshold Values:
  - Automatic closure of the request after x hours: Specify the number of hours after which the system closes a request. The default setting is 24 hours.
    
    Irrespective of the number of records loaded, the system closes the request as soon as this threshold value is reached, and the data transfer continues in a new request.
  - Maximum Number of Data Packages: Specify the maximum number of data packages that is permitted for each request before a new request is opened. The default setting is 100 packages.
  - Maximum Number of Failed Attempts: Define the maximum number of tolerated errors per request before RDA processing will be stopped. The default setting is 10. For more information, see Troubleshooting Real-Time Data Acquisition
Define the parameters on the Update tab page:

Make the settings for error handling. The following options are available:
- Deactivated
- No update, no reporting
Define the parameters on the Execute tab page:

On this tab page, the process flow of the program for the data transfer process is displayed in a tree structure.
1. Specify the status that you want the system to adopt for the request if there are warnings in the log.
2. Specify how you want the system to determine the overall status of the request.
Check, save, and activate the data transfer process.
To access the monitor for real-time data acquisition, choose Assign Daemon.

Note

Alternatively, if you are in the Data Warehousing Workbench, you can go to the monitor for real-time data acquisition from the context menu entry Assign RDA Daemon of the data transfer process.

The following applies for extraction from the PSA: The monitor is opened if there is already an InfoPackage for RDA for the DataSource that is the source for this DTP. If there is no InfoPackage yet, the system informs you that you first have to create an InfoPackage for RDA before you can assign the DTP.

Result

The data transfer process is assigned to the DataSource.

The following applies for extraction from the ODP:

Following initialization of the delta, you create an RDA request by choosing Start Load Process in the context menu for the DataSource.

The following applies for extraction from the PSA:

If the DataSource is already assigned to a daemon, the data transfer process appears in the monitor for real-time data acquisition under this daemon and the DataSource. It is now available for data processing by the daemon.

If the DataSource has not yet been assigned to a daemon, the data transfer process appears in the monitor for real-time data acquisition under the DataSource in the area Unassigned Objects. The data transfer process, the corresponding DataSource, the InfoPackage and possibly further associated data transfer processes are assigned to the specified daemon in the context menu of the data transfer process with Assign Daemon..