Show TOC

Creating InfoPackages for Real-Time Data AcquisitionLocate this document in the navigation structure

Use

You use (standard) InfoPackages to determine the parameters for data request and data transfer from a source to the inbound layer of BI, the Persistent Staging Area (PSA).

For real-time data acquisition (SAPI and Web service), like when using Web services without real-time data acquisition for standard update (with a standard data transfer process), you use a special type of InfoPackage that allows you to specify the required parameters for these transfer types. This InfoPackage type is called InfoPackage for Real-Time Data Acquisition.

Requests that are instantiated using an InfoPackage for real-time data acquisition remain open across several load processes. In the InfoPackage for real-time data acquisition, you specify the size and time limits for requests. The system closes a request when one on the defined threshold values is reached.

Prerequisites

  • The DataSource for which you want to create an InfoPackage supports real-time data acquisition.

  • If you are transferring data into BW using the service API, you have already created an InfoPackage for initializing the delta process for this DataSource, and have completed the initialization.

Procedure

You can only create one InfoPackage for a DataSource for real-time data acquisition.

  1. In the modeling view of the Data Warehousing Workbench, navigate to the DataSource tree of the required source system, select the DataSource, and in the context menu, choose Create InfoPackage.

  2. In the following dialog box, enter a description for the InfoPackage. In the DataSource table, select the required DataSource.

    • If you are transferring the data using the service API:

      Select the Real-Time Data Acquisition InfoPackage indicator. This field is only input ready if the DataSource supports real-time data acquisition, an InfoPackage for real-time data acquisition has not yet been created for this DataSource, and the delta initialization is complete.

    • If you are transferring the data using a Web service:

      The Real-Time Data Acquisition InfoPackage indicator is already set.

  3. Choose Save.

    The scheduler appears, in which you can maintain the InfoPackage.

  4. Enter the parameters on the Data Selection tab page:

    • If you are transferring data using the service API, the selections from the delta initialization are displayed.

    • If you are transferring data using the Web service, you can specify the selection values for the data transfer.

      Note

      If selectable fields are defined in the Web service DataSource and you have specified corresponding selections in the InfoPackage, before writing to the PSA, the system filters out all data records that do not fulfill the selection conditions. In this case, the number of records available in the PSA is less than the number of records sent by the source.

  5. Enter the parameters on the Extraction tab page:

    • If you are transferring the data using the service API, Real-Time Extraction from SAP Source System is displayed as the adapter.

    • If you are transferring the data using a Web service:

      Web Service (Push) is displayed as the adapter.

      Change the security profile for the data transfer, as required.

      If the name of the Web service or dependent objects needs to be predefined in the target system of a transport, enter a fixed name for the Web service. The Web service and any dependent objects, such as the corresponding function module, are then created using this name and the relevant generation prefix.

  6. Enter the parameters on the Processing tab page:

    • Define the threshold values for closing a request:

      • Specify the maximum number of days and / or hours after which the system closes a request. The default setting is one day.

        Irrespective of the number of records loaded, the system closes the request as soon as this threshold value is reached, and the data transfer continues in a new request.

      • Specify the maximum number of data records that is permitted for each request before a new request is opened. The default setting is 100,000 records.

      The system checks the threshold values before it uses the request to update data. When one of the threshold values is exceeded, the daemon closes the request and the data transfer is continued using a new request.

      If you use a Web service, the Web service caller also uses the threshold values to close the request. Whether the Web service caller or the daemon closes the request when you use a Web service depends on whether you are using the Web service for standard update without RDA, meaning without daemon assignment, or whether you are using the Web service with RDA. The Web service caller multiplies the defined threshold values (time and number of records) by 2. If you are using the Web service with RDA, this ensures that the daemon closes the request. If you are using the Web service without RDA, this ensures that the request is also closed without daemon after a certain amount of time or once it reaches a certain size. However, if you are using the Web service without RDA, you should not close the request using the threshold values. Instead you should use the process type Close Real-Time InfoPackage Request. Make a note of this when you make the settings for the threshold values in the InfoPackage.

    • For real-time data acquisition (SAPI Web service): Create the maximum number of tolerable errors that are permitted for each request before a request is evaluated as incorrect and RDA processing is stopped. For more information, see Troubleshooting Real-Time Data Acquisition.

    • The maximum size a data package for the data transfer can reach before a new package is opened is predefined. The default setting is 10,000 records. This setting can only be changed by the debug user. This setting may affect performance if you are updating data to the PSA using parallel processing (see Tasks on Demand, Change System Parameters).

  7. Save the InfoPackage.

    The InfoPackage and the related DataSource are now visible in the monitor for real-time data acquisition in the Unassigned Objects area.

  8. For real-time data acquisition (SAPI Web service): On the Schedule tab page, choose the Assign Daemon or Call RDA Monitor pushbutton.

    Alternatively, if you are in the Data Warehousing Workbench you can go to the monitor for real-time data acquisition from the context menu entry Assign RDA Daemon of the InfoPackage.

    In the monitor for real-time data acquisition, the system now displays the InfoPackage in the Unassigned Objects area, under the DataSource for which the InfoPackage was created. You assign the DataSource, the InfoPackage, and possibly any associated data transfer processes, to the specified daemon in the context menu of the DataSource by choosing Assign Daemon. The daemon now processes the InfoPackage.