Use Parallel Processing for Web Services

By default, SAP Cloud Integration for data services calls web service functions on a row-by-row basis. However, for tasks that deal with a large number of records, this sequential operation can cause a performance bottleneck. While some web services can be called using a batch of records from the XML Batch transform, this is not always possible if the web service function does not support batch input.

By calling a web service function in parallel, you can reduce the performance bottleneck caused by row-by-row function calls.

To call a web service function with parallel processing, you must configure the degree of parallelism for the data flow, and enable parallel execution on the function itself.

  1. Configure the data flow's degree of parallelism.
    1. Open the data flow editor.
    2. In the toolbar, select View Options.
    3. Specify the degree of parallelism.

      The degree of parallelism determines how many times the data flow can call the web service function simultaneously. For example, if you set the degree of parallelism to 4, the data flow can open 4 connections to the web service function at one time.

      The default degree of parallelism is 2.

  2. Enable parallel execution for the web service function.
    1. In the Datastores tab, select the web service datastore that contains the function call that you want to modify.
    2. Select the Tables tab in the datastore editor.
    3. Select the web service function, and select Properties.
    4. Select Enable parallel execution.