Add a Data Flow from Scratch

Data flows can be added to a task when the task is created or at a later time.

Create a new data flow when there is no suitable candidate to copy or replicate.

Creating a task from scratch is described in the following steps:

  1. In the Projects tab, select the task you want to add the data flow to and select Edit.
  2. In the Data Flows tab, do one of the following:
    • Add a data flow to an existing target object.

      Select the target object and select Start of the navigation pathActions Next navigation step Add data flowEnd of the navigation path.

    • Add a data flow to a new target object.

      Select Add Target Object, select the new target object, and select Create Data Flow.

  3. In the Add Data Flow screen, enter properties for the new data flow.

    The available options depend on the data flow's target option type.

    For HANA Cloud targets, the first time a task runs, all data is loaded from the source. For subsequent runs, the load option determines how the original data is treated. Based on the application the data is being loaded to, some options may not be available.
    Note
    The options are not available for SAP Integrated Business Planning products.
    The load options are described in the following table:

    Option

    Description

    No selection

    Loads new records.

    Auto correct load based primary key correlation

    Updates existing record or inserts new record based on the primary keys defined in the target object.

    Updates occur for subsequent loads of the same records (same key).

    Inserts occur for new records (new keys).

    Note
    If there is not a primary key match, records are appended to the object and duplicate records are inserted.

    Delete data from table before loading

    Clears the existing contents of the table before loading.

    For flat file targets, the options are described in the following table:

    Option

    Description

    Root Directory

    Path name on the SAP Data Services Agent host system.

    Note
    The SAP Data Services Agent must also be configured to have access to the directory that contains the source or target files. For more information, see the Agent Guide.

    Encrypt with PGP

    Creates a PGP-protected file.

    Remote File Path

    Path on the SFTP file server. Option is only available if SFTP has been configured for the target datastore.

    User ID of the External Public Key

    An email address, name, or other identifying information. It was specified when the external (third-party) public key was generated.

    Include Digital Signature

    Used to verify the authenticity of the data's origin and integrity.

    Delete file before loading

    Removes the existing file before loading a new file.

    For SuccessFactors adapter targets, the options are described in the following table:

    Option

    Description

    Batch Size

    The number of data rows to process as a single batch.

    Default: 200

    Column delimiter

    The character sequence used to separate data between columns.

    Default: /127

    Row delimiter

    The character sequence used to separate data between rows.

    Default: /007

    Auto correct load based on primary key correlation

    Updates existing record or inserts new record based on the primary keys defined in the target table.

    Updates occur for subsequent loads of the same records (same key).

    Inserts occur for new records (new keys).

    Note
    If there is not a primary key match, records are appended to the table and duplicate records are inserted.

    Use audit

    Log load success or failure at the data level. Default is unchecked.

  4. Select OK to add the new data flow to the task.
After adding the data flow, design it in the data flow editor.