Modeling Guide for SAP Data Hub

Ingest DB2 SQL

DB2 Consumer is based on datahub-flowagent and uses Data Services as an execution engine.

Data Services provides two methods of reading data from DB2 sources. You can either use DB2 Table Consumer to read the table, or use DB2 SQL Consumer to read the result set of the native SQL.

DB2 SQL Consumer

The SQL Consumer takes in native SQL statements that you would run on DB2 as input and it will read the response result set from the source piece-wise (100 rows per call), and load to the next operator in line.

Prerequisites

See the DB2 configurations on the Ingest DB2 Table graph (com.sap.dh.ingestion.db2.tableconsumer).

Components

  • Defining DB2 Connection:

    db2sqlconsumer1: provides DB2 consumer connection information.

    DB2 default port is 50000.

    If no port is provided in connection definition, the default value will be assigned.

  • Loader definition:

    flowagentfileproducer1: Data Services requires a loader, such as CSV Loader, to load to Vflow operators.

Partition

Please see partition configuration on the Oracle SQL Consumer graph (com.sap.dh.ingestion.oracle.sqlconsumer).