Modeling Guide for SAP Data Hub

Ingest Google BigQuery Table Producer

Google BigQuery Table Producer Graph is based on datahub-flowagent and uses Data Services as an execution engine. The graph uses the SAP ABAP ODP extractor as sample source data for ingestion.

Table Producer takes in the full path of Google Cloud Storage (GCS) file and loads it into Google BigQuery Table defined as "targetObjectName"

.

Components

  • Source Data:

    sapabapodpconsumer1: Data is read from SAP ABAP ODP object.

  • Load to GCS:

    flowagentfileproducer1: The data is loaded to GCS before sending to Google BigQuery table.

  • Defining Connection:

    googlebigquerytableproducer1: Provides table producer connection information.