Skip to content
Skip to navigation
Skip to footer
Modeling Guide for SAP Data Hub
Search
Modeling Guide for SAP Data Hub
Content
Modeling Guide for SAP Data Hub
Introduction to the SAP Data Hub Modeler
Log into SAP Data Hub Modeler
Navigating the SAP Data Hub Modeler
Create Graphs
Execute Graphs
Parameterize the Process Execution
Schedule Graph Executions
Cron Expression Format
Monitoring the SAP Data Hub Modeler
Monitor the Graph Execution Status
Graph Execution
Graph States
Process States
Trace Messages
Trace Severity Levels
Using SAP Data Hub Monitoring
Log in to SAP Data Hub Monitoring
Monitoring with the SAP Data Hub Monitoring Application
Downloading Diagnostic Information for Graphs
Diagnostic Information Archive Structure and Contents
version.json File
graphs.json File
graph-source-handle Folders
graph.json File
execution.json File
events.json File
group-instance-id Folders
logs-pod-name.txt File
pod-pod-name.json File
goroutine.txt File
heap.txt File
api-pod Folder
Tutorials
Create a Graph to Execute a TensorFlow Application
Example Graphs for TensorFlow
Creating a Graph to Perform Text Analysis
Example Graph for Simple Text Analysis
Example Graph for Text Analysis with HDFS
Create Operators
Operators
Port Types
Compatible Port Types
Working with the Data Workflow Operators
Execute an SAP BW Process Chain
Execute an SAP HANA Flowgraph Operator
Transform Data
Configure the Data Source Node
Configure the Data Target Node
Configure the Projection Node
Configure the Aggregation Node
Configure the Join Node
Configure the Union Node
Configure the Case Node
Execute an SAP Data Hub Pipeline
Execute an SAP Data Services Job
Transfer Data from SAP BW to SAP Vora or Cloud Storage
Transfer Modes
Data Type Mapping and Miscellaneous
Control Flow of Execution
Control Start and Shut Down of Data Workflows
Send E-mail Notifications
SAP Data Hub Built-in Operators
Connectivity
Read File
Write File
Remove File
Move File
Copy File
Send Email
Receive Email
HANA Client
HANA Monitor
HTTP Client
HTTP Server
OpenAPI Client
OpenAPI Server
Kafka Consumer 2
Kafka Producer
MQTT Consumer
MQTT Producer
NATS Consumer
NATS Producer
WAMP Consumer
WAMP Producer
Google Pub/Sub Consumer
Google Pub/Sub Producer
Connectivity (via Flowagent)
Flowagent CSV Producer
Flowagent File Producer
Flowagent Table Producer
OData Query Consumer
Oracle Table Consumer
Oracle SQL Consumer
DB2 SQL Consumer
DB2 Table Consumer
Google BigQuery SQL Consumer
Google BigQuery Table Producer
MySQL SQL Consumer
MySQL Table Consumer
SQL Server SQL Consumer
SQL Server Table Consumer
ABAP ODP Object Consumer
Converter
ToBlob Converter
ToMessage Converter
ToString Converter
ToNumber Converter
StringToStream Converter
StreamToString Converter
Computer Vision (Python OpenCV) (Beta)
Stream Viewer
Capture Video
Capture Camera
Capture Stream
Video Player
Motion JPG Stream
Bilateral Filter
Average Blur
Box Filter
Gaussian Blur
Median Blur
Pyramid Downsampling
Pyramid Upsampling
Resize
Color to Gray
Threshold
Adaptive Threshold
Distance Transform
Bitwise And
Bitwise Or
Bitwise Not
Find Contours
Convex Hulls
Bounding Rectangles
Merge Overlapping
Closing Eye
Closing Ones
KNN Background Subtractor
Mixture of Gaussians
Mixture of Gaussians 2
Draw Contours
Draw Objects
Draw Rectangles
Draw Paths
Past Object Information
Recognize by Distance
Shape Segmentation
Message to Python2 Image Converter
Python2 Image To Message Converter
Frame Limiter
Frame Diviser
Frame Converter
Frame Multiplier
Minimal Size
Data Quality
Anonymization
Anonymized Groups Example
Data Mask
Data Mask Examples
DQMm Address Cleanse (Beta)
DQMm Reverse Geo (Beta)
DQMm Client
Validation Rule
Data Workflows
Data Transfer
BW Process Chain
Data Transform
HANA Flowgraph
Workflow Merge (and)
Workflow Merge (or)
Workflow Split
Workflow Terminator
Workflow Trigger
Pipeline
SAP Data Services Job
Notification
Managed Hadoop
Submit Hadoop Job
ML Examples (Beta)
TF Classify Image
TF Train MNIST Data
TF Evaluate MNIST
TF Generate MNIST
Sentiment Analyzer
Tweet Stream
ML Utils (Beta)
Model Producer
Model Consumer
Create Batch
Chunk Data
Dashboard (Histogram UI)
UI for Image Recognition
Dashboard (Matrix UI)
Prune Faulty Lines
Multiplexer
ML Predictive Analytics (Beta)
PA Automated
Processing
Command Executor
JavaScript Operator
JavaScript Operator 2
Process Executor
Stdin/out Port Muxer
Golang Operator 2
Data Generator
Constant Generator
Message Generator
Goengine
Gomengine
Blank JavaScript
R Client
Python2 Operators
Python2Operator
Py2 Data Generator
Py2 Type to Blob
Py2 Type to String
Python3 Operators
Python3 Operator
Py3 Data Generator
Py3 Type to Blob
Py3 Type to String
SAP Integration (Beta)
Cloud Data Integration Consumer
SAP CPI-PI iFlow
SAP Leonardo MLF
Image Classifier
Extract Img Features
Language Detector
Leonardo MLF Client
Similarity Scorer
Changepoint Detector
Topic Detector
Translator
deploymentClient
Inference Client
modelRepoClient
trainingClient
SAP Vora
Vora Loader
Vora Client
Text Analysis
Vora Avro Decoder
Avro PostAssembler
Vora Ingestor
Vora Avro Ingestor
Spark
Spark Submit
Spark Job Server Client
Livy Spark Submit
Utilities
Terminal
Graph Terminator
Message Aggregator
Header Remover
Avro Serializer
Avro Deserializer
Flowgraph Compiler
Format Converter
Histogram Plotter
Histogram
ResponseCallbackInjector
ResponseCallbackInvoker
ResponseInterceptor
Wiretap
Blob Consumer
Blob Producer
Service Specific Information
Azure Data Lake (ADL)
Local File System [File)
Google Cloud Storage (GCS)
Hadoop File System (HDFS)
Amazon S3
Microsoft Azure Blob Storage (WASB)
WebHDFS
SAP Data Hub Graphs
Computer Vision (Beta)
Object Detection (Beta)
Object Tracking (Beta)
Connectivity
Kafka
OpenAPI GreeterClient Demo
OpenAPI PlainClient Demo
OpenAPI Greeter Demo
OpenAPI Plain Greeter
OpenAPI OData People Demo
S3
Google Pub/Sub
Examples
Data Generator
Go Data Generator
Message Generator
Go Message Generator
File System
HDFS
S3
GCS
Storage
Kafka
Histogram Simple Example
HTML Viewer
Load into SAP HANA
Vora SQL Console
Load into SAP Vora
Go Operator and File
Google Dataproc
Example Counter
Data Workflow
Example Notification
Anonymization
Data Mask
DQMm Address
DQMm Reverse
Basic Validation
IoT Validation
RClient Example
Ingestion via Flowagent
Ingest OData Query
Ingest Oracle SQL
Ingest Oracle Table
Ingest to VORA Streaming Table
Ingest DB2 SQL
Ingest DB2 Table
Ingest Google BigQuery SQL
Ingest Google BigQuery Table Producer
Ingest SQL Server SQL
Ingest SQL Server Table
Ingest MySQL SQL
Ingest MySQL Table
ML Examples (Beta)
Classify Images with Inception
Classify Video Stream with Inception
Infer MNIST Str. Repo
Infer MNIST Stream UI
Train MNIST Model Repository
R Training Pipeline (Iris Dataset) (Beta)
R Inference Pipeline (Iris Dataset) (Beta)
Sentiment Analysis Simple Example (Beta)
Tweet Sentiment With Histogram (Beta)
Tweet Stream Simple Example (Beta)
ML Predictive Analytics (Beta)
Apply PA Automated (Beta)
SAP Leonardo ML (Beta)
Classify Video Stream with Leonardo MLF Inference Client (Beta)
Image Classification
Image Feature Extraction
Classification with Leonardo MLF Inference Client
Regression with Leonardo MLF Inference Client
Training and Deploying Model with Leonardo MLF (Beta)
Similarity Scoring
TS Changepoint Detection
Topic Detection
Translation
SAP Vora
Direct Avro Ingestion
Avro Ingest. via Disk
Avro Ingest. Timeseries
Direct CSV Ingest2
CSV Ingest2 via Disk
CSV Ingest2 Timeseries
CSV Ingest3 via Disk
JSON Ingest2 via Disk
Record Ingest via Disk
Avro Ingest Mod via Disk
CSV Ingest2 via Disk
Text Analysis
Text Analysis Example
Text Analysis HDFS
Text Analysis Local File System
Utilities
Response Interceptor
Response Interceptor 2
Response Invoker
Wiretap
SAP Integration (Beta)
SAP CPI-PI iFlow Example
Subengines
Working with the C++ Subengine to Create Operators
Getting Started
Creating an Operator
Logging and Error Handling
Port Data
Setting Values for Configuration Properties
Process Handlers
API Reference
log.h
subengine.h
Working with Python2.7 and Python3.6 Subengines to Create Operators
Normal Usage
Using Python Libraries
Advanced Usage
Using Python Library
Adding Documentation
Creating Tests
List of BaseOperator Methods
Logging
Uploading to SAP System Management
Uploading Solution as a Layer in System Management
Uploading Solution in System Management to Tenant or User Workspace
Create Dockerfiles
Create Types
>
SAP Data Hub Built-in Operators
>
Managed Hadoop
Managed Hadoop
Related Information
Submit Hadoop Job
