SAP Data Hub Graphs
A graph is a network of operators connected to each other using typed input ports and output ports for data transfer. Users can define and configure the operators in a graph.
| Category | Graph | Technical Name | Primary Use Case | Status |
|---|---|---|---|---|
| Computer Vision | Object Detection | com.sap.cv.objectDetection | Detect the moving objects in the scene, without applying the segmentation algorithm or the recognition algorithm. | Beta |
| Computer Vision | Object Tracking | com.sap.cv.objectTracking | Detect, segment, recognize, and track multiple objects in previously unknown conditions without any prior knowledge about the objects. | Beta |
| Connectivity | Kafka | com.sap.demo.kafka | The data generator generates arbitrary data and passes it to the Kafka producer. The Kafka consumer reads the data and writes it to a terminal. |
|
| Connectivity | OpenAPI GreeterClient Demo | com.sap.demo.openapi.client.greeter | The openapi.client operator can call arbitrary REST services from a graph. |
|
| Connectivity | OpenAPI PlainClient Demo | com.sap.demo.openapi.client.plain_greeter | The openapi.client operator can call arbitrary REST services from a graph. |
|
| Connectivity | OpenAPI Greeter Demo | com.sap.demo.openapi.server.greeter | The openapi.server operator allows REST services to be exposed from a graph. |
|
| Connectivity | OpenAPI Plain Greeter | com.sap.demo.openapi.server.plain_greeter | The openapi.server operator allows REST services to be exposed from a graph. |
|
| Connectivity | OpenAPI OData People Demo | com.sap.demo.openapi.server.odata_people | This demo graph demonstrates how to use openapi.server to expose an OData service endpoint. |
|
| Connectivity | S3 | com.sap.demo.s3 | The data generator produces arbitrary data. |
|
| Connectivity | Google Pub/Sub | com.sap.demo.googlepubsub | This example shows how to publish messages using the Google Pub/Sub Producer, and consume them via the Google Pub/Sub Consumer. |
|
| Examples | Data Generator | com.sap.demo.datagenerator | The data generator generates arbitrary values simulating a set of sensors. |
|
| Examples | Go Data Generator | com.sap.demo.goDataGenerator | The data generator generates arbitrary values simulating a set of sensors. |
|
| Examples | Message Generator | com.sap.demo.messageGenerator | The message generator generates arbitrary values packed into a message, simulating a set of sensors. |
|
| Examples | Go Message Generator | com.sap.demo.goMessageGenerator | The message generator generates arbitrary values packed into a message, simulating a set of sensors. |
|
| Examples | File System | com.sap.demo.file | The data generator generates arbitrary data. |
|
| Examples | HDFS | com.sap.demo.hdfs | The data generator generates arbitrary data. |
|
| Examples | S3 | com.sap.demo.s3 | The data generator generates arbitrary data. |
|
| Examples | GCS | com.sap.demo.gcs | The data generator generates arbitrary data. |
|
| Examples | Storage | com.sap.demo.storage | The data generator generates arbitrary data. |
|
| Examples | Kafka | com.sap.demo.kafka | The data generator generates arbitrary data and passes it to the Kafka producer. |
|
| Examples | Histogram Simple Example | com.sap.demo.util.histogramSimple | The first operator generates random numbers that are sent to the Histogram Operator, which produces the histogram of its inputs as a Message, with an integer array on its body, and the range of the interval on its attributes. |
|
| Examples | HTML Viewer | com.sap.demo.htmlViewer | This example graph simulates a Sales Campaign generating pseudo-random data for a large number of stores. |
|
| Examples | Load into SAP HANA | com.sap.demo.hana | The data generator produces sensor data as a CSV string. |
|
| Examples | Vora SQL Console | com.sap.demo.vora.client | This graph shows how to use a Vora Client operator to execute SQL commands on SAP Vora. |
|
| Examples | Load into SAP Vora | com.sap.demo.vora.hdfs | The data generator produces sensor data which is aggregated by the JavaScript Operator. |
|
| Examples | Go Operator and File | com.sap.demo.system.goOperator | This graph reads content from a file and uses the Go operator in order to deal with the file content and name using different go functions and message type in the Go operator. |
|
| Examples | Google Dataproc | com.sap.demo.hadoop.dataproc | This example shows how to submit a Spark job to an existing Google Dataproc cluster, and see the results of the job. |
|
| Examples | Example Counter | com.sap.demo.counter | This graph runs for five seconds and then shuts down with status “completed”. It is intended for testing purposes. |
|
| Examples | Data Workflow | com.sap.demo.dataworkflow | This graph starts an internal example graph. It serves as an example on how to use the operators from the Data Workflow category. |
|
| Examples | Example Notification | com.sap.demo.notification | This graph serves as an example on how to use SAP Data Hub Notification and Pipeline operators from the Data Workflows category. |
|
| Examples | Data Mask | com.sap.demo.dataMask | The data mask operator protects the personally identifiable or sensitive information by covering all or a portion of the data. |
|
| Examples | DQMm Address | com.sap.demo.dqmm.addrCleanse | The DQMm Address Cleanse operator creates a request from data that can be passed to the DQMm Client operator to be sent to the service. |
|
| Examples | DQMm Reverse | com.sap.demo.dqmm.reverseGeo | The DQMm Reverse Geo operator creates a request from data that can be passed to the DQMm Client operator to be sent to the service. |
|
| Examples | Basic Validation | com.sap.demo.validationRule.basicValidationRule | The Validation Rule operator evaluates input data against a rule. |
|
| Examples | IoT Validation | com.sap.demo.validationRule.IoTValidationRule | This graph models a sensor that tracks the temperature and surface illuminance. |
|
| Examples | RClient Example | com.sap.demo.rClientExample | This graph shows the different features of the RClient operator. |
|
| Ingestion via Flowagent | Ingest OData Query | com.sap.dh.ingestion.odata.queryconsumer | Read data from OData sources using the OData Query Consumer to read the result set of the native OData Query URI. |
|
| Ingestion via Flowagent | Ingest Oracle SQL | com.sap.dh.ingestion.oracle.sqlconsumer | Data Services provides two methods of reading data from Oracle sources using the third party OCI client. |
|
| Ingestion via Flowagent | Ingest Oracle Table | com.sap.dh.ingestion.oracle.tableconsumer | Data Services provides two methods of reading data from Oracle sources using the third party OCI client. |
|
| Ingestion via Flowagent | Ingest to VORA Streaming Table | com.sap.dh.ingestion.vora.tableproducer | Flowagent Database Producer allows you to consume flowagent based consumer operators, loading the data to a database source, which in this graph is set to Vora. |
|
| ML Examples | Classify Images with Inception | com.sap.ml.tensorflow.classifyImages | This graph applies the inception neuronal network on any image that is fed into the input stream. | Beta |
| ML Examples | Classify Video Stream with Inception | com.sap.ml.tensorflow.classifyVideoStream | This graph applies the inception neuronal network on any video that is fed into the input stream. | Beta |
| ML Examples | Infer MNIST Str. Repo | com.sap.ml.tensorflow.evaluateMnistRepo | This graph applies a neuronal network based on a stream of images of handwritten numbers. | Beta |
| ML Examples | Infer MNIST Stream UI | com.sap.ml.tensorflow.evaluateMnistUI | This graph applies a neuronal network based on a stream of images of handwritten numbers. | Beta |
| ML Examples | Train MNIST Model Repository | com.sap.ml.tensorflow.trainMnistRepo | This graph trains a simple neuronal network, and stores the model packed as a tar file in the blob repository. | Beta |
| ML Examples | R Training Pipeline (Iris Dataset) | com.sap.ml.r.iris.train | This graph trains a flower classifier with R on the Iris Data Set. | Beta |
| ML Examples | R Inference Pipeline (Iris Dataset) | com.sap.ml.r.iris.inference | This graph predicts flower classes using a specified trained R classifier. | Beta |
| ML Examples | Sentiment Analysis Simple Example | com.sap.ml.nlp.sentimentSimpleExample | A message generator (implemented with a JavaScript Operator) is used to alternate between two strings in the body of the message. | Beta |
| ML Examples | Tweet Sentiment With Histogram | com.sap.ml.nlp.tweetSentiment | This graph analyzes the sentiment of tweets and then makes a histogram of their polarity, which range between -1 and 1. | Beta |
| ML Examples | Tweet Stream Simple Example | com.sap.ml.nlp.tweetStreamExample | Convert the output message of the Tweet Stream operator to a string and print it into the Terminal operator. | Beta |
| ML Predictive Analytics | Apply PA Automated | com.sap.ml.pa.applyAutomatedAnalytics | This graph runs the PA automated analytics application on streaming string input data using a model trained on the Census data set as example. | Beta |
| SAP Leonardo ML | Classify Video Stream with Leonardo MLF Inference Client | com.sap.ml.leonardo.classifyVideo | Run the graph and use the terminal to iteratively send the parameters. | Beta |
| SAP Leonardo ML | Image Classification | com.sap.ml.leonardo.imageClassification | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Leonardo ML | Image Feature Extraction | com.sap.ml.leonardo.imageFeatureExtraction | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Leonardo ML | Classification with Leonardo MLF Inference Client | com.sap.ml.leonardo.mlfClassification | Run the graph and use the terminal to iteratively send the parameters. | Beta |
| SAP Leonardo ML | Regression with Leonardo MLF Inference Client | com.sap.ml.leonardo.mlfRegression | Run the graph and use the terminal to iteratively send the parameters. | Beta |
| SAP Leonardo ML | Training and Deploying Model with Leonardo MLF | com.sap.ml.leonardo.mlfTraining | Run the graph and use the terminals to follow the log messages describing the training and deployment of the model. | Beta |
| SAP Leonardo ML | Similarity Scoring | com.sap.ml.leonardo.similarityScoring | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Leonardo ML | TS Changepoint Detection | com.sap.ml.leonardo.timeSeriesChangepointDetection | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Leonardo ML | Topic Detection | com.sap.ml.leonardo.topicDetection | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Leonardo ML | Translation | com.sap.ml.leonardo.translation | Run the graph and use the terminal to interactively create request messages. | Beta |
| SAP Vora | Direct Avro Ingestion | com.sap.demo.vora.ingestion.avro_ingestion_direct_example | A series of messages are read, each consisting of Avro records. Each message is passed to the Avro ingestor, which directly stores the records in the vora disk engine and emits the commit token associated with each message. |
|
| SAP Vora | Avro Ingest. via Disk | com.sap.demo.vora.ingestion.avro_ingestion_example_disk | A series of messages are read, each consisting of Avro records. Each message is passed to the preingestor, which creates a message with record objects. Finally, this message is passed to the ingestor, which stores the records in the vora disk engine and emits the commit token associated with each message. |
|
| SAP Vora | Avro Ingest. Timeseries | com.sap.demo.vora.ingestion.avro_ingestion_example_series | A series of messages are read, each consisting of Avro records. Each message is passed to the preingestor, which creates a message with record objects. Finally, this message is passed to the ingestor, which stores the records in the vora timeseries engine and emits the commit token associated with each message. |
|
| SAP Vora | Direct CSV Ingest2 | com.sap.demo.vora.ingestion.csv_ingestion_direct_example2 | The data generator generates a series of messages, each consisting of one or more csv records. |
|
| SAP Vora | CSV Ingest2 via Disk | com.sap.demo.vora.ingestion.csv_ingestion_example2_disk | The data generator generates a series of messages, each consisting of one or more csv records. |
|
| SAP Vora | CSV Ingest2 Timeseries | com.sap.demo.vora.ingestion.csv_ingestion_example2_series | The data generator generates a series of messages, each consisting of one or more csv records. |
|
| SAP Vora | CSV Ingest3 via Disk | com.sap.demo.vora.ingestion.csv_ingestion_example3_disk | This sample graph is similar to the sample graph csv_ingestion_example2_disk. It uses, however, an Avro schema with additional extension attributes to customize the table definition. |
|
| SAP Vora | JSON Ingest2 via Disk | com.sap.demo.vora.ingestion.json_ingestion_example2_disk | The data generator generates a series of messages, each consisting of one or more JSON records. |
|
| SAP Vora | Record Ingest via Disk | com.sap.demo.vora.ingestion.rec_ingest_example2_disk | The data generator generates a series of messages, each consisting of one or more record objects. |
|
| SAP Vora | Avro Ingest Mod via Disk | com.sap.demo.vora.ingestion.avro_ingestion_example_disk_go | From a kafka broker, a series of messages is read, each consisting of Avro records. Each message is passed to the preingestor, which creates a message with record objects. Finally, this message is passed to the ingestor, which stores the records in the vora disk engine and emits the commit token associated with each message. |
|
| SAP Vora | CSV Ingest2 via Disk | com.sap.demo.vora.ingestion.csv_ingestion_example2_disk_go | The data generator generates a series of messages, each consisting of one or more csv records. |
|
| Text Analysis | Text Analysis Example | com.sap.textanalysis.example | This is an example graph for text analysis that shows the use of the Text Analysis Connector operator. |
|
| Text Analysis | Text Analysis HDFS | com.sap.textanalysis.hdfs | This graph is a demo for text analysis using hdfs file system. |
|
| Text Analysis | Text Analysis Local File System | com.sap.textanalysis.lfs | This graph is a demo for text analysis using a local file system. |
|
| Utilities | Response Interceptor | com.sap.demo.util.respintercept | The util.responseinterceptor can be used to intercept a response message and deliver it to the initiator of a request response invocation. |
|
| Utilities | Response Interceptor 2 | com.sap.demo.util.respintercept2 | The util.responsecallbackinjector can be used to inject a response callback to an incoming message so that when its callback is invoked, the corresponding response message is emitted from this operator and this message can be sent to the responseinterceptor operator. |
|
| Utilities | Response Invoker | com.sap.demo.util.respinvoke | The util.responseinvoker can be used to invoke the response callback to deliver a response message to the initiator of a request response invocation. |
|
| Utilities | Wiretap | com.sap.demo.util.wiretap | The wiretap operator allows the user to inspect messages that are transferred from one operator to another. |
|