SAP Data Hub Built-in Operators
SAP Data Hub provides built-in operators which can be directly used in a graph or used as the basis for a custom operator.
An event from the environment is a message delivered to the operator through its input ports. The operator can interact with the environment through its output ports. The operators are unaware of the graph in which it is defined and the source and target of its incoming and outgoing connections.
Category |
Operator |
Technical Name |
Primary Use Case |
Status |
Replaced By |
---|---|---|---|---|---|
Computer Vision (Python OpenCV) | Adaptive Threshold | com.sap.cv.opencv.imgproc.transform.adaptiveThreshold | Apply an adaptive threshold to an image. | Beta |
|
Deprecated Operators | ADL Consumer | com.sap.storage.adl.consumer | Access an ADL instance to read a file or periodically poll a directory for its contents. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “adl”. |
Deprecated Operators | ADL Producer | com.sap.storage.adl.producer | Write files to ADL. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “adl”. |
Computer Vision (Python OpenCV) | Average Blur | com.sap.cv.opencv.imgproc.filter.blur | Perform the averaging blur filter on the image. | Beta |
|
Utilities | Avro Deserializer | com.sap.util.avroDeserializer | Convert Avro-encoded messages and produce the contents as CSV-encoded lines. |
|
|
SAP Vora | Avro PostAssembler | com.sap.vora.postassembler | Create Avro, CSV, or JSON messages from the Vora messages containing record objects. |
|
|
SAP Vora | Avro PreIngestor | com.sap.vora.preingestor | Decode coded (Avro, CSV, and JSON) messages and offer the possibility to process the decoded messages before storing them in SAP Vora using SAP Vora Ingestor. |
|
|
Utilities | Avro Serializer | com.sap.util.avroSerializer | Convert CSV encoded lines and produces the contents as Avro encoded messages. |
|
|
Computer Vision (Python OpenCV) | Bitwise And | com.sap.cv.opencv.core.arrayop.bitwiseAnd | Perform pixel-wise logical conjunction between two images. | Beta |
|
Computer Vision (Python OpenCV) | Bitwise Or | com.sap.cv.opencv.core.arrayop.bitwiseOr | Perform pixel-wise logical disconjunction between two images. | Beta |
|
Computer Vision (Python OpenCV) | Bitwise Not | com.sap.cv.opencv.core.arrayop.bitwiseNot | Perform pixel-wise logical complement between two images. | Beta |
|
Computer Vision (Python OpenCV) | Bilateral Filter | com.sap.cv.opencv.imgproc.filter.bilateralFilter | Perform bilateral filter on the image. | Beta |
|
Processing | Blank JavaScript | com.sap.system.jsoperator | Execute JavaScript snippets within a graph. |
|
|
Utilities | Blob Consumer | com.sap.blob.consumer | Consume a blob in the blob repository. |
|
|
Utilities | Blob Producer | com.sap.blob.producer | Push a blob to the blob repository. |
|
|
Computer Vision (Python OpenCV) | Bounding Rectangles | com.sap.cv.opencv.imgproc.shape.boundingRects | Find the smallest bounding rectangle for the given set of points. | Beta |
|
Computer Vision (Python OpenCV) | Box Filter | com.sap.cv.opencv.imgproc.filter.boxFilter | Perform box filter on the image. | Beta |
|
Computer Vision (Python OpenCV) | Capture Camera | com.sap.cv.opencv.mediaio.captureCamera | Retrieve video stream from local webcam device /dev/video[n] using OpenCV. (Only working in local mode.) | Beta |
|
Computer Vision (Python OpenCV) | Capture Stream | com.sap.cv.opencv.mediaio.captureStream | Capture the video stream from a distant host (webcam, ...). | Beta |
|
Computer Vision (Python OpenCV) | Capture Video | com.sap.cv.opencv.mediaio.captureVideo | Capture the video stream from a file on the File System. | Beta |
|
SAP Leonardo MLF | Changepoint Detector | com.sap.ml.leonardo.timeSeriesChangepointDetector | Prepare a request message for the Leonardo Machine Learning Foundation (Leonardo MLF) service: Changepoint Detection. |
|
|
ML Utils | Chunk Data | com.sap.ml.util.dataChunker | Split a batch of lines into separate lines and sends single lines in fixed time intervals. | Beta |
|
Computer Vision (Python OpenCV) | Closing Eye | com.sap.cv.opencv.imgproc.morphology.closingEye | Perform the morphological closing operation on the image with the identity matrix kernel. | Beta |
|
Computer Vision (Python OpenCV) | Closing Ones | com.sap.cv.opencv.imgproc.morphology.closingOnes | Perform the morphological closing operation on the image with the kernel filled with ones. | Beta |
|
Processing | Command Executor | com.sap.system.commandExecutor | Execute the given command for each arrival of a message on the stdin port. |
|
|
Processing | Constant Generator | com.sap.util.constantGenerator | Represent a constant string that may be emitted into the graph. |
|
|
Computer Vision (Python OpenCV) | Color to Gray | com.sap.cv.opencv.imgproc.transform.colorToGray | Convert color images to gray-scale. | Beta |
|
Connectivity | Copy File | com.sap.storage.copy2 | Copy files in a storage service. |
|
|
Deprecated Operators | Copy File | com.sap.storage.copy | Copy files in a storage service. | Deprecated | Copy File (com.sap.storage.copy2) |
Computer Vision (Python OpenCV) | Convex Hulls | com.sap.cv.opencv.imgproc.shape.convexHulls | Find the convex hull for the given set of points. | Beta |
|
ML Utils | Create Batch | com.sap.ml.util.dataBatcher | Batch several string lines to a batch, with a newline as delimiter. | Beta |
|
Data Quality | Data Mask | com.sap.dh.dq.dataMask | Protect the personally identifiable or sensitive information by covering all or a portion of the data. |
|
|
Data Workflows | Data Transfer | com.sap.dh.bwdatatransfer | Transfer data from an SAP BW system to an SAP Vora system. |
|
|
Data Workflows | Data Transform | com.sap.dh.datatransform | Provides capabilities to meet your data transformation requirement. |
|
|
Processing | Data Generator | com.sap.util.dataGenerator | Generate random sample data every 500ms. |
|
|
ML Utils | Dashboard (Histogram UI) | com.sap.ml.util.histogramUI | Show a histogram of the accumulation of product classes and the current tweet. | Beta |
|
ML Utils |
Dashboard (Matrix UI) | com.sap.ml.util.matrixUI | Show the confusion matrix together with the classification accuracy. | Beta |
|
SAP Leonardo MLF | deploymentClient | com.sap.ml.leonardo.deploymentClient | Perform the OAuth2 authentication using oauthClientId and oauthClientSecret on oauthTokenUrl and sends the request to the server. |
|
|
Computer Vision (Python OpenCV) | Distance Transform | com.sap.cv.opencv.imgproc.transform.distanceTransform | Calculate the distance to the closest zero pixel for each pixel. | Beta |
|
Computer Vision (Python OpenCV) | Draw Contours | com.sap.cv.opencv.imgproc.drawing.drawContours | Draw the contours of shapes from the given set of points. | Beta |
|
Computer Vision (Python OpenCV) | Draw Objects | com.sap.cv.trackcv.visual.drawObjects | Draw the detected objects in the frame. | Beta |
|
Computer Vision (Python OpenCV) | Draw Paths | com.sap.cv.trackcv.visual.drawPaths | Draw the paths representing the objects movement. | Beta |
|
Computer Vision (Python OpenCV) | Draw Rectangles | com.sap.cv.opencv.imgproc.drawing.drawRectangles | Draw rectangles on the specified positions of the image. | Beta |
|
Data Quality | DQMm Address Cleanse (Beta) | com.sap.dh.dq.dqmmAddressCleanse | Prepare address cleanse requests to be sent to the SAP Data Quality Management, microservices for location data services. | Beta |
|
Data Quality | DQMm Client | com.sap.dh.dq.dqmmClient | Send requests to the Data Quality Management microservices for location data. |
|
|
Data Quality | DQMm Reverse Geo (Beta) | com.sap.dh.dq.dqmmReverseGeo | Prepare address cleanse requests to be sent to the SAP Data Quality Management, microservices for location data services. | Beta |
|
SAP Leonardo MLF | Extract Img Features | com.sap.ml.leonardo.imageFeatureExtractor | Prepare a request message for the Leonardo Machine Learning Foundation (Leonardo MLF) service: Extract Img Features. |
|
|
Deprecated Operators | File Consumer | com.sap.storage.file.consumer | Access the file system to read a file or periodically poll a directory for its contents. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “file”. |
Deprecated Operators | File Producer | com.sap.storage.file.producer | Write files to the file system. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “file”. |
Utilities | Flowgraph Compiler | com.sap.bdh.flowgraphCompiler | Compile incoming flowgraph XML strings into jars that can be executed via Spark. |
|
|
Connectivity (via Flowagent) | Flowagent CSV Producer | com.sap.dh.ds.csv.producer | Consume flowagent based consumer operators. |
|
|
Connectivity (via Flowagent) | Flowagent File Producer | com.sap.dh.ds.storage.producer | Consume flowagent based consumer operators. |
|
|
Utilities | Format Converter | com.sap.util.formatConverter | Convert blobs between CSV, JSON and XML. |
|
|
Computer Vision (Python OpenCV) | Frame Converter | com.sap.cv.opencv.vidutil.frameConverter | Convert messages, i.e. from the File Consumer, into images/frames. | Beta |
|
Computer Vision (Python OpenCV) | Frame Diviser | com.sap.cv.opencv.vidutil.frameDiviser | Send to mainOut the secondaryNumber(th) input, otherwise it is sent to secondaryOut. | Beta |
|
Computer Vision (Python OpenCV) | Frame Limiter | com.sap.cv.opencv.vidutil.frameLimiter | Resends only the n-th frame forward. | Beta |
|
Computer Vision (Python OpenCV) | Frame Multiplier | com.sap.cv.opencv.vidutil.frameMultiplier | Resend frame n-times. | Beta |
|
Deprecated Operators | GCS Consumer | com.sap.storage.gcs.consumer | Access a GCS instance to read a file or periodically poll a directory for its contents. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “gcs”. |
Deprecated Operators | GCS Producer | com.sap.storage.gcs.producer | Write files to GCS. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “gcs”. |
Deprecated Operators | Go Data Generator | com.sap.util.goDataGenerator | Execute Go code within a graph. | Deprecated | Golang Operator 2 (com.sap.system.golangExecutor2) |
Processing | Goengine | com.sap.system.golangengine2 | Execute Go code within a graph. |
|
|
Deprecated Operators | Goengine | com.sap.system.golangengine | Execute Go code within a graph. | Deprecated | Golang Operator 2 (com.sap.system.golangExecutor2) |
Deprecated Operators | Golang Operator | com.sap.system.golangExecutor | Execute Go code within a graph. | Deprecated | Golang Operator 2 (com.sap.system.golangExecutor2) |
Processing | Golang Operator 2 | com.sap.system.golangExecutor2 | Execute Go code within a graph. |
|
|
Processing | Gomengine | com.sap.system.golangmengine2 | Execute Go code within a graph. |
|
|
Deprecated Operators | Gomengine | com.sap.system.golangmengine | Execute Go code within a graph. | Deprecated | Golang Operator 2 (com.sap.system.golangExecutor2) |
Deprecated Operators | Go Message Generator | com.sap.util.goDataMessageGenerator | Execute Go code within a graph. | Deprecated | Golang Operator 2 (com.sap.system.golangExecutor2) |
Utilities | Graph Terminator | com.sap.util.graphTerminator | Terminate the current graph execution. |
|
|
Deprecated Operators | HDFS Consumer | com.sap.storage.hdfs.consumer | Access an HDFS instance to read a file or periodically poll a directory for its contents. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “hdfs”. |
Deprecated Operators | HDFS Producer | com.sap.storage.hdfs.producer | Write files to HDFS. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “hdfs”. |
Utilities | Header Remover | com.sap.util.headerRemover | Remove specified headers from an SAP Vora message. The operator has two output ports: one that produces the SAP Vora message and another that produces only the message body. |
|
|
Utilities | Histogram | com.sap.util.histogram | Receive a numeric value as input and increments the counter of the bin that corresponds to the range in which the value lies. The array of counts is then sent in the output port. |
|
|
Utilities | Histogram Plotter | com.sap.util.histogramPlotter | Receive a string-converted Data Pipeline message as input with an array of integers in the body and rangeMin and rangeMax fields in the header. |
|
|
Connectivity | HTTP Client | com.sap.http.client2 | An HTTP client operator capable of sending arbitrary HTTP requests, polling a URL and, posting JSON data. |
|
|
Deprecated Operators | HTTP Client | com.sap.http.client | An HTTP client operator capable of sending arbitrary HTTP requests, polling a URL and, posting JSON data. | Deprecated | HTTP Client (com.sap.http.client2) |
Connectivity | HTTP Server | com.sap.http.server | Start an HTTP server on a configurable port. It handles GET and POST requests received from a configurable handler path. |
|
|
SAP Leonardo MLF | Image Classifier | com.sap.ml.leonardo.imageClassifier | Prepare a request message for the Leonardo Machine Learning Foundation (Leonardo MLF) service: Image Classifier. |
|
|
SAP Leonardo MLF | Inference Client | com.sap.ml.leonardo.inferenceClient | Perform the OAuth2 authentication using oauthClientId and oauthClientSecret on oauthTokenUrl and sends the request to the MLF model server. |
|
|
Processing | JavaScript Operator | com.sap.system.jsengine | Execute JavaScript snippets within a graph. |
|
|
Processing | JavaScript Operator 2 | com.sap.system.jsmengine | Execute JavaScript snippets within a graph using the vflow messages. |
|
|
Deprecated Operators | Kafka Consumer | com.sap.kafka.consumer | Consume records/messages from a Kafka cluster. | Deprecated | Kafka Consumer (com.sap.kafka.consumer2) |
Connectivity | Kafka Consumer 2 | com.sap.kafka.consumer2 | Consume records/messages from a Kafka cluster. |
|
|
Connectivity | Kafka Producer | com.sap.kafka.producer | Send records/messages to topics on a Kafka cluster. |
|
|
Computer Vision (Python OpenCV) | KNN Background Subtractor | com.sap.cv.opencv.vidanalysis.knnSubtractor | K-Nearest Neighbors background subtractor. | Beta |
|
Spark | Livy Spark Submit | com.sap.livy.submit | Submit jobs to a cluster using the Livy REST API. |
|
|
Computer Vision (Python OpenCV) | Median Blur | com.sap.cv.opencv.imgproc.filter.medianBlur | Perform median blur on the image. | Beta |
|
Computer Vision (Python OpenCV) | Merge Overlapping | com.sap.cv.trackcv.blobop.mergeOverlapping | Merge the overlapping rectangles. | Beta |
|
Utilities | Message Aggregator | com.sap.util.aggregator | Aggregate input messages in a custom manner specified by JavaScript functions that the user can enter. |
|
|
Processing | Message Generator | com.sap.util.aggregator | Generate a message with random sample data every 500ms. |
|
|
Computer Vision (Python OpenCV) | Message to Python2 Image Converter | com.sap.cv.opencv.converter.messageToPy2Image | Convert messages, i.e. from File Consumer, into Python2 Images. | Beta |
|
Computer Vision (Python OpenCV) | Minimal Size | com.sap.cv.trackcv.blobop.minSize | Remove the given rectangles that do not meet a size criteria. | Beta |
|
Computer Vision (Python OpenCV) | Mixture of Gaussians | com.sap.cv.opencv.vidanalysis.mogSubtractor | Mixture of Gaussians background subtractor. | Beta |
|
Computer Vision (Python OpenCV) | Mixture of Gaussians 2 | com.sap.cv.opencv.vidanalysis.mog2Subtractor | Mixture of Gaussians 2 background subtractor. | Beta |
|
SAP Leonardo MLF | modelRepoClient | com.sap.ml.leonardo.modelRepoClient | Perform the OAuth2 authentication using oauthClientId and oauthClientSecret on oauthTokenUrl and sends the request to the server. |
|
|
ML Utils | Model Consumer | com.sap.ml.model.consumer | Consume a model in the model repository. | Beta |
|
ML Utils | Model Producer | com.sap.ml.model.producer | Push a model to the model repository. | Beta |
|
Computer Vision (Python OpenCV) | Motion JPG Stream | com.sap.cv.opencv.mediaio.mjpgStream | Stream the received video (frame by frame) to a distant host. | Beta |
|
Connectivity | Move File | com.sap.storage.move2 | Used to move (rename) files in a file service. |
|
|
Deprecated Operators | Move File | com.sap.storage.move | Move files in a file service. | Deprecated | Move File (com.sap.storage.move2) |
Multiplexer | Multiplexer |
|
Map multiple input ports to one or more output ports. |
|
|
Connectivity | NATS Consumer | com.sap.nats.consumer | Consume messages from NATS and forwards them to the output port. |
|
|
Connectivity | NATS Producer | com.sap.nats.producer | Receive a message from the input port and publishes it into NATS. |
|
|
Connectivity (via Flowagent) | OData Query Consumer | com.sap.dh.sdi.odata.table.consumer | Use datahub-flowagent for execution. |
|
|
Connectivity | OpenAPI Client | com.sap.openapi.client | Invoke services described in a swagger/openAPI document. |
|
|
Connectivity | OpenAPI Server | com.sap.openapi.server | Provide services described in swagger/openAPI or unspecified http services in vflow. |
|
|
Connectivity (via Flowagent) | Oracle SQL Consumer | com.sap.dh.ds.oracle.sql.consumer | Use datahub-flowagent for execution. |
|
|
Connectivity (via Flowagent) | Oracle Table Consumer | com.sap.dh.ds.oracle.table.consumer | Use datahub-flowagent for execution. |
|
|
ML Predictive Analytics | PA Automated | com.sap.ml.pa.automatedAnalytics | Apply the PA Automed Analytics product for prediction of values. |
|
|
Computer Vision (Python OpenCV) | Past Object Information | com.sap.cv.trackcv.core.pastObjectsInfo | Resend received objects. | Beta |
|
Data Workflows | Pipeline | com.sap.dh.vflowpipeline | Execute an SAP Data Hub Pipeline in an SAP Data Hub system. |
|
|
Processing | Process Executor | com.sap.system.processExecutor | Start a process and provide given contiguous streams to it. |
|
|
Computer Vision (Python OpenCV) | Pyramid Downsampling | com.sap.cv.opencv.imgproc.filter.pyrDown | Perform the pyramid downscaling of the image. | Beta |
|
Computer Vision (Python OpenCV) | Pyramid Upsampling | com.sap.cv.opencv.imgproc.filter.pyrUp | Perform pyramid upscaling of the image. | Beta |
|
Computer Vision (Python OpenCV) | Py2 Data Generator | com.sap.util.datageneratorpy2 | Generate random sample data every 500ms. | Beta |
|
Computer Vision (Python OpenCV) | Py3 Data Generator | com.sap.util.datageneratorpy3 | Generate random sample data every 500ms. | Beta |
|
Computer Vision (Python OpenCV) | Python2Operator | com.sap.system.python2Operator | Define a script which offers some convenience functions offered by the API object. | Beta |
|
Computer Vision (Python OpenCV) | Python3 Operator | com.sap.system.python3Operator | Define a script which offers some convenience functions offered by the API object. | Beta |
|
Computer Vision (Python OpenCV) | Py2 Type to Blob | com.sap.util.python2TypeToBlob | Serialize any python2 data received in its input port and send the result to the output port. | Beta |
|
Computer Vision (Python OpenCV) | Py3 Type to Blob | com.sap.util.python3TypeToBlob | Serialize any python3 data received in its input port and send the result to the output port. | Beta |
|
Computer Vision (Python OpenCV) | Py2 Type to String | com.sap.util.python2TypeToString | Convert any python2 data received in its input to string by feeding it into the standard python unicode(.) function. | Beta |
|
Computer Vision (Python OpenCV) | Py3 Type to String | com.sap.util.python3TypeToString | Convert any python3 data received in its input to string by feeding it into the standard python str(.) function. | Beta |
|
Connectivity | Read File | com.sap.storage.read | Read a file or periodically poll a directory for its contents in a storage service. |
|
|
Processing | R Client | com.sap.system.rClient | Run Microsoft R code defined by the user in the RServer. |
|
|
Connectivity | Receive Email | com.sap.email.receive | Receive emails. |
|
|
Computer Vision (Python OpenCV) | Recognize by Distance | com.sap.cv.trackcv.recognize.byDistance | Recognize the objects detected in the previous frame in the current frame by its distance shift. | Beta |
|
Connectivity | Remove File | com.sap.storage.remove2 | Remove files in a storage service. |
|
|
Deprecated Operators | Remove File | com.sap.storage.remove | Remove files in a storage service. | Deprecated | Remove File (com.sap.storage.remove2) |
Utilities | ResponseCallbackInjector | com.sap.util.responsecallbackinjector | Inject a response callback into the incoming message so that when its callback is invoked, the response message is emitted from this operator. |
|
|
Utilities | ResponseCallbackInvoker | com.sap.util.responsecallbackinvoker | Invoke the response callback included in the incoming message. |
|
|
Utilities | ResponseInterceptor | com.sap.util.responseinterceptor | Intercept a response message and deliver it to the initiator of a request response invocation. |
|
|
Deprecated Operators | S3 Consumer | com.sap.storage.s3.consumer | Access an S3 instance to read a file or periodically poll a directory for its contents. | Deprecated Operators | Read File (com.sap.storage.read) operator configured with “service”: “s3”. |
Deprecated Operators | S3 Producer | com.sap.storage.s3.producer | Write files to S3. | Deprecated Operators | Write File (com.sap.storage.write) operator configured with “service”: “s3”. |
Connectivity (via Flowagent) | e179ef15d5e148b5aa05469252ff5d16.html | com.sap.dh.ds.businesssuite.odp.consumer | Use datahub-flowagent for execution. |
|
|
Connectivity (via Flowagent) | ee997fd41065469c8624835280750c68.html | com.sap.dh.ds.businesssuite.table.consumer | Use datahub-flowagent for execution. |
|
|
Data Workflows | SAP BW Process Chain | com.sap.dh.bwprocesschain | Use datahub-flowagent for execution. |
|
|
Data Workflows | SAP Data Services Job | com.sap.dh.dsjob | Execute an SAP Data Services Job in a remote system. |
|
|
Connectivity | SAP HANA Client | com.sap.hana.client2 | Execute SQL statements and inserts CSV or JSON data into an SAP HANA instance. |
|
|
Deprecated Operators | SAP HANA Client | com.sap.hana.client | Executes SQL statements and insertions into an SAP HANA instance. | Deprecated | SAP HANA Client (com.sap.hana.client2) |
Data Workflows | SAP HANA Flowgraph | com.sap.dh.hanaflowgraph | Execute an SAP HANA flowgraph in an SAP HANA system. |
|
|
Data Workflow | Notification | com.sap.dh.notification | Use to send emails. |
|
|
Connectivity | SAP HANA Monitor | com.sap.hana.monitor2 | Create a trigger on a given table and for each row inserted, it saves a copy on a temporary table and polls the temp table for those new rows. |
|
|
Deprecated Operators | SAP HANA Monitor | com.sap.hana.monitor | Create a trigger on a given table and for each row inserted, it saves a copy on a temporary table and polls the temp table for those new rows. | Deprecated | SAP HANA Monitor (com.sap.hana.monitor2) |
Connectivity | Send Email | com.sap.email.send | Used to send emails. |
|
|
ML Examples | Sentiment Analyzer | com.sap.ml.nlp.sentimentAnalyser | Perform a sentiment analysis and a subjectivity analysis. | Beta |
|
Deprecated Operators | Sentiment Analyzer | experimental.ml.nlp.sentimentAnalyser | Perform a sentiment analysis and a subjectivity analysis. | Deprecated | Sentiment Analyzer (com.sap.ml.nlp.sentimentAnalyser |
Computer Vision (Python OpenCV) | Shape Segmentation | com.sap.cv.trackcv.segment.shapeSegmentation | Find the overlapping objects and estimates the best possible position based on the foreground mask. | Beta |
|
SAP Leonardo MLF | Similarity Scorer | Spark | Prepare a request message for the Leonardo Machine Learning Foundation (Leonardo MLF) service: Similarity Scorer |
|
|
|
Spark Job Server Client | com.sap.spark.jobServerClient | Schedule a specified Spark job on the Spark job server when it is started and stops the job when the operator is terminated. |
|
|
Spark | Spark Submit | com.sap.spark.submit | A wrapper for spark-submit. |
|
|
Managed Hadoop | Submit Hadoop Job | com.sap.hadoop.submitJob | Submit jobs to Hadoop clusters provided by different cloud providers |
|
|
Processing | Stdin/out Port Muxer | com.sap.system.process.stdmuxer | Map multiple input ports to stdin of a process and multiplexes the output of stdout to multiple output ports. |
|
|
Converter | StreamToString Converter | com.sap.util.streamToStringConverter | Parse a contiguous stream and outputs strings that are separated by platform-dependent line delimiters. |
|
|
Computer Vision (Python OpenCV) | Stream Viewer | com.sap.cv.util.streamViewer | Display an mjpg webstream. | Beta |
|
Converter | StringToStream Converter | com.sap.util.stringToStreamConverter | Convert incoming messages of type 'string' to a contiguous stream. |
|
|
SAP Vora | SAP Vora Avro Ingestor | com.sap.vora.avroingestor | Ingest data into SAP Vora based on the incoming Avro or other text messages in CSV and JSON. |
|
|
SAP Vora | SAP Vora Client | com.sap.vora.client2 | Run statements on the SAP Vora Transaction Coordinator. |
|
|
Deprecated Operators | SAP Vora Client | com.sap.vora.client | Works as a client for the SAP Vora Transaction Coordinator, and lets you run statements on it. | Deprecated | SAP Vora Client (com.sap.vora.client2) |
Deprecated Operators | SAP Vora HDFSLoader | com.sap.vora.hdfsLoader | Load data into SAP Vora. | Deprecated | SAP Vora Loader (com.sap.vora.voraLoader) |
SAP Vora | SAP Vora Ingestor | com.sap.vora.ingestor | Ingest data into SAP Vora based on incoming records messages. |
|
|
Deprecated Operators | SAP Vora Inserter | com.sap.vora.inserter | This operator works as a client for the SAP Vora Transaction Coordinator, and lets you insert data into it. | Deprecated | SAP Vora Avro Ingestor (com.sap.vora.avroingestor) |
SAP Vora | SAP Vora Loader | com.sap.vora.voraLoader | Load data into SAP Vora. |
|
|
Utilities | Terminal | com.sap.util.terminal | Represents a terminal window in the browser. |
|
|
SAP Vora | Text Analysis | com.sap.textanalysis.taconnector | Connect to a text analysis server using an external connector binary. |
|
|
ML TensorFlow | TF Classify Image | com.sap.ml.tensorflow.classifyImgContent | Run tensorflow code that applies the inception neuronal network model (trained on ImageNet 2012 Challenge data set) to recognize the generic content of a picture. | Beta |
|
ML TensorFlow | TF Evaluate MNIST | com.sap.ml.tensorflow.evaluateMnistImage | Run tensorflow code that applies a previously trained model (loaded from disk) to an image message stream. | Beta |
|
ML TensorFlow | TF Generate MNIST | com.sap.ml.tensorflow.generateMnistImages | Run tensorflow code that generates MNIST images to check a previously trained model (loaded from disk). | Beta |
|
ML TensorFlow | TF Train MNIST Data | com.sap.ml.tensorflow.trainMnist | Run tensorflow code that trains a simple neuronal network model to recognize numbers from a handwriting image. | Beta |
|
SAP Leonardo MLF | Topic Detector | com.sap.ml.leonardo.topicDetector | Prepare a request message for the Leonardo Machine Learning Foundation (Leonardo MLF) service: Topic Detection. |
|
|
Converter | ToBlob Converter | com.sap.util.toBlobConverter | Convert the input into a byte array. |
|
|
Converter | ToMessage Converter | com.sap.util.toMessageConverter | Convert the input to a Pipeline Modeler message. |
|
|
Converter | ToNumber Converter | com.sap.util.toNumberConverter | Convert types int64, uint64, float64 and string into other numeric types. |
|
|
Converter | ToString Converter | com.sap.util.toStringConverter | Convert the input to a string. |
|
|
SAP Leonardo MLF | trainingClient | com.sap.ml.leonardo.trainingClient | Perform the OAuth2 authentication using oauthClientId and oauthClientecret on oauthTokenUrl and sends the request to the server. |
|
|
SAP Leonardo MLF | Translator | com.sap.ml.leonardo.translator | The generic client for the Leonardo Machine Learning Foundation (Leonardo MLF) services. |
|
|
ML Examples | Tweet Stream | com.sap.social.tweetStream | Receive a stream of tweets filtered by some key words specified in the configuration using the Twitter Streaming API. | Beta |
|
Deprecated Operators | Tweet Stream | experimental.util.tweetStream | Receive a stream of tweets filtered by some key words specified in the configuration using the Twitter Streaming API. | Deprecated | Tweet Stream (com.sap.social.tweetStream) |
ML Utils | UI for Image Recognition | com.sap.ml.util.imgClassifyUI | Display an mjpg webstream together with the streamed string data from the input port in1. | Beta |
|
Data Quality | Validation Rule | com.sap.dh.dq.validationRule | Create rules and route records that pass through the 'pass' output port. |
|
|
Computer Vision (Python OpenCV) | Video Player | com.sap.cv.opencv.mediaio.videoPlayer | Calculate the distance to the closest zero pixel for each pixel. | Beta |
|
Connectivity | WAMP Consumer | com.sap.wamp.consumer | Access records from WAMP (Web Application Messaging Protocol). |
|
|
Connectivity | WAMP Producer | com.sap.wamp.producer | Write files to WAMP (Web Application Messaging Protocol). |
|
|
Deprecated Operators | WASB Consumer | com.sap.storage.wasb.consumer | Connect to the Windows Azure Storage Blob (WASB) and read files or binaries stored in the cloud. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “wasb”. |
Deprecated Operators | WASB Producer | com.sap.storage.wasb.producer | Connect to the Windows Azure Storage Blob (WASB) and write files or binaries in the cloud. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “wasb”. |
Deprecated Operators | WebHDFS Consumer | com.sap.storage.webhdfs.consumer | Access a WebHDFS instance to read a file or periodically poll a directory for its contents. | Deprecated | Read File (com.sap.storage.read) operator configured with “service”: “webhdfs”. |
Deprecated Operators | WebHDFS Producer | com.sap.storage.webhdfs.producer | Write files to WebHDFS. | Deprecated | Write File (com.sap.storage.write) operator configured with “service”: “webhdfs”. |
Utilities | Wiretap | com.sap.util.wiretap | Wiretap a connection between two operators in a vflow graph and display the traffic to the browser window or to an external websocket client that connects to this operator. |
|
|
Data Workflows | Workflow Merge (AND) | com.sap.dh.logical.AND | Control the flow of execution in a data workflow. |
|
|
Data Workflows | Workflow Merge (OR) | com.sap.dh.logical.OR | Control the flow of execution in a data workflow. |
|
|
Data Workflows | Workflow Split | com.sap.dh.split | Duplicate an input message into two output messages. |
|
|
Data Workflows | Workflow Terminator | com.sap.dh.terminator | Shut down the data workflow execution. |
|
|
Data Workflows | Workflow Trigger | com.sap.dh.trigger | Send a start message, which you can use to start a data workflow. |
|
|