Pipeline

The data pipeline, when executed, can help process the raw data from multiple sources and make it available for different use cases.

This operator has one input port (input) and two output ports (output and error). Use this operator in a graph that uses only other data workflow operators.

Connect the input port to another data workflow operator to trigger its start. On the error output port, the engine writes a message in case of errors when trying to execute the Pipeline. On success, the engine writes a message on the output port. If you want the execution of the graph to proceed, connect the respective output ports to other data workflow operators.

Configuration Parameters (using Connection ID)

Parameter	Type	Description
VFlow Connection	object	Connection ID that references a connection to a remote SAP Data Hub system.
Graph Name	string	Name of the graph to execute Note The value help that the tool provides lists only graph from the local instance (currently used modeler instance) even if you have selected a remote instance.
Running Permanently	string	If set to true, the operator execution checks whether the data pipeline state is in a running state, starts the data pipeline execution if it is not in running, and terminates immediately (status:completed) while the data pipeline remains in the running state. But, if the task was already running with a different task version, then that instance is stopped, and the new task version is started and immediately terminated (status: completed). If set to false, the operator executes the data pipeline once, and the operator execution terminates after the pipeline execution terminates. Remember If you do not provide any value, the modeler uses `false` as the default value.
Retry Interval	string	Time interval in seconds (default 20) to wait until next status update.
Retry Attempts	string	Maximum number of attempts (default 10) to query for a status update.

Configuration Parameters (manual)

If you are manually entering the connection details of the SAP Data Hub system in which you want to execute the pipeline:

Parameter	Type	Description
Host	string	Host name of the VFlow system. For example, `localhost`.
Port	number	Port number. For example, `8090`
Protocol	string	"HTTPS" or "HTTP"
User	string	Name of the user used for the authentication. It is of syntax, `tenant\username`. `tenant` is the tenant to use and `username` the login user name.
Password	string	The password of the user used for the authentication

Input

Input	Type	Description
`input`	string	Accepts a message from a connected data workflow operator.

Output

Output	Type	Description
`output`	string	If the operator executed successfully, this port transports the success message.
`error`	string	Operator error. If the port is connected then the graph will keep running. If it is not connected, the graph will terminate with the operator error.

For more information, see Execute an SAP Data Hub Pipeline