Modeling Guide for SAP Data Hub

Flowagent File Producer

The Flowagent File Producer operator allows to consume flowagent based consumer operators. Flowagent based operator uses output string.flowagent.config, which can be connected to this operator.

Supported services are:
  • Local File System

  • Amazon S3

  • Azure Data Lake

  • Google Cloud Storage

  • HDFS

  • Windows Azura Storage Blob

Configuration Parameters

Parameter

Type

Description

Format string

Output file format.

Default: "CSV"

Path

string

A formatted string describing the output path and file name.

Default: "/vrep/.csv"

Only applies when storage type is local

Remote file name

string

File name to be saved on cloud storage.

Default: ".csv"

Only applies when storage type is cloud storage.

Storage type

string

The file service to operate. Additional parameters may depend on the selected service.

Default: "local"

CSV Properties

Column delimiter

char

The field separator.

Default: ","

Row delimiter

string

Indicates which type of row delimiter will be used. The options available are: LF (Unix), CRLF (Windows), or user defined.

Default: Unix-NewLine

Text delimiter

char

Indicates which character will be used to delimit columns in a row.

Default "

Text delimiter style

string

Indicates how the text delimiter should be applied. If Always is selected, all columns will have a text delimiter; if Minimal, the text delimiter will be added only when required.

Default: Minimal

Escape character

char

Indicates which escape character will be used to escape the text delimiter.

Default: "

Null value replacement

string

Convert Database null fileds to user specified format.

Header included

bool

Indicates whether or not each CSV output will have a header as first line.

Default: false

Additional Properties

Compression type string

Compression type used when uploading file into cloud service.

Number of threads

integer

Number of threads used when uploading file into cloud service.

Default: 1

Upload batch size

integer

Batch size in MB used when uploading file into cloud service.

Default: 1

Retry count

integer

Number of retries when uploading file into cloud service.

Default: 1

Input

Input

Type

Description

inConfig

string.flowagent.config

Connection information provided by Flowagent based consumer operators.

Output

Output

Type

Description

outFileName

string

The path to the file to which content is written.

outError

string

Operator error. If mapped, the operator error will be sent to the operator this port is mapped to and the graph will remain running. If not mapped, the graph will terminate with the operator error.