Flowagent File Producer
The Flowagent File Producer operator allows to consume flowagent based consumer operators. Flowagent based operator uses output string.flowagent.config, which can be connected to this operator.
-
Local File System
-
Amazon S3
-
Azure Data Lake
-
Google Cloud Storage
-
HDFS
-
Windows Azura Storage Blob
Configuration Parameters
Parameter |
Type |
Description |
---|---|---|
Format | string |
Output file format. Default: "CSV" |
Path |
string |
A formatted string describing the output path and file
name.
Default: "/vrep/.csv" Only applies when storage type is local |
Remote file name |
string |
File name to be saved on cloud storage. Default: ".csv" Only applies when storage type is cloud storage. |
Storage type |
string |
The file service to operate. Additional parameters may depend on the selected service. Default: "local" |
CSV Properties |
||
Column delimiter |
char |
The field separator. Default: "," |
Row delimiter |
string |
Indicates which type of row delimiter will be used. The options available are: LF (Unix), CRLF (Windows), or user defined. Default: Unix-NewLine |
Text delimiter |
char |
Indicates which character will be used to delimit columns in a row. Default " |
Text delimiter style |
string |
Indicates how the text delimiter should be applied. If Always is selected, all columns will have a text delimiter; if Minimal, the text delimiter will be added only when required. Default: Minimal |
Escape character |
char |
Indicates which escape character will be used to escape the text delimiter. Default: " |
Null value replacement |
string |
Convert Database null fileds to user specified format. |
Header included |
bool |
Indicates whether or not each CSV output will have a header as first line. Default: false |
Additional Properties |
||
Compression type | string |
Compression type used when uploading file into cloud service. |
Number of threads |
integer |
Number of threads used when uploading file into cloud service. Default: 1 |
Upload batch size |
integer |
Batch size in MB used when uploading file into cloud
service.
Default: 1 |
Retry count |
integer |
Number of retries when uploading file into cloud service. Default: 1 |
Input
Input |
Type |
Description |
---|---|---|
inConfig |
string.flowagent.config |
Connection information provided by Flowagent based consumer operators. |
Output
Output |
Type |
Description |
---|---|---|
outFileName |
string |
The path to the file to which content is written. |
outError |
string |
Operator error. If mapped, the operator error will be sent to the operator this port is mapped to and the graph will remain running. If not mapped, the graph will terminate with the operator error. |