Modeling Guide

Avro PostAssembler

The Avro PostAssembler operator allows you to create Avro, CSV, or JSON messages from the Vora messages containing record objects. This operator can be used as the inverse operator of the PreIngestor operator to reconstruct the original messages, the equivalent messages in another format or in different structures.

The schema must be provided in this operator's configuration or included in the message itself under attribute "avro.schema". This schema is used to assemble the input data into the target output message.

Configuration Parameters

Parameter

Type

Description

defaultAvroSchema

string

The Avro schema to be used to generate the output message.

Default: ""

format

string

The output message format. The accepted values are "avro", "csv", or "json".

Default: "avro"

csvComma

rune

The delimiter character code for the CSV format. For example, 44 for ','; 59 for ';'; 124 for '|'.

Default: ","

csvHeaderIncluded

bool

The input CSV message contains the header line.

Default: false

Input

Input

Type

Description

in

message

Accept messages containing record objects in the body.

Output

Output

Type

Description

out

message

Messages whose body content are formatted as Avro, CSV, or JSON messages.