Modeling Guide

Kafka Producer

The Kafka Producer operator allows applications to send records/messages to topics on a Kafka cluster. It supports Kafka versions 0.8 and later.

Configuration Parameters

Parameter

Type

Description

brokers

string

Mandatory. The node in the cluster.

Default: "broker1:9092,broker2:9092"

key

string

The key to be included in the record.

Default: ""

manualPartitioning

bool

Specifies whether the partition is configured manually.

Default: "false"

numRetryAttempts

int

The number of attempts to retry.

Default: 0

partition

int

The partition count.

Default: 0

retryPeriodInMs

int

The retry waiting time in milliseconds.

Default: 0

topic

string

The category name to which records are subscribed.

Default: "test_topic"

mandatory

async

bool

Whether the producer should work on asynchronous mode.

Default: false

maxMessageBytes

int

The maximum permitted size of a message.

Default: 1000000

maxMessageBatch

int

The maximum number of messages the producer will send in a single broker request.

Default: 0

insecureSkipVerify

bool

Controls whether a client verifies the server's certificate chain and host name.

Default: false

useTLS

bool

Flag that enables using TLS/SSL authentication.

Default: false

brokers

string

Mandatory. The node in the cluster.

Default: "broker1:9092,broker2:9092"

key

string

The key to be included in the record.

Default: ""

manualPartitioning

bool

Specifies whether the partition is configured manually.

Default: "false"

numRetryAttempts

int

The number of attempts to retry.

Default: 0

partition

int

The partition count.

Default: 0

retryPeriodInMs

int

The retry waiting time in milliseconds.

Default: 0

topic

string

The category name to which records are subscribed.

Default: "test_topic"

mandatory

async

bool

Whether the producer should work on asynchronous mode.

Default: false

maxMessageBytes

int

The maximum permitted size of a message.

Default: 1000000

maxMessageBatch

int

The maximum number of messages the producer will send in a single broker request.

Default: 0

insecureSkipVerify

bool

Controls whether a client verifies the server's certificate chain and host name.

Default: false

useTLS

bool

Flag that enables using TLS/SSL authentication.

Default: false

tlsCAFile

string

Certificate authority file path.

Default: ""

authenticate

bool

Flag that enables SASL authentication.

Default: false

username

string

Username if using kafka's SASL/PLAIN authentication.

Default: ""

password

string

Password if using kafka's SASL/PLAIN authentication.

Default: ""

Input

Input

Type

Description

message

message

The stream of records to publish.

Output

None