Kafka Producer
The Kafka Producer operator allows applications to send records/messages to topics on a Kafka cluster. It supports Kafka versions 0.8 and later.
Configuration Parameters
|
Parameter |
Type |
Description |
|---|---|---|
|
brokers |
string |
Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092" |
|
key |
string |
The key to be included in the record. Default: "" |
|
manualPartitioning |
bool |
Specifies whether the partition is configured manually. Default: "false" |
|
numRetryAttempts |
int |
The number of attempts to retry. Default: 0 |
|
partition |
int |
The partition count. Default: 0 |
|
retryPeriodInMs |
int |
The retry waiting time in milliseconds. Default: 0 |
|
topic |
string |
The category name to which records are subscribed. Default: "test_topic" mandatory |
|
async |
bool |
Whether the producer should work on asynchronous mode. Default: false |
|
maxMessageBytes |
int |
The maximum permitted size of a message. Default: 1000000 |
|
maxMessageBatch |
int |
The maximum number of messages the producer will send in a single broker request. Default: 0 |
|
insecureSkipVerify |
bool |
Controls whether a client verifies the server's certificate chain and host name. Default: false |
|
useTLS |
bool |
Flag that enables using TLS/SSL authentication. Default: false |
|
brokers |
string |
Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092" |
|
key |
string |
The key to be included in the record. Default: "" |
|
manualPartitioning |
bool |
Specifies whether the partition is configured manually. Default: "false" |
|
numRetryAttempts |
int |
The number of attempts to retry. Default: 0 |
|
partition |
int |
The partition count. Default: 0 |
|
retryPeriodInMs |
int |
The retry waiting time in milliseconds. Default: 0 |
|
topic |
string |
The category name to which records are subscribed. Default: "test_topic" mandatory |
|
async |
bool |
Whether the producer should work on asynchronous mode. Default: false |
|
maxMessageBytes |
int |
The maximum permitted size of a message. Default: 1000000 |
|
maxMessageBatch |
int |
The maximum number of messages the producer will send in a single broker request. Default: 0 |
|
insecureSkipVerify |
bool |
Controls whether a client verifies the server's certificate chain and host name. Default: false |
|
useTLS |
bool |
Flag that enables using TLS/SSL authentication. Default: false |
|
tlsCAFile |
string |
Certificate authority file path. Default: "" |
|
authenticate |
bool |
Flag that enables SASL authentication. Default: false |
|
username |
string |
Username if using kafka's SASL/PLAIN authentication. Default: "" |
|
password |
string |
Password if using kafka's SASL/PLAIN authentication. Default: "" |
Input
|
Input |
Type |
Description |
|---|---|---|
|
message |
message |
The stream of records to publish. |
Output
None
