Kafka Producer
The Kafka Producer operator allows applications to send records/messages to topics on a Kafka cluster. It supports Kafka versions 0.8 and later.
Configuration Parameters
Parameter |
Type |
Description |
---|---|---|
brokers |
string |
Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092" |
key |
string |
The key to be included in the record. Default: "" |
manualPartitioning |
bool |
Specifies whether the partition is configured manually. Default: "false" |
numRetryAttempts |
int |
The number of attempts to retry. Default: 0 |
partition |
int |
The partition count. Default: 0 |
retryPeriodInMs |
int |
The retry waiting time in milliseconds. Default: 0 |
topic |
string |
The category name to which records are subscribed. Default: "test_topic" mandatory |
async |
bool |
Whether the producer should work on asynchronous mode. Default: false |
maxMessageBytes |
int |
The maximum permitted size of a message. Default: 1000000 |
maxMessageBatch |
int |
The maximum number of messages the producer will send in a single broker request. Default: 0 |
insecureSkipVerify |
bool |
Controls whether a client verifies the server's certificate chain and host name. Default: false |
useTLS |
bool |
Flag that enables using TLS/SSL authentication. Default: false |
brokers |
string |
Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092" |
key |
string |
The key to be included in the record. Default: "" |
manualPartitioning |
bool |
Specifies whether the partition is configured manually. Default: "false" |
numRetryAttempts |
int |
The number of attempts to retry. Default: 0 |
partition |
int |
The partition count. Default: 0 |
retryPeriodInMs |
int |
The retry waiting time in milliseconds. Default: 0 |
topic |
string |
The category name to which records are subscribed. Default: "test_topic" mandatory |
async |
bool |
Whether the producer should work on asynchronous mode. Default: false |
maxMessageBytes |
int |
The maximum permitted size of a message. Default: 1000000 |
maxMessageBatch |
int |
The maximum number of messages the producer will send in a single broker request. Default: 0 |
insecureSkipVerify |
bool |
Controls whether a client verifies the server's certificate chain and host name. Default: false |
useTLS |
bool |
Flag that enables using TLS/SSL authentication. Default: false |
tlsCAFile |
string |
Certificate authority file path. Default: "" |
authenticate |
bool |
Flag that enables SASL authentication. Default: false |
username |
string |
Username if using kafka's SASL/PLAIN authentication. Default: "" |
password |
string |
Password if using kafka's SASL/PLAIN authentication. Default: "" |
Input
Input |
Type |
Description |
---|---|---|
message |
message |
The stream of records to publish. |
Output
None