Kafka Producer

The Kafka Producer operator allows applications to send records/messages to topics on a Kafka cluster. It supports Kafka versions 0.8 and later.

Configuration Parameters

Configuration Parameters
Parameter	Type	Description
brokers	string	Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092"
key	string	The key to be included in the record. Default: ""
manualPartitioning	bool	Specifies whether the partition is configured manually. Default: "false"
numRetryAttempts	int	The number of attempts to retry. Default: 0
partition	int	The partition count. Default: 0
retryPeriodInMs	int	The retry waiting time in milliseconds. Default: 0
topic	string	The category name to which records are subscribed. Default: "test_topic" mandatory
async	bool	Whether the producer should work on asynchronous mode. Default: false
maxMessageBytes	int	The maximum permitted size of a message. Default: 1000000
maxMessageBatch	int	The maximum number of messages the producer will send in a single broker request. Default: 0
insecureSkipVerify	bool	Controls whether a client verifies the server's certificate chain and host name. Default: false
useTLS	bool	Flag that enables using TLS/SSL authentication. Default: false
brokers	string	Mandatory. The node in the cluster. Default: "broker1:9092,broker2:9092"
key	string	The key to be included in the record. Default: ""
manualPartitioning	bool	Specifies whether the partition is configured manually. Default: "false"
numRetryAttempts	int	The number of attempts to retry. Default: 0
partition	int	The partition count. Default: 0
retryPeriodInMs	int	The retry waiting time in milliseconds. Default: 0
topic	string	The category name to which records are subscribed. Default: "test_topic" mandatory
async	bool	Whether the producer should work on asynchronous mode. Default: false
maxMessageBytes	int	The maximum permitted size of a message. Default: 1000000
maxMessageBatch	int	The maximum number of messages the producer will send in a single broker request. Default: 0
insecureSkipVerify	bool	Controls whether a client verifies the server's certificate chain and host name. Default: false
useTLS	bool	Flag that enables using TLS/SSL authentication. Default: false
tlsCAFile	string	Certificate authority file path. Default: ""
authenticate	bool	Flag that enables SASL authentication. Default: false
username	string	Username if using kafka's SASL/PLAIN authentication. Default: ""
password	string	Password if using kafka's SASL/PLAIN authentication. Default: ""

Connection Parameters
Parameter	Type	Description
connectionType	string	"Regular" will get connection information from each property, while "connection management" will use connection property for connection information. Default: regular
connection	object	Holds information about connection information for the services.
configurationType	string	Which type of connection information will be used: Manual (user input) or retrieved by the Connection Management Service. Default: ""
connectionID	string	The ID of the connection information to retrieve from the Connection Management Service. Default: ""
connectionProperties	object	All the connection properties for manual input: broker (type string) Mandatory. The node in the cluster. Default: broker1:9092,broker2:9092 topic (type string) Mandatory. The category name to which records are subscribed. Default: test_topic insecureSkipVerify (type bool) Controls whether a client verifies the server's certificate chain and host name. Default: false tlsCAFile (type string) Certificate authority file path. Default: "" username (type string) Username if using Kafka's SASL/PLAIN authentication. Default: "" password (type string) Password if using Kafka's SASL/PLAIN authentication. Default: ""

Input

Input	Type	Description
`message`	message	The stream of records to publish.

Output

Output	Type	Description
`markoffsets`	message	Message containing the offset and set of headers.