Kafka
Sink plugin: Kafka [Spark]
Description
Write Rows to a Kafka topic.
Options
name | type | required | default value | engine |
---|---|---|---|---|
producer.bootstrap.servers | string | yes | - | all streaming |
topic | string | yes | - | all streaming |
producer.* | string | no | - | all streaming |
producer.bootstrap.servers [string]
Kafka Brokers List
topic [string]
Kafka Topic
producer [string]
In addition to the above parameters that must be specified for the producer client, you can also specify multiple kafka's producer parameters described in producerconfigs
The way to specify parameters is to use the prefix "producer" before the parameter. For example, request.timeout.ms
is specified as: producer.request.timeout.ms = 60000
.If you do not specify these parameters, it will be set the default values according to Kafka documentation
Examples
kafka {
topic = "seatunnel"
producer.bootstrap.servers = "localhost:9092"
}