Druid

Druid sink connector

Description

Write data to Druid

Key features

• exactly-once
• support multiple table write

Data Type Mapping

SeaTunnel Data Type	Druid Data Type
TINYINT	LONG
SMALLINT	LONG
INT	LONG
BIGINT	LONG
FLOAT	FLOAT
DOUBLE	DOUBLE
DECIMAL	DOUBLE
STRING	STRING
BOOLEAN	STRING
TIMESTAMP	STRING

Options

name	type	required	default value
coordinatorUrl	string	yes	-
datasource	string	yes	-
batchSize	int	no	10000
common-options		no	-

coordinatorUrl [string]

The coordinatorUrl host and port of Druid, example: "myHost:8888"

datasource [string]

The datasource name you want to write, example: "seatunnel"

batchSize [int]

The number of rows flushed to Druid per batch. Default value is 1024.

common options

Sink plugin common parameters, please refer to Sink Common Options for details

Example

Simple example:

sink {
  Druid {
    coordinatorUrl = "testHost:8888"
    datasource = "seatunnel"
  }
}

Use placeholders get upstream table metadata example:

sink {
  Druid {
    coordinatorUrl = "testHost:8888"
    datasource = "${table_name}_test"
  }
}

Changelog

Change Log

Change	Commit	Version
[Improve] restruct connector common options (#8634)	https://github.com/apache/seatunnel/commit/f3499a6eeb	2.3.10
[improve] update Druid connector config option (#8594)	https://github.com/apache/seatunnel/commit/07a2288a2e	2.3.10
[Improve][dist]add shade check rule (#8136)	https://github.com/apache/seatunnel/commit/51ef800016	2.3.9
[Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786)	https://github.com/apache/seatunnel/commit/6b7c53d03c	2.3.9
[Improve][Connector] Add multi-table sink option check (#7360)	https://github.com/apache/seatunnel/commit/2489f6446b	2.3.7
[Feature][Core] Support using upstream table placeholders in sink options and auto replacement (#7131)	https://github.com/apache/seatunnel/commit/c4ca74122c	2.3.6
[Feature][Druid]Support multi table for druid sink (#7023)	https://github.com/apache/seatunnel/commit/476d492165	2.3.6
[Feature][Connector] Add druid sink connector (#6346)	https://github.com/apache/seatunnel/commit/d7fa9afdfe	2.3.6