Skip to main content
Version: 1.x

Join

Filter plugin : Join

Description

Joining a streaming Dataset/DataFrame with a static Dataset/DataFrame.

Options

nametyperequireddefault value
source_fieldstringnoraw_message
table_namestringyes-
source_field [string]

Source field, default is raw_message.

table_name [string]

Static Dataset/DataFrame name.

Examples

input {
fakestream {
content = ["Hello World,seatunnel"]
rate = 1
}

mysql {
url = "jdbc:mysql://localhost:3306/info"
table = "project_info"
table_name = "access_log"
user = "username"
password = "password"
}
}

filter {
split {
fields = ["msg", "project"]
delimiter = ","
}

join {
table_name = "user_info"
source_field = "project"
}
}