Skip to main content
Version: Next

RowKindExtractor

RowKindExtractor transform plugin

Description​

transform cdc row to append only row that contains the cdc RowKind.
Example:
CDC row: -D 1, test1, test2
transformed Row: +I 1,test1,test2,DELETE

Options​

nametyperequireddefault value
custom_field_namestringyesrow_kind
transform_typeenumyesSHORT

custom_field_name [string]​

Custom field name of the RowKind field

transform_type [enum]​

the RowKind field value formatting , the option can be SHORT or FULL

SHORT : +I, -U , +U, -D FULL : INSERT, UPDATE_BEFORE, UPDATE_AFTER , DELETE

Examples​


env {
parallelism = 1
job.mode = "BATCH"
}

source {
FakeSource {
schema = {
fields {
pk_id = bigint
name = string
score = int
}
primaryKey {
name = "pk_id"
columnNames = [pk_id]
}
}
rows = [
{
kind = INSERT
fields = [1, "A", 100]
},
{
kind = INSERT
fields = [2, "B", 100]
},
{
kind = INSERT
fields = [3, "C", 100]
},
{
kind = INSERT
fields = [4, "D", 100]
},
{
kind = UPDATE_BEFORE
fields = [1, "A", 100]
},
{
kind = UPDATE_AFTER
fields = [1, "F", 100]
}
{
kind = UPDATE_BEFORE
fields = [2, "B", 100]
},
{
kind = UPDATE_AFTER
fields = [2, "G", 100]
},
{
kind = DELETE
fields = [3, "C", 100]
},
{
kind = DELETE
fields = [4, "D", 100]
}
]
}
}

transform {
RowKindExtractor {
custom_field_name = "custom_name"
transform_type = FULL
result_table_name = "trans_result"
}
}

sink {
Console {
source_table_name = "custom_name"
}
}