RowKindExtractor
RowKindExtractor transform plugin
Descriptionâ
transform cdc row to append only row that contains the cdc RowKind.
Example:
CDC row: -D 1, test1, test2
transformed Row: +I 1,test1,test2,DELETE
Optionsâ
name | type | required | default value |
---|---|---|---|
custom_field_name | string | yes | row_kind |
transform_type | enum | yes | SHORT |
custom_field_name [string]â
Custom field name of the RowKind field
transform_type [enum]â
the RowKind field value formatting , the option can be SHORT
or FULL
SHORT
: +I, -U , +U, -D
FULL
: INSERT, UPDATE_BEFORE, UPDATE_AFTER , DELETE
Examplesâ
env {
parallelism = 1
job.mode = "BATCH"
}
source {
FakeSource {
schema = {
fields {
pk_id = bigint
name = string
score = int
}
primaryKey {
name = "pk_id"
columnNames = [pk_id]
}
}
rows = [
{
kind = INSERT
fields = [1, "A", 100]
},
{
kind = INSERT
fields = [2, "B", 100]
},
{
kind = INSERT
fields = [3, "C", 100]
},
{
kind = INSERT
fields = [4, "D", 100]
},
{
kind = UPDATE_BEFORE
fields = [1, "A", 100]
},
{
kind = UPDATE_AFTER
fields = [1, "F", 100]
}
{
kind = UPDATE_BEFORE
fields = [2, "B", 100]
},
{
kind = UPDATE_AFTER
fields = [2, "G", 100]
},
{
kind = DELETE
fields = [3, "C", 100]
},
{
kind = DELETE
fields = [4, "D", 100]
}
]
}
}
transform {
RowKindExtractor {
custom_field_name = "custom_name"
transform_type = FULL
result_table_name = "trans_result"
}
}
sink {
Console {
source_table_name = "custom_name"
}
}