Skip to main content
Version: 2.3.2

Replace

Replace transform plugin

Description​

Examines string value in a given field and replaces substring of the string value that matches the given string literal or regexes with the given replacement.

Options​

nametyperequireddefault value
replace_fieldstringyes
patternstringyes-
replacementstringyes-
is_regexbooleannofalse
replace_firstbooleannofalse

replace_field [string]​

The field you want to replace

pattern [string]​

The old string that will be replaced

replacement [string]​

The new string for replace

is_regex [boolean]​

Use regex for string match

replace_first [boolean]​

Whether replace the first match string. Only used when is_regex = true.

common options [string]​

Transform plugin common parameters, please refer to Transform Plugin for details

Example​

The data read from source is a table like this:

nameagecard
Joy Ding20123
May Ding20123
Kin Dom20123
Joy Dom20123

We want to replace the char to _ at the name field. Then we can add a Replace Transform like this:

transform {
Replace {
source_table_name = "fake"
result_table_name = "fake1"
replace_field = "name"
pattern = " "
replacement = "_"
is_regex = true
}
}

Then the data in result table fake1 will update to

nameagecard
Joy_Ding20123
May_Ding20123
Kin_Dom20123
Joy_Dom20123

Job Config Example​

env {
job.mode = "BATCH"
}

source {
FakeSource {
result_table_name = "fake"
row.num = 100
schema = {
fields {
id = "int"
name = "string"
}
}
}
}

transform {
Replace {
source_table_name = "fake"
result_table_name = "fake1"
replace_field = "name"
pattern = ".+"
replacement = "b"
is_regex = true
}
}

sink {
Console {
source_table_name = "fake1"
}
}

Changelog​

new version​

  • Add Replace Transform Connector