Skip to main content
Version: Next

Replace

Replace transform plugin

Description

Examines string value in a given field and replaces substring of the string value that matches the given string literal or regexes with the given replacement.

Options

nametyperequireddefault value
replace_fieldstringyes
patternstringyes-
replacementstringyes-
is_regexbooleannofalse
replace_firstbooleannofalse

replace_field [string]

The field you want to replace

pattern [string]

The old string that will be replaced

replacement [string]

The new string for replace

is_regex [boolean]

Use regex for string match

replace_first [boolean]

Whether replace the first match string. Only used when is_regex = true.

common options [string]

Transform plugin common parameters, please refer to Transform Plugin for details

Example

The data read from source is a table like this:

nameagecard
Joy Ding20123
May Ding20123
Kin Dom20123
Joy Dom20123

We want to replace the char to _ at the name field. Then we can add a Replace Transform like this:

transform {
Replace {
plugin_input = "fake"
plugin_output = "fake1"
replace_field = "name"
pattern = " "
replacement = "_"
is_regex = true
}
}

Then the data in result table fake1 will update to

nameagecard
Joy_Ding20123
May_Ding20123
Kin_Dom20123
Joy_Dom20123

Job Config Example

env {
job.mode = "BATCH"
}

source {
FakeSource {
plugin_output = "fake"
row.num = 100
schema = {
fields {
id = "int"
name = "string"
}
}
}
}

transform {
Replace {
plugin_input = "fake"
plugin_output = "fake1"
replace_field = "name"
pattern = ".+"
replacement = "b"
is_regex = true
}
}

sink {
Console {
plugin_input = "fake1"
}
}

Changelog

new version

  • Add Replace Transform Connector