Replace
Replace transform plugin
Description
Examines string value in a given field and replaces substring of the string value that matches the given string literal or regexes with the given replacement.
Options
name | type | required | default value |
---|---|---|---|
replace_field | string | yes | |
pattern | string | yes | - |
replacement | string | yes | - |
is_regex | boolean | no | false |
replace_first | boolean | no | false |
replace_field [string]
The field you want to replace
pattern [string]
The old string that will be replaced
replacement [string]
The new string for replace
is_regex [boolean]
Use regex for string match
replace_first [boolean]
Whether replace the first match string. Only used when is_regex = true
.
common options [string]
Transform plugin common parameters, please refer to Transform Plugin for details
Example
The data read from source is a table like this:
name | age | card |
---|---|---|
Joy Ding | 20 | 123 |
May Ding | 20 | 123 |
Kin Dom | 20 | 123 |
Joy Dom | 20 | 123 |
We want to replace the char
to _
at the name
field. Then we can add a Replace
Transform like this:
transform {
Replace {
plugin_input = "fake"
plugin_output = "fake1"
replace_field = "name"
pattern = " "
replacement = "_"
is_regex = true
}
}
Then the data in result table fake1
will update to
name | age | card |
---|---|---|
Joy_Ding | 20 | 123 |
May_Ding | 20 | 123 |
Kin_Dom | 20 | 123 |
Joy_Dom | 20 | 123 |
Job Config Example
env {
job.mode = "BATCH"
}
source {
FakeSource {
plugin_output = "fake"
row.num = 100
schema = {
fields {
id = "int"
name = "string"
}
}
}
}
transform {
Replace {
plugin_input = "fake"
plugin_output = "fake1"
replace_field = "name"
pattern = ".+"
replacement = "b"
is_regex = true
}
}
sink {
Console {
plugin_input = "fake1"
}
}
Changelog
new version
- Add Replace Transform Connector