Skip to main content
Version: 2.3.2

Filter

Filter transform plugin

Description

Filter the field.

Options

nametyperequireddefault value
fieldsarrayyes

fields [array]

The list of fields that need to be kept. Fields not in the list will be deleted

common options [string]

Transform plugin common parameters, please refer to Transform Plugin for details

Example

The data read from source is a table like this:

nameagecard
Joy Ding20123
May Ding20123
Kin Dom20123
Joy Dom20123

We want to delete field age, we can add Filter Transform like this

transform {
Filter {
source_table_name = "fake"
result_table_name = "fake1"
fields = [name, card]
}
}

Then the data in result table fake1 will like this

namecard
Joy Ding123
May Ding123
Kin Dom123
Joy Dom123

Changelog

new version

  • Add Filter Transform Connector