Common Options
Common parameters of source connectors
name | type | required | default value |
---|---|---|---|
result_table_name | string | no | - |
parallelism | int | no | - |
result_table_name [string]
When result_table_name
is not specified, the data processed by this plugin will not be registered as a data set (dataStream/dataset)
that can be directly accessed by other plugins, or called a temporary table (table)
;
When result_table_name
is specified, the data processed by this plugin will be registered as a data set (dataStream/dataset)
that can be directly accessed by other plugins, or called a temporary table (table)
. The data set (dataStream/dataset)
registered here can be directly accessed by other plugins by specifying source_table_name
.
parallelism [int]
When parallelism
is not specified, the parallelism
in env is used by default.
When parallelism is specified, it will override the parallelism in env.
Example
source {
FakeSourceStream {
result_table_name = "fake"
}
}
The result of the data source
FakeSourceStream
will be registered as a temporary table namedfake
. This temporary table can be used by anyTransform
orSink
plugin by specifyingsource_table_name
.