Common Options
Source common parametersâ
- Spark
- Flink
name | type | required | default value |
---|---|---|---|
result_table_name | string | yes | - |
table_name | string | no | - |
result_table_name [string]â
When result_table_name
is not specified, the data processed by this plug-in will not be registered as a data set that can be directly accessed by other plugins, or called a temporary table (table);
When result_table_name
is specified, the data processed by this plug-in will be registered as a data set (dataset) that can be directly accessed by other plug-ins, or called a temporary table (table). The dataset registered here can be directly accessed by other plugins by specifying source_table_name
.
table_name [string]â
[Deprecated since v1.4] The function is the same as result_table_name
, this parameter will be deleted in subsequent Release versions, and result_table_name
parameter is recommended.
name | type | required | default value |
---|---|---|---|
result_table_name | string | no | - |
field_name | string | no | - |
result_table_name [string]â
When result_table_name
is not specified, the data processed by this plugin will not be registered as a data set (dataStream/dataset)
that can be directly accessed by other plugins, or called a temporary table (table)
;
When result_table_name
is specified, the data processed by this plugin will be registered as a data set (dataStream/dataset)
that can be directly accessed by other plugins, or called a temporary table (table)
. The data set (dataStream/dataset)
registered here can be directly accessed by other plugins by specifying source_table_name
.
field_name [string]â
When the data is obtained from the upper-level plug-in, you can specify the name of the obtained field, which is convenient for use in subsequent sql plugins.
Exampleâ
- Spark
- Flink
fake {
result_table_name = "view_table"
}
The result of the data source
fake
will be registered as a temporary table namedview_table
. This temporary table can be used by any Filter or Output plugin by specifyingsource_table_name
.
source {
FakeSourceStream {
result_table_name = "fake"
field_name = "name,age"
}
}
The result of the data source
FakeSourceStream
will be registered as a temporary table namedfake
. This temporary table can be used by anyTransform
orSink
plugin by specifyingsource_table_name
.
field_name
names the two columns of the temporary tablename
andage
respectively.