跳到主要内容
版本:2.3.0-beta

Iceberg

Iceberg source connector

Description

Read data from Iceberg.

提示

Engine Supported and plugin name

  • Spark: Iceberg
  • Flink

Options

nametyperequireddefault value
common-optionsyes-
pathstringyes-
pre_sqlstringyes-
snapshot-idlongno-
as-of-timestamplongno-

Refer to iceberg read options for more configurations.

common-options

Source plugin common parameters, please refer to Source Plugin for details

path

Iceberg table location.

pre_sql

SQL statements queried from iceberg table. Note that the table name is result_table_name configuration

snapshot-id

Snapshot ID of the table snapshot to read

as-of-timestamp

A timestamp in milliseconds; the snapshot used will be the snapshot current at this time.

Example

iceberg {
path = "hdfs://localhost:9000/iceberg/warehouse/db/table"
result_table_name = "my_source"
pre_sql="select * from my_source where dt = '2019-01-01'"
}