Skip to main content
Version: 2.1.1

Iceberg

Description​

Read data from Iceberg.

tip

Engine Supported and plugin name

  • Spark: Iceberg
  • Flink

Options​

nametyperequireddefault value
common-optionsyes-
pathstringyes-
pre_sqlstringyes-
snapshot-idlongno-
as-of-timestamplongno-

Refer to iceberg read options for more configurations.

common-options​

Source plugin common parameters, please refer to Source Plugin for details

path​

Iceberg table location.

pre_sql​

SQL statements queried from iceberg table. Note that the table name is result_table_name configuration

snapshot-id​

Snapshot ID of the table snapshot to read

as-of-timestamp​

A timestamp in milliseconds; the snapshot used will be the snapshot current at this time.

Example​

iceberg {
path = "hdfs://localhost:9000/iceberg/warehouse/db/table"
result_table_name = "my_source"
pre_sql="select * from my_source where dt = '2019-01-01'"
}