Skip to main content
Version: 2.2.0-beta

Iceberg

Iceberg sink connector

Description​

Write data to Iceberg.

tip

Engine Supported and plugin name

  • Spark: Iceberg
  • Flink

Options​

nametyperequireddefault value
pathstringyes-
saveModestringnoappend
target-file-size-byteslongno-
check-nullabilityboolno-
snapshot-property.custom-keystringno-
fanout-enabledboolno-
check-orderingboolno-

Refer to iceberg write options for more configurations.

path​

Iceberg table location.

saveMode​

append or overwrite. Only these two modes are supported by iceberg. The default value is append.

target-file-size-bytes​

Overrides this table’s write.target-file-size-bytes

check-nullability​

Sets the nullable check on fields

snapshot-property.custom-key​

Adds an entry with custom-key and corresponding value in the snapshot summary eg: snapshot-property.aaaa="bbbb"

fanout-enabled​

Overrides this table’s write.spark.fanout.enabled

check-ordering​

Checks if input schema and table schema are same

Example​

iceberg {
path = "hdfs://localhost:9000/iceberg/warehouse/db/table"
}