跳到主要内容
版本:2.1.0

Iceberg

Sink plugin: Iceberg [Spark]

Description

Write data to Iceberg.

Options

nametyperequireddefault value
pathstringyes-
saveModestringnoappend
target-file-size-byteslongno-
check-nullabilityboolno-
snapshot-property.custom-keystringno-
fanout-enabledboolno-
check-orderingboolno-

Refer to iceberg write options for more configurations.

path

Iceberg table location.

saveMode

append or overwrite. Only these two modes are supported by iceberg. The default value is append.

target-file-size-bytes

Overrides this table’s write.target-file-size-bytes

check-nullability

Sets the nullable check on fields

snapshot-property.custom-key

Adds an entry with custom-key and corresponding value in the snapshot summary eg: snapshot-property.aaaa="bbbb"

fanout-enabled

Overrides this table’s write.spark.fanout.enabled

check-ordering

Checks if input schema and table schema are same

Example

iceberg {
path = "hdfs://localhost:9000/iceberg/warehouse/db/table"
}