Skip to main content
Version: 2.1.0

Hudi

Sink plugin: Hudi [Spark]

Description​

Write Rows to a Hudi.

Options​

nametyperequireddefault valueengine
hoodie.base.pathstringyes-Spark
hoodie.table.namestringyes-Spark
save_modestringnoappendSpark

More hudi Configurations

hoodie.base.path [string]​

Base path on lake storage, under which all the table data is stored. Always prefix it explicitly with the storage scheme (e.g hdfs://, s3:// etc). Hudi stores all the main meta-data about commits, savepoints, cleaning audit logs etc in .hoodie directory under this base path directory.

hoodie.table.name [string]​

Table name that will be used for registering with Hive. Needs to be same across runs.

Examples​

hudi {
hoodie.base.path = "hdfs://"
hoodie.table.name = "seatunnel_hudi"
}