Repartition

Filter plugin : Repartition

• Author: InterestingLab
• Homepage: https://interestinglab.github.io/seatunnel-docs
• Version: 1.0.0

Description

Adjust the number of underlying spark rdd partition to increase or decrease degree of parallelism. This filter is mainly to adjust the data processing performance.

Options

name	type	required	default value
num_partitions	number	yes	-

num_partitions [number]

Target partition number.

Examples

repartition {
    num_partitions = 8
}