Deployment
Preparation
Before starting to download SeaTunnel, you need to ensure that you have installed the following software required by SeaTunnel:
- Install Java (Java 8 or 11, and other versions higher than Java 8 can theoretically work) and set
JAVA_HOME.
Download SeaTunnel Release Package
Download The Binary Package
Visit the SeaTunnel Download Page to download the latest binary package seatunnel-<version>-bin.tar.gz.
Or you can also download it through the terminal:
export version="2.3.13"
wget "https://archive.apache.org/dist/seatunnel/${version}/apache-seatunnel-${version}-bin.tar.gz"
tar -xzvf "apache-seatunnel-${version}-bin.tar.gz"
Download The Connector Plugins
Starting from version 2.2.0-beta, the binary package no longer provides connector dependencies by default. Therefore, the first time you use it, you need to run the following command to install the connectors (Alternatively, you can manually download the connectors from the Apache Maven Repository and move them to the connectors/ directory. For versions before 2.3.5, place them in the connectors/seatunnel directory):
sh bin/install-plugin.sh
If you need a specific connector version, taking 2.3.13 as an example, you need to execute the following command:
sh bin/install-plugin.sh 2.3.13
Typically, you do not need all the connector plugins. You can specify the required plugins by configuring config/plugin_config. For example, if you want the sample application to work properly, you will need the connector-console and connector-fake plugins. You can modify the plugin_config configuration file as follows:
--seatunnel-connectors--
connector-fake
connector-console
--end--
You can find all supported connectors and the corresponding plugin_config configuration names under ${SEATUNNEL_HOME}/connectors/plugins-mapping.properties.
If you want to install connector plugins by manually downloading connectors, you only need to download the related connector plugins and place them in the ${SEATUNNEL_HOME}/connectors/ directory.
This local deployment guide assumes that you use the official SeaTunnel 2.3.13 binary release package. If you need to validate source changes, debug SeaTunnel source code, or prepare a custom distribution, see Set Up Develop Environment.
Run SeaTunnel
Now you have downloaded the SeaTunnel binary package and the connector plugins. Next, you can choose different engine option to run synchronization tasks.
If you use Flink to run the synchronization task, there is no need to deploy the SeaTunnel Engine service cluster. You can refer to Quick Start With Flink to run your synchronization task.
If you use Spark to run the synchronization task, there is no need to deploy the SeaTunnel Engine service cluster. You can refer to Quick Start With Spark to run your synchronization task.
If you use the builtin SeaTunnel Engine (Zeta) to run tasks, you need to deploy the SeaTunnel Engine service first. Refer to Quick Start With SeaTunnel Engine.