Skip to main content
Version: Next

Edge Agent Quick Start

Two validation paths:

PathEngine requiredPurpose
Console local testNoInstall, collect, local WAL without Engine
Production setup (with Engine)YesAgent → Engine job

For production hardening, see Deployment Guide and Operations.

Step 1: Install Edge Agent on the edge host

Follow Download And Build Edge Agent Package, then:

export EDGE_AGENT_HOME=/opt/apache-seatunnel-edge-agent-<version>
cd "$EDGE_AGENT_HOME"

The install root contains bin/, config/, and starter/.

Console local test

Prerequisites

  • Java 8 or 11 on the edge host, with JAVA_HOME set.
  • No SeaTunnel Engine and no EdgeSocket connectivity required.
  • Writable install root (default WAL data/wal.db, logs, edge-agent.id).

Configure the agent

Edit $EDGE_AGENT_HOME/config/agent.yaml:

input:
paths:
- "/tmp/edge-agent-quickstart.log"

output:
type: console

When output.type is omitted, the default is also console. You may omit queue (default sqlite-path: data/wal.db). See Output Configuration — console.

Create the sample log and append a line:

echo '{"event":"hello","ts":1}' >> /tmp/edge-agent-quickstart.log

Start and verify

sh bin/seatunnel-edge-agent.sh start
sh bin/seatunnel-edge-agent.sh status

Confirm BOOTSTRAP_READY in log/edge-agent.log, then append another line:

echo '{"event":"world","ts":2}' >> /tmp/edge-agent-quickstart.log

Search log/edge-agent.log for EDGE_CONSOLE_OUTPUT (console writes via the app logger, not edge-agent.out). You should see serialized payloads.

No EDGE_CONSOLE_OUTPUT?
  1. Confirm files in input.paths exist and are readable (ls -l /tmp/edge-agent-quickstart.log).
  2. Append a new line after BOOTSTRAP_READY (tail mode does not re-read old content on first open).
  3. Check log/edge-agent.log for input or WAL errors.

The agent still creates edge-agent.id and the WAL persistence files under data/ (wal.db, wal.db-wal, wal.db-shm), even without Engine. See Configuration — WAL persistence files.

Stop

sh bin/seatunnel-edge-agent.sh stop

To continue with Engine, see Production setup.

Production setup

Prerequisites

  • Step 1 completed.
  • Network: the edge host can reach the Engine EdgeSocket port (example 9876).
  • SeaTunnel Engine: cluster or local Zeta where you can submit a job.
  • Writable install root.

Start an Engine job

Submit a job with EdgeSocket Source (HOCON):

env {
parallelism = 1
job.mode = "STREAMING"
}

source {
EdgeSocket {
port = 9876
token = "quick-start-secret"
}
}

sink {
Console {}
}
caution

Note the listen port and token. The agent output.endpoint must be reachable from the edge machine (typically the Engine node IP or load balancer, not 0.0.0.0).

Save as edgesocket-quickstart.conf and submit:

./bin/seatunnel.sh --config ./config/edgesocket-quickstart.conf

Configure the agent

Edit config/agent.yaml:

input:
paths:
- "/tmp/edge-agent-quickstart.log"

output:
type: transport
endpoint: "<engine-host>:9876"
auth-type: token
token: "quick-start-secret"
packet-mode: RAW

Replace <engine-host> with the Engine node IP or hostname. If you ran the console test, you can reuse the same log file.

echo '{"event":"hello-engine","ts":1}' >> /tmp/edge-agent-quickstart.log

Start and verify

sh bin/seatunnel-edge-agent.sh start

Confirm BOOTSTRAP_READY in log/edge-agent.log. After appending log lines, the Engine Console sink should print data after RECEIVED. For REJECTED, see Operations — Common issues.

Use this minimal verification chain:

  1. Agent log contains BOOTSTRAP_READY.
  2. Agent log does not contain AUTH_FAILED / REJECTED.
  3. Engine job log shows incoming EdgeSocket batches and Console sink output.
  4. If auth fails: AUTH_FAILED usually means output.token vs Engine token mismatch; REJECTED usually means duplicate collector policy conflict.

Stop

sh bin/seatunnel-edge-agent.sh stop

Keep edge-agent.id and the data/ directory (default wal.db plus -wal/-shm) when migrating or continuing tests. See FAQ.

Next steps

Once you have completed the quick start, continue with the Deployment Guide for production setup, or see the Configuration Reference for full parameters. For a complete documentation map, visit About Edge Agent.