Skip to main content
Version: Next

About Edge Agent

Edge Agent is the operational surface for SeaTunnel Edge Agent — a lightweight collector on edge hosts where source data is only reachable locally (log files, host-local paths, and similar). The agent buffers outbound records in WAL and forwards batches to a running SeaTunnel job through the EdgeSocket line protocol.

Edge Agent is not a replacement for SeaTunnel Engine. Typical topology:

  Edge host                         SeaTunnel Engine cluster
+------------------+ +---------------------------+
| Edge Agent | EdgeSocket | Job with EdgeSocket Source|
| (this module) | -----------> | (ingest + pipeline) |
+------------------+ +---------------------------+

When to use Edge Agent

  • Sources exist only on edge machines (for example /var/log, application log directories).
  • You want a small, long-lived daemon with local durability before network send.
  • The downstream pipeline uses EdgeSocket Source on the engine side.

When not to use Edge Agent

  • Sources are reachable directly from the engine cluster (use connector sources on the engine instead).
  • You need full SeaTunnel transform/sink orchestration on the edge host (deploy engine workers or another runtime there).

Glossary

TermDefinition
WALThe local outbound queue durability mechanism in Edge Agent, used to persist and retry records until the engine returns RECEIVED for a batch.
BEST_EFFORTDelivery behavior in this release: persist to local WAL and retry until RECEIVED; duplicate delivery can occur.
WAL row statesPENDING (ready), SENDING (in-flight), ACKED (engine returned RECEIVED for the batch), DEAD (retry limit exceeded).
Engine response codesACK confirms authentication only. RECEIVED confirms batch ingest and moves a SENDING WAL row to ACKED. Other responses are AUTH_FAILED, REJECTED, RETRY, QUEUE_FULL, and DECRYPT_FAILED.
PhaseDocumentDescription
Try it outQuick StartLocal test → connect to Engine
InstallDownload / Deployment GuidePackage download and production setup
ConfigureInput Configuration / Output ConfigurationScenario-based YAML examples
ReferenceConfiguration ReferenceFull agent.yaml parameter tables
Deep diveArchitecture OverviewDesign, reliability and Engine boundary
Engine sideEdgeSocket SourceEngine-side receive protocol
OperateOperationsStart/stop, logs, troubleshooting