Skip to main content
Version: Next

Scenario Recipes

These recipes are best read after your first local job succeeds. Instead of reading every example in order, start with the pipeline shape that is closest to your real source and sink.

The recipes in this section include concrete prerequisites, complete configurations, and expected results so that you can validate each pipeline in your own environment.

Choose A Recipe By Pipeline Goal

GoalStart here
CDC from MySQL into Kafka with metadata headersMySQL CDC to Kafka
CDC from MySQL into Elasticsearch with filtering and field shapingMySQL CDC to Elasticsearch
Batch migration between relational databases with row transformationJDBC to JDBC
JDBC extraction into object storageJDBC to S3
Streaming from Kafka into IcebergKafka to Iceberg
CDC from PostgreSQL into IcebergPostgreSQL CDC to Iceberg
HTTP ingestion into JDBCHTTP to JDBC
CDC from MySQL into DorisMySQL CDC to Doris
File-based loading into StarRocksFile to StarRocks
Multi-table CDC orchestrationMulti-Table CDC

How To Read A Recipe

  1. Confirm the source and sink combination matches your target pipeline.
  2. Compare the env, source, transform, and sink sections with your own job.
  3. Replace only one system at a time when adapting the sample.
  4. If the sample depends on CDC, drivers, or extra plugins, verify those prerequisites before running it.