Scenario Recipes
These recipes are best read after your first local job succeeds. Instead of reading every example in order, start with the pipeline shape that is closest to your real source and sink.
The recipes in this section include concrete prerequisites, complete configurations, and expected results so that you can validate each pipeline in your own environment.
Choose A Recipe By Pipeline Goal
| Goal | Start here |
|---|---|
| CDC from MySQL into Kafka with metadata headers | MySQL CDC to Kafka |
| CDC from MySQL into Elasticsearch with filtering and field shaping | MySQL CDC to Elasticsearch |
| Batch migration between relational databases with row transformation | JDBC to JDBC |
| JDBC extraction into object storage | JDBC to S3 |
| Streaming from Kafka into Iceberg | Kafka to Iceberg |
| CDC from PostgreSQL into Iceberg | PostgreSQL CDC to Iceberg |
| HTTP ingestion into JDBC | HTTP to JDBC |
| CDC from MySQL into Doris | MySQL CDC to Doris |
| File-based loading into StarRocks | File to StarRocks |
| Multi-table CDC orchestration | Multi-Table CDC |
How To Read A Recipe
- Confirm the source and sink combination matches your target pipeline.
- Compare the
env,source,transform, andsinksections with your own job. - Replace only one system at a time when adapting the sample.
- If the sample depends on CDC, drivers, or extra plugins, verify those prerequisites before running it.