JDBC
描述
JDBC Sink 通过数据库厂商提供的 JDBC 驱动写入数据。它支持批处理和流处理、并行写入、自动生成 SQL 或自定义 SQL、多表写入、CDC 事件,以及基于 XA 事务的可选精确一次语义。
第一次配置 JDBC Sink 时,请先阅读选择写入模式和快速入门,再按需查阅后面的完整参数说明。
DB2 upsert 的 NULL 处理
生成的 DB2 upsert 会在传入字段发生变化时更新匹配行,包括 NULL 变为非 NULL 和非 NULL 变为 NULL。相等值(包括两端均为 NULL)不会触发多余的匹配更新。
SAP HANA 版本兼容
生成的 upsert 通过不带目标表别名的 SQL 兼容 SAP HANA 2.00.033 等较早版本,无需额外配置。全字段均为键的表仍会插入未匹配行,并保持匹配行不变。
MySQL 时间值
MySQL DATETIME 映射为 SeaTunnel TIMESTAMP(LocalDateTime)。MySQL JDBC Sink 直接绑定本地日期和时间字段,即使 Worker JVM 与 JDBC 连接使用不同的时区,也会保留目标列支持的小数秒精度。MySQL TIMESTAMP 映射为 TIMESTAMP_TZ,仍按时间点处理。
从受 #13024 影响的版本升级时,请移除为补偿 DATETIME 写入偏移而手动添加的小时偏移。已经写入的数据不会自动修复;修正或重新加载之前,请先与原始数据进行比较。
使用依赖
先安装 connector-jdbc 插件:
--seatunnel-connectors--
connector-jdbc
--end--
cd "${SEATUNNEL_HOME}"
sh bin/install-plugin.sh
不同数据库厂商的 JDBC 驱动具有不同的许可证和再分发条款,而且驱动版本还必须同时兼容目标数据库和 Java 运行时,因此 SeaTunnel 不会统一内置所有 JDBC 驱动。请自行下载合适的驱动,并在启动任务前把 JAR 放入对应引擎的目录。
Spark 和 Flink 引擎
把 JDBC 驱动放到每个 SeaTunnel 执行节点的 ${SEATUNNEL_HOME}/plugins/Jdbc/lib/。
Zeta 引擎
把 JDBC 驱动放到每个 SeaTunnel 节点的 ${SEATUNNEL_HOME}/lib/,然后重启受影响的 SeaTunnel 进程,让驱动进入类路径。
常用驱动类名和下载地址见驱动参考。
CockroachDB
使用 driver = "org.postgresql.Driver"、PostgreSQL JDBC URL,并显式配置 dialect = "CockroachDB"。作业启动前必须创建目标表;本方言不提供用于自动建表或 schema save mode 的 Catalog。
Jdbc {
url = "jdbc:postgresql://cockroachdb:26257/app?sslmode=verify-full"
driver = "org.postgresql.Driver"
dialect = "CockroachDB"
username = "seatunnel"
password = ${DB_PASSWORD}
database = "app"
table = "public.orders"
generate_sink_sql = true
primary_keys = ["id"]
}
请为驱动配置集群的受信任根证书。生产环境不要禁用 TLS。
生成的 upsert 使用 CockroachDB 原生 INSERT ... ON CONFLICT (keys) DO UPDATE,保留 primary_keys 指定的冲突目标,也支持匹配的非主键唯一约束。不使用简写 UPSERT,因为它始终选择数据库实际主键,可能改变非主键唯一键配置的语义。更新仅修改输入中的非键列,未输入的列保留已有值;仅包含键的记录使用 DO NOTHING。重复写入相同的非空键值不会新增记录;可为空的唯一键包含 NULL 时不会产生冲突,可能新增记录。配置的键必须匹配目标表的主键或唯一约束。
首期支持对现有表进行插入、upsert、更新和删除,不包含 CockroachDB Catalog、自动 DDL/模式演变、XA exactly-once 或新的事务重试策略。模式变更事件会在刷新缓冲数据或执行 DDL 前被拒绝。仅支持 data_save_mode = APPEND_DATA;schema_save_mode 可以保持默认值或设为 IGNORE,但这两种配置都不会创建或检查目标表。其他 save mode 会被拒绝,而不会被静默忽略。table_options 会被拒绝,避免误接受 PostgreSQL 专有设置。现有 PostgreSQL 作业和 URL 匹配规则不变。
选择写入模式
JDBC Sink 有两种互斥的写入模式。请先确定模式,再配置其余参数。
| 使用场景 | 必需配置 | 行为 |
|---|---|---|
| 由 SeaTunnel 生成 SQL | generate_sink_sql = true、database,通常还要配置 table | 推荐大多数任务使用。SeaTunnel 可以根据上游 schema 和 RowKind 生成 INSERT、数据库原生 UPSERT、UPDATE 和 DELETE;可以使用 SaveMode 和自动建表。 |
| 用户提供 SQL | query = "INSERT ... VALUES (?, ...)" | 适合必须完全控制目标 SQL 的场景。? 参数按照上游字段顺序绑定;此模式不会执行 SaveMode 相关配置。 |
不要同时配置两种模式。generate_sink_sql 默认是 false,因此没有显式设置 generate_sink_sql = true 的任务必须提供 query。
使用自动生成 SQL 时,如果目标端需要 Upsert、Update 或 Delete,请配置 primary_keys。未配置时,SeaTunnel 会尝试从上游 Catalog 元数据继承主键,再尝试第一个唯一键;仍然没有可用键时,会退化为普通 INSERT。
快速入门:PostgreSQL
下面使用自动生成 SQL 写入一张已经创建的 PostgreSQL 表。这份配置和预期结果已经在 PostgreSQL 14 中验证,包括示例数据写入和最终数据库值。
按照使用依赖的说明放置兼容版本的 PostgreSQL JDBC 驱动。
创建目标表:
CREATE TABLE public.orders (
id BIGINT PRIMARY KEY,
customer_name VARCHAR(100) NOT NULL,
amount DECIMAL(10, 2) NOT NULL
);
- 把下面的任务保存为
${SEATUNNEL_HOME}/config/jdbc-sink-quick-start.conf,并按实际环境替换主机、账号和数据库名。
env {
parallelism = 1
job.mode = "BATCH"
}
source {
FakeSource {
row.num = 3
schema = {
fields {
id = bigint
customer_name = string
amount = "decimal(10, 2)"
}
}
rows = [
{ kind = INSERT, fields = [1, "Alice", 120.50] }
{ kind = INSERT, fields = [2, "Bob", 80.00] }
{ kind = INSERT, fields = [3, "Carol", 42.00] }
]
}
}
sink {
Jdbc {
url = "jdbc:postgresql://localhost:5432/sales"
driver = "org.postgresql.Driver"
username = "postgres"
password = "change_me"
generate_sink_sql = true
database = "sales"
table = "public.orders"
primary_keys = ["id"]
schema_save_mode = "ERROR_WHEN_SCHEMA_NOT_EXIST"
data_save_mode = "APPEND_DATA"
}
}
- 运行任务:
cd "${SEATUNNEL_HOME}"
./bin/seatunnel.sh --config ./config/jdbc-sink-quick-start.conf -m local
- 验证结果:
SELECT id, customer_name, amount
FROM public.orders
ORDER BY id;
预期结果:
| id | customer_name | amount |
|---|---|---|
| 1 | Alice | 120.50 |
| 2 | Bob | 80.00 |
| 3 | Carol | 42.00 |
如果任务在写入前失败,请先检查故障排查。
连接 MariaDB 时,请使用 MariaDB Connector/J 以及匹配的 URL 和驱动:
url = "jdbc:mariadb://localhost:3306/database"
driver = "org.mariadb.jdbc.Driver"
不要使用 MySQL Connector/J 和 jdbc:mysql: URL 连接 MariaDB。该配置会选择 MySQL 方言,可能将 MariaDB 服务端版本判定为不支持的 MySQL 版本。
主要特性
Exactly-once 依赖 XA 事务,因此数据库和 JDBC 驱动都必须支持 XA。具体要求见 Exactly-once 前置条件。
Options
连接器的 OptionRule 始终要求提供 url、driver、schema_save_mode 和 data_save_mode。两个 SaveMode 参数有默认值,任务配置通常可以省略。其他参数会随写入模式变为必填:
- 自动生成 SQL:设置
generate_sink_sql = true并配置database;除非目标表由上游元数据动态提供,否则还要配置table。 - 自定义 SQL:保持
generate_sink_sql = false并配置query。 - Exactly-once:设置
is_exactly_once = true、xa_data_source_class_name和max_retries = 0。
| 名称 | 类型 | 是否必须 | 默认值 |
|---|---|---|---|
| url | String | 是 | - |
| driver | String | 是 | - |
| username | String | 否 | - |
| password | String | 否 | - |
| query | String | 否 | - |
| compatible_mode | String | 否 | - |
| dialect | String | 否 | - |
| database | String | 否 | - |
| table | String | 否 | - |
| schema | String | 否 | - |
| tablePrefix | String | 否 | - |
| tableSuffix | String | 否 | - |
| primary_keys | Array | 否 | - |
| connection_check_timeout_sec | Int | 否 | 30 |
| connect_timeout_ms | Int | 否 | 86400000 |
| socket_timeout_ms | Int | 否 | 86400000 |
| max_retries | Int | 否 | 0 |
| batch_size | Int | 否 | 1000 |
| batch_interval_ms | Long | 否 | 0 |
| is_exactly_once | Boolean | 否 | false |
| generate_sink_sql | Boolean | 否 | false |
| xa_data_source_class_name | String | 否 | - |
| max_commit_attempts | Int | 否 | 3 |
| transaction_timeout_sec | Int | 否 | -1 |
| auto_commit | Boolean | 否 | true |
| field_ide | Enum | 否 | - |
| properties | Map | 否 | - |
| decimal_type_narrowing | Boolean | 否 | true |
| int_type_narrowing | Boolean | 否 | true |
| handle_blob_as_string | Boolean | 否 | false |
| common-options | 否 | - | |
| schema_save_mode | Enum | 否 | CREATE_SCHEMA_WHEN_NOT_EXIST |
| data_save_mode | Enum | 否 | APPEND_DATA |
| custom_sql | String | 否 | - |
| enable_upsert | Boolean | 否 | true |
| is_primary_key_updated | Boolean | 否 | true |
| support_upsert_by_insert_only | Boolean | 否 | false |
| table_options | Map | 否 | - |
| use_copy_statement | Boolean | 否 | false |
| oracle_insert_mode | Enum | 否 | CONVENTIONAL |
| create_index | Boolean | 否 | true |
| use_kerberos | Boolean | 否 | false |
| kerberos_principal | String | 否 | - |
| kerberos_keytab_path | String | 否 | - |
| krb5_path | String | 否 | /etc/krb5.conf |
| access_key_id | String | 否 | |
| secret_access_key | String | 否 | |
| region | String | 否 |
driver [string]
用于连接远程数据源的 jdbc 类名,如果使用MySQL,则值为com.mysql.cj.jdbc.Driver
username [string]
数据库登录用户名。username 是规范参数名;未设置 username 时,仍兼容旧参数 user。
password [string]
密码
url [string]
JDBC 连接的 URL。参考案例:jdbc:postgresql://localhost/test
query [string]
用于写入每条上游数据的参数化 SQL,例如 INSERT INTO target(id, name) VALUES (?, ?)。SeaTunnel 按上游字段顺序绑定 ? 参数。该参数只用于自定义 SQL 模式,不能与 generate_sink_sql = true 同时使用。
当前限制:当 sink 配置了 query(自定义写入 SQL)时,JDBC sink 不会执行 save mode 处理。此模式下 schema_save_mode、data_save_mode、custom_sql 不生效。如需使用 save mode,请改用 generate_sink_sql = true 并配置 database、table。
compatible_mode [string]
数据库的兼容模式,当数据库支持多种兼容模式时需要。
例如,使用 OceanBase 数据库时,需要将其设置为 'mysql' 或 'oracle' 。使用StarRocks时,需要将其设置为starrocks。
Postgres 9.5及以下版本,请设置为 postgresLow 来支持 CDC
dialect [string]
指定的方言,如果不存在,仍然按照url获取,优先级高于url。例如,当使用 starrocks 时,你需要将其值设置为 starrocks,同理,当使用mysql时,你需要将其值设置为mysql。
如果 SeaTunnel 不支持某种方言,它将使用默认方言 GenericDialect。请确保您提供的驱动程序支持您想要连接的数据库。
示例可选
| 方言名称 | ||
|---|---|---|
| Greenplum | DB2 | Dameng |
| Gbase8a | HIVE | KingBase |
| MySQL | StarRocks | Oracle |
| Phoenix | Postgres | Redshift |
| SapHana | Snowflake | Sqlite |
| SqlServer | Tablestore | Teradata |
| Vertica | OceanBase | XUGU |
| IRIS | Inceptor | Highgo |
| OpenGauss | Presto | Dsql |
| DuckDB | YashanDB | CockroachDB |
database [string]
自动生成 SQL 模式下的目标 database 或 catalog。generate_sink_sql = true 时必填,不能与 query 同时使用。
table [string]
自动生成 SQL 模式下的目标表,不能与 query 同时使用。
table 参数可以填入目标表名,这个名字最终会被用作创建或写入的表名,并且支持变量(${table_name},${schema_name})。
替换规则如下:${schema_name} 将替换传递给目标端的 SCHEMA 名称,${table_name} 将替换传递给目标端的表名。
mysql 接收器示例:
- test${schema_name}${table_name}_test
- sink_sinktable
- ss_${table_name}
pgsql (Oracle Sqlserver ...) 接收器示例:
- ${schema_name}.${table_name}_test
- dbo.tt_${table_name}_sink
- public.sink_table
Tip: 如果目标数据库有 SCHEMA 的概念,则表参数必须写成 xxx.xxx
schema [string]
目标 schema,适用于支持 schema 的数据库(PostgreSQL、Oracle、SQL Server、Redshift、Kingbase、OpenGauss、达梦、虚谷等)。配置后优先级高于 table 中携带的 schema 部分(schema.table),同时用于生成的 SQL 以及由 schema_save_mode / data_save_mode 驱动的 catalog 操作。
tablePrefix [string]
已过时。请改用带表占位符的 table 参数。例如,使用 table = "prefix_${table_name}_suffix" 替代 tablePrefix 和 tableSuffix。
tableSuffix [string]
已过时。请改用带表占位符的 table 参数。例如,使用 table = "prefix_${table_name}_suffix" 替代 tablePrefix 和 tableSuffix。
primary_keys [array]
生成数据库原生 UPSERT、UPDATE 和 DELETE 语句时使用的目标键列。未配置时,SeaTunnel 会尝试从上游 catalog 元数据继承主键或第一组唯一键;仍无可用键时,自动生成的 SQL 退回普通 INSERT。
connection_check_timeout_sec [int]
用于验证数据库连接的有效性时等待数据库操作完成所需的时间,单位是秒
connect_timeout_ms [int]
建立 JDBC 连接时的连接超时时间,单位毫秒。默认值为 24 小时。设置为 0 表示不超时。
socket_timeout_ms [int]
JDBC 连接建立后的 socket 读取超时时间,单位毫秒。默认值为 24 小时。设置为 0 表示不超时。
max_retries [int]
JDBC executeBatch 失败后的重试次数。Exactly-once 模式要求设置为 0,重试失败的 XA batch 可能破坏事务保证。
非 XA 手动提交连接在 Connection.commit() 阶段失败时,一律按系统错误处理,即使 SQLState 属于 22 或 23 类也不能作为行级错误丢弃。失败的 writer 不能通过再次提交来假定事务已恢复。开启 checkpoint 时,该共享事务中已 flush 的数据会被标记为不安全,同队列的其他 writer 也会拒绝提交,直到作业恢复。
batch_size [int]
每个 batch 最多缓存的行数。达到 batch_size、checkpoint 准备提交或 writer 关闭时会执行 flush。增大该值可能提高吞吐,但会占用更多内存,并增加故障后需要重试的数据量。
batch_interval_ms [long]
刷新间隔(毫秒)。当设置值大于 0 时,若距上次 flush 的时间超过该间隔,下一次 writeRecord 调用将同步触发 flush,即使尚未达到 batch_size。默认值为 0(禁用)。此为写入触发的时间检查,而非后台定时器——若无新记录到达(空闲分区),不会触发基于时间的 flush;缓冲数据将在下一次 prepareCommit(checkpoint)或 close 时刷出。注意:当 auto_commit = false 时,已 flush 的数据在下次 commit(如 checkpoint)之前对其他事务不可见。
is_exactly_once [boolean]
是否通过 XA 事务启用 exactly-once。开启时必须配置 xa_data_source_class_name、max_retries = 0,且数据库和驱动都要支持 XA;该模式不支持定时 flush。
generate_sink_sql [boolean]
为 true 时,根据上游 schema 和 RowKind 自动生成写入语句。需要配置 database,通常还要配置 table,并且不能配置 query。默认值为 false,此时必须配置 query。
xa_data_source_class_name [string]
指数据库驱动的 XA 数据源的类名。以 MySQL 为例,其类名为 com.mysql.cj.jdbc.MysqlXADataSource。了解其他数据库的数据源类名,可以参考文档的附录部分
max_commit_attempts [int]
事务提交失败的最大重试次数
在 exactly-once 的 XA 模式下,这个重试预算会在单次 aggregated-commit 或 restore 调用内消耗完。 恢复时,SeaTunnel 会从 XA recovery scan 中第一个仍然处于 prepared 状态的 checkpoint XID 开始, 严格回放其后的事务后缀。位于该边界之前、且在 recovery scan 中缺失的 XID,只有在后缀严格提交 成功之后才会被视为已经解析完成。如果 recovery scan 中一个 checkpoint XID 都不存在,SeaTunnel 会把整个批次视为已经完成,不再重复回放。SeaTunnel 会在同步重试轮次之间固定等待 1 秒,让瞬时 的资源管理器不可用可以真正消耗这份重试预算,而不是在瞬间烧完所有尝试次数。只有在第一个 recovered checkpoint XID 之后又出现缺 口时,恢复才会直接 fail-closed,而不是把结果推断成已经成功提交。
transaction_timeout_sec [int]
在事务开启后的超时时间,默认值为-1(即永不超时)。请注意,设置超时时间可能会影响到精确一次(exactly-once)的语义
auto_commit [boolean]
默认启用自动事务提交
对于 Oracle JDBC Sink,即使配置 auto_commit = true,SeaTunnel 写入时也会在内部使用手动提交。
这样可以保证失败批次的原子性,避免原始数据错误被后续的主键重复错误掩盖。
关闭 checkpoint 时,每次由 batch_size / batch_interval_ms 触发并成功的批量写入会立即提交事务,避免已刷出的数据一直停留在同一个未结束的事务中直到 writer 关闭;开启 checkpoint 时,提交边界仍然是 checkpoint。
field_ide [Enum]
字段 field_ide 用于在从 source 同步到 sink 时,确定字段是否需要转换为大写或小写。'ORIGINAL' 表示不需要转换,'UPPERCASE'
表示转换为大写,'LOWERCASE' 表示转换为小写
properties
附加连接配置参数,当属性和URL具有相同参数时,优先级由驱动程序的具体实现确定。例如,在 MySQL 中,属性配置优先于 URL。
decimal_type_narrowing [boolean]
仅在 Oracle catalog 执行建表或读取目标表结构(schema_save_mode)时生效。为 true 时,精度和小数位可以放入整型的 Oracle NUMBER 列会被映射为 INT 或 BIGINT 而不是 DECIMAL。建议与 source 端保持一致,以保证自动建表的字段类型匹配。
int_type_narrowing [boolean]
仅在 MySQL catalog 执行建表或读取目标表结构(schema_save_mode)时生效。为 true 时,MySQL 的 TINYINT(1) 列会被映射为 BOOLEAN;为 false 时保持为 TINYINT。
handle_blob_as_string [boolean]
仅在 Oracle catalog 执行建表或读取目标表结构(schema_save_mode)时生效。为 true 时,Oracle 的 BLOB 列会按 STRING 类型处理,与 JDBC source 的 handle_blob_as_string 选项保持一致。
common options
Sink插件常用参数,请参考 Sink常用选项 了解详情
schema_save_mode [Enum]
在启动同步任务之前,针对目标侧已有的表结构选择不同的处理方案
选项介绍:
RECREATE_SCHEMA:当表不存在时会创建,当表已存在时会删除并重建
CREATE_SCHEMA_WHEN_NOT_EXIST:当表不存在时会创建,当表已存在时则跳过创建
ERROR_WHEN_SCHEMA_NOT_EXIST:当表不存在时将抛出错误
IGNORE :忽略对表的处理
data_save_mode [Enum]
在启动同步任务之前,针对目标侧已存在的数据选择不同的处理方案
选项介绍:
DROP_DATA:保留数据库结构,删除数据
APPEND_DATA:保留数据库结构,保留数据
CUSTOM_PROCESSING:允许用户自定义数据处理方式
ERROR_WHEN_DATA_EXISTS:当有数据时抛出错误
目标表的完整路径指定数据库(database.schema.table)时,DROP_DATA 会连接到该数据库执行 TRUNCATE TABLE。
table_options [Map]
Sink 在自动建表(SaveMode DDL)时附加的表级选项。仅在 schema_save_mode 触发建表时生效,例如 CREATE_SCHEMA_WHEN_NOT_EXIST、RECREATE_SCHEMA;不影响数据写入阶段的 INSERT/UPSERT,也不会对已存在表执行 ALTER TABLE。
当前支持情况:
| 方言 | 是否支持 | 可用 key |
|---|---|---|
| MySQL | 是 | engine、charset、collate |
| TiDB | 是 | engine、charset、collate(通过 MySQL JDBC 协议与 jdbc:mysql:// 连接) |
| OceanBase(MySQL 模式) | 是 | engine、charset、collate |
| PostgreSQL | 是 | tablespace、fillfactor |
| 达梦 Dameng | 是 | tablespace、fillfactor |
| Oracle | 是 | tablespace、pctfree |
| OceanBase(Oracle 模式) | 是 | tablespace、pctfree(compatible_mode=oracle 时走 Oracle 方言 / DDL 路径) |
| Kingbase | 是 | tablespace、fillfactor |
| 其他 JDBC 方言 | 否 | 配置非空 table_options 时任务启动即校验失败 |
非法或不支持的 key 会在 JdbcSinkFactory 的 option 规则阶段提前校验(--check 与作业提交),而非仅在运行时 DDL 阶段失败。
方言说明:
- MySQL:
engine、charset、collate均会写入CREATE TABLE并生效。 - TiDB:通过
jdbc:mysql://与 MySQL JDBC 驱动连接时,与 MySQL 使用相同的 key 白名单与 DDL 拼接方式。charset、collate会生效;engine仅为 MySQL 兼容语法,TiDB 会解析但忽略存储引擎设置。 - OceanBase(MySQL 模式):
jdbc:oceanbase://且非 Oracle 兼容模式时支持上述三个 key。charset、collate须为 OceanBase 当前版本支持的字符集与排序规则(通常为 MySQL 兼容子集,请以目标库SHOW CHARSET/SHOW COLLATION为准);不支持的取值会在执行CREATE TABLE时报错,而非在作业提交阶段校验。 - PostgreSQL:
fillfactor会生成WITH (fillfactor=<n>),取值须为[10, 100]的整数;tablespace会生成TABLESPACE "...",按配置字面量引用(不受fieldIde大小写改写)。空白值,以及tablespace中的非法字符(例如")会在作业提交阶段被拒绝。仅接受上述 curated key(不支持任意WITH参数)。OpenGauss、HighGo 通过 Postgres catalog/dialect 继承同一套校验与 DDL。 - 达梦 Dameng:
fillfactor与tablespace会写入达梦STORAGE (...)子句(FILLFACTOR <n>、ON "<表空间>")。fillfactor取值须为[0, 100]的整数;tablespace按配置字面量引用(不受fieldIde大小写改写)。空白值,以及tablespace中的非法字符(例如")会在作业提交阶段被拒绝。仅接受上述 curated key(不支持透传任意STORAGE参数如INITIAL/NEXT)。表空间须已在目标库存在。 - Oracle / OceanBase(Oracle 模式):
pctfree会生成PCTFREE <n>,取值须为[0, 99]的整数;tablespace会生成TABLESPACE "...",按配置字面量引用(不受fieldIde大小写改写)。空白值,以及tablespace中的非法字符(例如")会在作业提交阶段被拒绝。仅接受上述 curated key(不支持嵌套STORAGE (...)、LOB/分区子句)。目标库中 tablespace 须事先存在。 - Kingbase:
fillfactor会写入WITH (fillfactor=<n>),取值须为[10, 100]的整数(PostgreSQL 兼容);tablespace会写入TABLESPACE "...",按配置字面量引用(不受fieldIde大小写改写)。空白值,以及tablespace中的非法字符(例如")会在作业提交阶段被拒绝。仅接受上述 curated key(不支持透传任意WITH (...)参数)。表空间须已在目标库存在。
SeaTunnel 在提交时会对所有支持 table_options 的方言校验 key 白名单。对 PostgreSQL(以及 OpenGauss / HighGo 同源路径)、达梦与 Kingbase,还会校验空白值与 fillfactor 数值区间。对 Oracle / OceanBase(Oracle 模式),还会校验空白值与 pctfree 数值区间。其他方言(例如 MySQL)在白名单之外不额外校验具体取值是否被目标库支持。
示例(MySQL 自动建表时指定存储引擎与字符集):
sink {
Jdbc {
url = "jdbc:mysql://localhost:3307/mydb"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "password"
database = "mydb"
table = "orders"
generate_sink_sql = true
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
primary_keys = ["id"]
table_options = {
"engine" = "InnoDB"
"charset" = "utf8mb4"
"collate" = "utf8mb4_general_ci"
}
}
}
生成的 DDL 会追加 ENGINE、DEFAULT CHARSET、COLLATE 子句。未在白名单内的 key(如 bucket_num)会在作业提交阶段报错。
示例(PostgreSQL 自动建表时指定 tablespace 与 fillfactor):
sink {
Jdbc {
url = "jdbc:postgresql://localhost:5432/mydb"
driver = "org.postgresql.Driver"
username = "postgres"
password = "password"
database = "mydb"
table = "public.orders"
generate_sink_sql = true
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
primary_keys = ["id"]
table_options = {
"tablespace" = "pg_default"
"fillfactor" = "70"
}
}
}
示例(达梦自动建表时指定表空间与填充比例):
sink {
Jdbc {
url = "jdbc:dm://localhost:5236"
driver = "dm.jdbc.driver.DmDriver"
username = "SYSDBA"
password = "SYSDBA"
database = "DAMENG"
table = "orders"
generate_sink_sql = true
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
primary_keys = ["id"]
table_options = {
"tablespace" = "MAIN"
"fillfactor" = "80"
}
}
}
生成的 DDL 会追加 STORAGE (FILLFACTOR 80, ON "MAIN")。
示例(Oracle 自动建表时指定 tablespace 与 pctfree):
sink {
Jdbc {
url = "jdbc:oracle:thin:@localhost:1521/ORCLPDB1"
driver = "oracle.jdbc.OracleDriver"
username = "scott"
password = "tiger"
database = "SCOTT"
table = "ORDERS"
generate_sink_sql = true
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
primary_keys = ["id"]
table_options = {
"tablespace" = "USERS"
"pctfree" = "10"
}
}
}
示例(Kingbase 自动建表时指定表空间与 fillfactor):
sink {
Jdbc {
url = "jdbc:kingbase8://localhost:54321/test"
driver = "com.kingbase8.Driver"
username = "SYSTEM"
password = "123456"
database = "test"
table = "orders"
generate_sink_sql = true
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
primary_keys = ["id"]
table_options = {
"tablespace" = "pg_default"
"fillfactor" = "70"
}
}
}
生成的 DDL 会追加 WITH (fillfactor=70) 与 TABLESPACE "pg_default"。
custom_sql [String]
当data_save_mode选择CUSTOM_PROCESSING时,需要填写CUSTOM_SQL参数。该参数通常填写一条可以执行的SQL。SQL将在同步任务之前执行
注意:在 sink 的 query 模式下,custom_sql 不会执行。这是 JDBC sink 的当前限制。
enable_upsert [boolean]
启用通过主键更新插入,如果任务没有key重复数据,设置该参数为 false 可以加快数据导入速度
is_primary_key_updated [boolean]
生成 update 语句时是否包含主键字段。除非目标数据库要求更新时跳过主键列,一般保持默认值即可。
support_upsert_by_insert_only [boolean]
是否通过仅 insert 的语句支持 upsert 行为。该参数属于高级兼容选项,默认关闭。
use_copy_statement [boolean]
使用 COPY ${table} FROM STDIN 语句导入数据。仅支持具有 getCopyAPI() 方法连接的驱动程序。例如:Postgresql
驱动程序 org.postgresql.Driver
注意:不支持 MAP、ARRAY、ROW类型
oracle_insert_mode [Enum]
Oracle 插入模式。默认值为 CONVENTIONAL,保持现有 JDBC insert 行为。
设置为 APPEND_VALUES 时,SeaTunnel 会为自动生成的 Oracle insert SQL 添加 APPEND_VALUES hint:
INSERT /*+ APPEND_VALUES */ INTO ...
该选项仅支持 Oracle JDBC Sink 的 insert-only 写入。使用时必须配置 generate_sink_sql = true、auto_commit = true,不能配置自定义 query,不能配置 primary_keys,并且 is_exactly_once = false、support_upsert_by_insert_only = false。Oracle Sink 实际写入时仍会在内部使用手动提交。
create_index [boolean]
自动建表时是否创建索引(包含主键和其他索引)。迁移大表时可关闭该选项以提升写入速度,但迁移完成后需要手动创建索引来保证查询性能。
use_kerberos [boolean]
是否为 JDBC 连接启用 Kerberos 认证。开启后,请根据环境同时配置 kerberos_principal、kerberos_keytab_path 和 krb5_path。
access_key_id [String]
AWS IAM 认证中所需要的access_key_id 。 该参考仅适用于 dialect="dsql"
secret_access_key [String]
AWS IAM 认证中所需要的secret_access_key。 该参考仅适用于 dialect="dsql"
region [String]
Amazon Aurora DSQL 所在的区域。 该参考仅适用于 dialect="dsql"
Exactly-once 前置条件
is_exactly_once = true 时,JDBC Sink 使用 XA 事务。启用前请确认:
- 设置
max_retries = 0,并为已安装的驱动配置正确的xa_data_source_class_name。 - PostgreSQL 必须允许 prepared transaction。把
max_prepared_transactions设置为能够容纳预期并发事务的正数;如果数据库要求,修改后需重启 PostgreSQL。 - MySQL Server 和 Connector/J 的组合必须支持 Sink 使用的 XA 操作。执行 XA recovery 的账号还可能需要
XA_RECOVER_ADMIN权限,请按所用 MySQL 版本的要求配置。 - 不要配置
sink.flush.interval,XA 事务边界由 checkpoint 控制。
对于非 XA 的 MySQL 批量任务,可以尝试在 JDBC URL 中加入 rewriteBatchedStatements=true 提升吞吐;实际效果应结合驱动版本和业务负载验证。
驱动参考
下表仅作为起点;驱动制品和版本应以数据库厂商的兼容矩阵为准。
| 数据源 | driver | url | xa_data_source_class_name | maven |
|---|---|---|---|---|
| MySQL | com.mysql.cj.jdbc.Driver | jdbc:mysql://localhost:3306/test | com.mysql.cj.jdbc.MysqlXADataSource | https://mvnrepository.com/artifact/mysql/mysql-connector-java |
| PostgreSQL | org.postgresql.Driver | jdbc:postgresql://localhost:5432/postgres | org.postgresql.xa.PGXADataSource | https://mvnrepository.com/artifact/org.postgresql/postgresql |
| DM | dm.jdbc.driver.DmDriver | jdbc:dm://localhost:5236 | dm.jdbc.driver.DmdbXADataSource | https://mvnrepository.com/artifact/com.dameng/DmJdbcDriver18 |
| Phoenix | org.apache.phoenix.queryserver.client.Driver | jdbc:phoenix:thin:url=http://localhost:8765;serialization=PROTOBUF | / | https://mvnrepository.com/artifact/com.aliyun.phoenix/ali-phoenix-shaded-thin-client |
| SQL Server | com.microsoft.sqlserver.jdbc.SQLServerDriver | jdbc:sqlserver://localhost:1433 | com.microsoft.sqlserver.jdbc.SQLServerXADataSource | https://mvnrepository.com/artifact/com.microsoft.sqlserver/mssql-jdbc |
| Oracle | oracle.jdbc.OracleDriver | jdbc:oracle:thin:@localhost:1521/xepdb1 | oracle.jdbc.xa.client.OracleXADataSource | https://mvnrepository.com/artifact/com.oracle.database.jdbc/ojdbc8 |
| sqlite | org.sqlite.JDBC | jdbc:sqlite:test.db | / | https://mvnrepository.com/artifact/org.xerial/sqlite-jdbc |
| GBase8a | com.gbase.jdbc.Driver | jdbc:gbase://localhost:5258/test | / | https://cdn.gbase.cn/products/30/p5CiVwXBKQYIUGN8ecHvk/gbase-connector-java-9.5.0.7-build1-bin.jar |
| StarRocks | com.mysql.cj.jdbc.Driver | jdbc:mysql://localhost:3306/test | / | https://mvnrepository.com/artifact/mysql/mysql-connector-java |
| db2 | com.ibm.db2.jcc.DB2Driver | jdbc:db2://localhost:50000/testdb | com.ibm.db2.jcc.DB2XADataSource | https://mvnrepository.com/artifact/com.ibm.db2.jcc/db2jcc/db2jcc4 |
| saphana | com.sap.db.jdbc.Driver | jdbc:sap://localhost:39015 | / | https://mvnrepository.com/artifact/com.sap.cloud.db.jdbc/ngdbc |
| Doris | com.mysql.cj.jdbc.Driver | jdbc:mysql://localhost:3306/test | / | https://mvnrepository.com/artifact/mysql/mysql-connector-java |
| teradata | com.teradata.jdbc.TeraDriver | jdbc:teradata://localhost/DBS_PORT=1025,DATABASE=test | / | https://mvnrepository.com/artifact/com.teradata.jdbc/terajdbc |
| Redshift | com.amazon.redshift.jdbc42.Driver | jdbc:redshift://localhost:5439/testdb | com.amazon.redshift.xa.RedshiftXADataSource | https://mvnrepository.com/artifact/com.amazon.redshift/redshift-jdbc42 |
| Snowflake | net.snowflake.client.jdbc.SnowflakeDriver | jdbc:snowflake://<account_name>.snowflakecomputing.com | / | https://mvnrepository.com/artifact/net.snowflake/snowflake-jdbc |
| Vertica | com.vertica.jdbc.Driver | jdbc:vertica://localhost:5433 | / | https://repo1.maven.org/maven2/com/vertica/jdbc/vertica-jdbc/12.0.3-0/vertica-jdbc-12.0.3-0.jar |
| Kingbase | com.kingbase8.Driver | jdbc:kingbase8://localhost:54321/db_test | / | https://repo1.maven.org/maven2/cn/com/kingbase/kingbase8/8.6.0/kingbase8-8.6.0.jar |
| OceanBase | com.oceanbase.jdbc.Driver | jdbc:oceanbase://localhost:2881 | / | https://repo1.maven.org/maven2/com/oceanbase/oceanbase-client/2.4.12/oceanbase-client-2.4.12.jar |
| opengauss | org.opengauss.Driver | jdbc:opengauss://localhost:5432/postgres | / | https://repo1.maven.org/maven2/org/opengauss/opengauss-jdbc/5.1.0-og/opengauss-jdbc-5.1.0-og.jar |
| Highgo | com.highgo.jdbc.Driver | jdbc:highgo://localhost:5866/highgo | / | https://repo1.maven.org/maven2/com/highgo/HgdbJdbc/6.2.3/HgdbJdbc-6.2.3.jar |
| Dsql | org.postgresql.Driver | jdbc:postgresql://Amazon Aurora DSQL Cluster Endpoint:5432/postgres | org.postgresql.xa.PGXADataSource | https://mvnrepository.com/artifact/org.postgresql/postgresql |
| YashanDB | com.yashandb.jdbc.Driver | jdbc:yasdb://localhost:1688/SYS | / | https://repo1.maven.org/maven2/com/yashandb/yashandb-jdbc/1.10.7/yashandb-jdbc-1.10.7.jar |
常用模式
自定义 SQL
jdbc {
url = "jdbc:mysql://localhost:3306/test"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
query = "insert into test_table(name,age) values(?,?)"
}
自定义 SQL 的 Exactly-once
通过设置 is_exactly_once 开启精确一次语义
jdbc {
url = "jdbc:mysql://localhost:3306/test"
driver = "com.mysql.cj.jdbc.Driver"
max_retries = 0
username = "root"
password = "123456"
query = "insert into test_table(name,age) values(?,?)"
is_exactly_once = true
xa_data_source_class_name = "com.mysql.cj.jdbc.MysqlXADataSource"
}
Zeta 定时刷新
该引擎级能力仅由 Zeta 支持。Spark 和 Flink 不会注入 FlushSignal,因此在这两个引擎中配置 sink.flush.interval 不能启用定时刷新。在 Zeta 中,可以在 env 块配置 sink.flush.interval;引擎会定期向记录流注入 FlushSignal,JDBC Sink 收到后会立即刷出全部缓冲数据,无论是否达到 batch_size。
当 is_exactly_once = true 时不支持定时刷新。精确一次模式下 sink 使用 XA 事务,其事务边界由 checkpoint 管理;定时触发的 flush 会破坏事务一致性保证。
env {
job.mode = "STREAMING"
checkpoint.interval = 30000
sink.flush.interval = 5000
}
sink {
jdbc {
url = "jdbc:mysql://localhost:3306/test"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
database = "sink_database"
table = "sink_table"
generate_sink_sql = true
primary_keys = ["id"]
batch_size = 10000
}
}
变更数据捕获事件
jdbc 接收 CDC 示例
sink {
jdbc {
url = "jdbc:mysql://localhost:3306"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
generate_sink_sql = true
database = "sink_database"
table = "sink_table"
primary_keys = ["key1", "key2"]
}
}
自动创建不存在的目标表
通过设置 schema_save_mode 配置为 CREATE_SCHEMA_WHEN_NOT_EXIST 来支持不存在表时创建表
sink {
jdbc {
url = "jdbc:mysql://localhost:3306"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
generate_sink_sql = true
database = "sink_database"
table = "sink_table"
primary_keys = ["key1", "key2"]
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
data_save_mode = "APPEND_DATA"
}
}
PostgreSQL 9.5 及以下版本 CDC 兼容模式
Postgres 9.5及以下版本,通过设置 compatible_mode 配置为 postgresLow 来支持 Postgres CDC 操作
sink {
jdbc {
url = "jdbc:postgresql://localhost:5432"
driver = "org.postgresql.Driver"
username = "root"
password = "123456"
compatible_mode = "postgresLow"
database = "sink_database"
table = "sink_table"
generate_sink_sql = true
primary_keys = ["key1", "key2"]
}
}
多表写入
MySQL CDC Source
env {
parallelism = 1
job.mode = "STREAMING"
checkpoint.interval = 5000
}
source {
Mysql-CDC {
url = "jdbc:mysql://127.0.0.1:3306/seatunnel"
username = "root"
password = "******"
table-names = ["seatunnel.role", "seatunnel.user", "galileo.Bucket"]
}
}
transform {
}
sink {
jdbc {
url = "jdbc:mysql://localhost:3306"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
generate_sink_sql = true
database = "${database_name}_test"
table = "${table_name}_test"
primary_keys = ["${primary_key}"]
}
}
JDBC Source
env {
parallelism = 1
job.mode = "BATCH"
}
source {
Jdbc {
driver = oracle.jdbc.driver.OracleDriver
url = "jdbc:oracle:thin:@localhost:1521/XE"
username = testUser
password = testPassword
table_list = [
{
table_path = "TESTSCHEMA.TABLE_1"
},
{
table_path = "TESTSCHEMA.TABLE_2"
}
]
}
}
transform {
}
sink {
jdbc {
url = "jdbc:mysql://localhost:3306"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "123456"
generate_sink_sql = true
database = "${schema_name}_test"
table = "${table_name}_test"
primary_keys = ["${primary_key}"]
}
}
Amazon Aurora DSQL
env {
parallelism = 1
job.mode = "BATCH"
}
source {
Jdbc {
driver = oracle.jdbc.driver.OracleDriver
url = "jdbc:oracle:thin:@localhost:1521/XE"
username = testUser
password = testPassword
table_list = [
{
table_path = "TESTSCHEMA.TABLE_1"
},
{
table_path = "TESTSCHEMA.TABLE_2"
}
]
}
}
transform {
}
sink {
Jdbc {
dialect="Dsql"
driver = "org.postgresql.Driver"
url="jdbc:postgresql://ixxxxxxxxxxxxx.dsql.us-east-1.on.aws:5432/postgres"
username = "admin"
access_key_id = "ACCESSKEYIDEXAMPLE"
secret_access_key = "SECRETACCESSKEYEXAMPLE"
region = "us-east-1"
database = "postgres"
generate_sink_sql = true
primary_keys = ["id"]
max_retries = 3
batch_size = 1000
}
}
故障排查
JDBC Sink 支持自动建表吗?
支持。通过 schema_save_mode 参数控制建表行为:
CREATE_SCHEMA_WHEN_NOT_EXIST:表不存在时创建,已存在则跳过。RECREATE_SCHEMA:每次任务启动时删除并重建表。ERROR_WHEN_SCHEMA_NOT_EXIST:表不存在时抛出异常。IGNORE:跳过所有建表逻辑。
配合 generate_sink_sql = true 以及 database、table 参数可自动生成 INSERT/UPSERT SQL。
如何用 JDBC Sink 实现精确一次(exactly-once)?
JDBC Sink 通过 XA 事务支持 exactly-once:
sink {
jdbc {
url = "jdbc:mysql://localhost:3306/mydb"
driver = "com.mysql.cj.jdbc.Driver"
username = "root"
password = "password"
max_retries = 0
is_exactly_once = true
xa_data_source_class_name = "com.mysql.cj.jdbc.MysqlXADataSource"
generate_sink_sql = true
database = "mydb"
table = "target_table"
primary_keys = ["id"]
}
}
不是所有数据库都支持 XA 事务,启用前请确认数据库和 JDBC 驱动均支持。
如何配置 Upsert(INSERT OR UPDATE)行为?
SeaTunnel 只有在最终拿到了主键/唯一键信息时,才会进入 upsert / update 路径。这个 key 既可以来自显式配置的 primary_keys,也可以在未显式配置时从上游 catalog 元数据里继承主键;如果没有主键,还会尝试继承第一组 unique key。
当最终存在 key 且 enable_upsert = true 时,SeaTunnel 会优先使用目标数据库方言支持的原生 upsert 语句。例如 PostgreSQL 会生成 INSERT ... ON CONFLICT (...) DO UPDATE(如果所有字段都是主键,没有可更新列,则退化为 DO NOTHING):
sink {
jdbc {
url = "jdbc:postgresql://localhost:5432/sales"
driver = "org.postgresql.Driver"
username = "postgres"
password = "password"
generate_sink_sql = true
database = "sales"
table = "public.orders"
primary_keys = ["id"]
}
}
当最终存在 key 但 enable_upsert = false 时,SeaTunnel 不再生成数据库原生 upsert 语句,而是回到按行类型执行的 insert/update 路径:
INSERT行执行普通 INSERT- CDC
UPDATE_AFTER行执行 UPDATE - CDC
DELETE行执行 DELETE
因此,enable_upsert = false 不适合依赖重复键自动覆盖的普通批量导入场景。
未显式配置 primary_keys 时会发生什么?
如果你没有显式配置 primary_keys,SeaTunnel 会先尝试从上游 catalog 元数据继承主键;如果没有主键,则再尝试继承第一组 unique key。
只有在“显式配置也没有、上游元数据里也没有可继承 key”时,JDBC Sink 才会退回普通 INSERT。进入这个无 key 模式后,不仅不会生成数据库原生 upsert 语句,Sink 也不会再使用按 RowKind 执行 UPDATE / DELETE 的写入器。对于 CDC 输入,这条写链路会实质上退化为普通 INSERT batching,重复键是否报错完全取决于目标表自身约束。
什么时候应该开启 use_copy_statement?
use_copy_statement = true 会让 JDBC Sink 直接优先走 COPY <table> (...) FROM STDIN WITH CSV 路径,而不是常规的 INSERT / UPSERT 语句。即使同时配置了 primary_keys,也会优先进入 COPY 路径。
这个选项更适合 PostgreSQL 大批量导入场景,但要同时满足下面几个前提:
- JDBC 驱动连接对象必须提供
getCopyAPI()能力;否则任务会直接报错,并提示把use_copy_statement改回false - 它不是
ON CONFLICT的替代品,不负责处理重复键覆盖逻辑 - 当前不支持
MAP、ARRAY、ROW类型
如何在一个任务中写入多张表?
使用 table = "${table_name}"、database = "${schema_name}" 占位符,SeaTunnel 会从上游记录的元数据中解析实际值(与 CDC 数据源或多表配置配合使用)。搭配 generate_sink_sql = true 可实现全自动 SQL 生成。
为什么提示 JDBC 驱动未找到?
SeaTunnel 不内置所有 JDBC 驱动。Spark 和 Flink 需要把 JAR 放到每个执行节点的 ${SEATUNNEL_HOME}/plugins/Jdbc/lib/;Zeta 需要放到每个 SeaTunnel 节点的 ${SEATUNNEL_HOME}/lib/,然后重启受影响的进程。常见驱动文件名包括:
- MySQL:
mysql-connector-j-8.x.x.jar - PostgreSQL:
postgresql-42.x.x.jar - Oracle:
ojdbc8.jar - SQL Server:
mssql-jdbc-12.x.x.jre11.jar
变更日志
Change Log
| Change | Commit | Version |
|---|---|---|
| [Fix][Connector-xugu] Fix several bugs in the xugu connector (#9820) | https://github.com/apache/seatunnel/commit/75c9adb280 | dev |
[Feature][Transform-V2] Support AT TIME ZONE statement for sql transform (#9784) | https://github.com/apache/seatunnel/commit/ad5278c5bb | dev |
| [Feature][Transform-V2] Support vector series sql function (#9765) | https://github.com/apache/seatunnel/commit/a40114cf7a | 2.3.12 |
| [Chore] fix typos filed -> field (#9757) | https://github.com/apache/seatunnel/commit/e3e1c67d29 | 2.3.12 |
| [Feature][Core] Add plugin directory support for each connector (#9650) | https://github.com/apache/seatunnel/commit/4beb2b9336 | 2.3.12 |
| [Improve][Core] Update apache common to apache common lang3 (#9694) | https://github.com/apache/seatunnel/commit/6e5737c1ec | 2.3.12 |
| [Improve][API] Optimize the enumerator API semantics and reduce lock calls at the connector level (#9671) | https://github.com/apache/seatunnel/commit/9212a77140 | 2.3.12 |
| [Fix][connector-jdbc] prevent precision loss in Float to BigDecimal conversion (#9670) | https://github.com/apache/seatunnel/commit/6e11285bf6 | 2.3.12 |
| [Fix][Connector-Jdbc] Supports reading and writing Postgres network dress types (#9618) | https://github.com/apache/seatunnel/commit/3dc79c1ddf | 2.3.12 |
| [improve] jdbc options (#9541) | https://github.com/apache/seatunnel/commit/d041e5fb32 | 2.3.12 |
| [Fix][Connector-Jdbc]Fixed Vertica data source cannot upsert data. (#9607) | https://github.com/apache/seatunnel/commit/7b4d05171b | 2.3.12 |
[Fix][Connectors-Jdbc] Postgres supports streaming and batch reading and writing of the interval data type (#9590) | https://github.com/apache/seatunnel/commit/58ab917024 | 2.3.12 |
| [Feature][Connectors-v2] Optimize the size of CDC JAR Files (#9546) | https://github.com/apache/seatunnel/commit/1dd19c6823 | 2.3.12 |
| [improve][Connector-jdbc] add comments when schema not include all columns (#9559) | https://github.com/apache/seatunnel/commit/02d2b69d85 | 2.3.12 |
| [Hotfix][Connector-Jdbc] Write MySQL to support set collection data type (#9553) | https://github.com/apache/seatunnel/commit/3836c97a62 | 2.3.12 |
| [Feature][Jdbc] Support read multiple tables by regular expressions (#9380) | https://github.com/apache/seatunnel/commit/670a52a918 | 2.3.12 |
| [bugfix][Connector-V2] Fixed the load driver inaccurate situation (#9468) | https://github.com/apache/seatunnel/commit/c6639e81fe | 2.3.12 |
| [Fix][Connector-V2] Fix OceanBase Oracle create unsupported data type (#9383) | https://github.com/apache/seatunnel/commit/f4178c72f1 | 2.3.12 |
| [improve][Connector-V2] delete jdbc param support_upsert_by_query_primary_key_exist (#9408) | https://github.com/apache/seatunnel/commit/d247fe1d8d | 2.3.12 |
| [Feature][Connector-V2] Jdbc mysql support read tinyint(1) to byte(tinyint) (#9373) | https://github.com/apache/seatunnel/commit/7b87aa6f12 | 2.3.12 |
| [Improve] JdbcInputFormat nextRecord Exception throw TableId (#9374) | https://github.com/apache/seatunnel/commit/484aef593d | 2.3.12 |
| [Feature][Connector-V2][JDBC] Add presto/trino dialect (#9388) | https://github.com/apache/seatunnel/commit/3cac2bd126 | 2.3.12 |
| [Feature][Connector-JDBC] Supprot read Oracle BLOB data as string instead of bytes (#9305) | https://github.com/apache/seatunnel/commit/454a88f81a | 2.3.11 |
| [Fix][Connector-jdbc] Fix postgresql sink trying to update unique key (#9293) (#9298) | https://github.com/apache/seatunnel/commit/d0c1de8357 | 2.3.11 |
| [Fix][Connector-V2] Fix oceanbase mysql jdbc sink create statement error (#9267) | https://github.com/apache/seatunnel/commit/79f8125ea6 | 2.3.11 |
| [Feature][Transform] Support define sink column type (#9114) | https://github.com/apache/seatunnel/commit/ab7119e507 | 2.3.11 |
| [Feature][Checkpoint] Add check script for source/sink state class serialVersionUID missing (#9118) | https://github.com/apache/seatunnel/commit/4f5adeb1c7 | 2.3.11 |
[Fix][API] Fixed not invoke the SinkAggregatedCommitter's init method (#9070) | https://github.com/apache/seatunnel/commit/df0d11d632 | 2.3.11 |
| [Fix][Connector-V2] Fix SqlServer create table when database with dot (#9007) | https://github.com/apache/seatunnel/commit/e09445c789 | 2.3.11 |
| [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index (#9072) | https://github.com/apache/seatunnel/commit/4140cd1d8f | 2.3.11 |
| [Improve][Connector-V2] Optimize dialect selection in jdbc (#8820) | https://github.com/apache/seatunnel/commit/92c62c5e63 | 2.3.11 |
| [Fix][JDBC] fix jdbc default connection parameter invalid (#8185) | https://github.com/apache/seatunnel/commit/f85eb78b37 | 2.3.11 |
| [Hotfix][Jdbc] Fix mysql tinyint(1) type mapping for TypeMapper (#9012) | https://github.com/apache/seatunnel/commit/5f85d7668a | 2.3.11 |
| [Feature][Jdbc] Add String type column split Support by charset-based splitting algorithm (#9002) | https://github.com/apache/seatunnel/commit/dbe41e74cd | 2.3.11 |
| [Fix][Paimon] nullable and comment attribute was lost during automatic table creation (#9020) | https://github.com/apache/seatunnel/commit/eb54fdd52c | 2.3.11 |
| [Fix][Connector-JDBC] Fix JDBC driver selection for data source connections (#8986) | https://github.com/apache/seatunnel/commit/a5aafa7301 | 2.3.11 |
| [Improve][Jdbc] Upgrade sap-hana driver from 2.14.7 to 2.23.10 (#9013) | https://github.com/apache/seatunnel/commit/9ba9f169be | 2.3.11 |
| [Feature][Jdbc] Support sink ddl for sqlserver #8114 (#8936) | https://github.com/apache/seatunnel/commit/30aa485b38 | 2.3.10 |
| [Fix][Connector-V2] Fix parse SqlServer JDBC Url error (#8784) | https://github.com/apache/seatunnel/commit/373d2162d3 | 2.3.10 |
| [Improve][Jdbc] Support upsert for opengauss (#8627) | https://github.com/apache/seatunnel/commit/56110bf392 | 2.3.10 |
| [Improve][Jdbc] Remove useless utils. (#8793) | https://github.com/apache/seatunnel/commit/36a7533e85 | 2.3.10 |
| [Improve][Jdbc] Improve catalog connection cache (#8626) | https://github.com/apache/seatunnel/commit/6205065b25 | 2.3.10 |
| [Fix][Connector-V2] Fix jdbc sink statement buffer wrong time to clear (#8653) | https://github.com/apache/seatunnel/commit/cf35eecdfc | 2.3.10 |
| [Feature][Jdbc] Support sink ddl for dameng (#8380) | https://github.com/apache/seatunnel/commit/5ff3427428 | 2.3.10 |
| [Improve] restruct connector common options (#8634) | https://github.com/apache/seatunnel/commit/f3499a6eeb | 2.3.10 |
| [Improve][Jdbc] Remove oracle 'v$database' query (#8571) | https://github.com/apache/seatunnel/commit/3cf09f61ca | 2.3.10 |
| [Fix][Connector-V2] Postgres support for multiple primary keys (#8526) | https://github.com/apache/seatunnel/commit/04db40d973 | 2.3.10 |
| [Feature][JDBC source] pg support char types (#8420) | https://github.com/apache/seatunnel/commit/776ac94478 | 2.3.9 |
| [Feature][Jdbc] Support sink ddl for postgresql (#8276) | https://github.com/apache/seatunnel/commit/353bbd21a1 | 2.3.9 |
| [Feature][Connector-V2] Support the jdbc connector for highgo db (#8282) | https://github.com/apache/seatunnel/commit/aa381cbfb4 | 2.3.9 |
| [Improve][Jdbc] Support nvarchar in dm (#8270) | https://github.com/apache/seatunnel/commit/2f1c54ee2e | 2.3.9 |
| [Improve][Connector-v2] Use regex to match filedName placeholders in jdbc sink (#8222) | https://github.com/apache/seatunnel/commit/c02d4fed36 | 2.3.9 |
| [Improve][Connector-V2] Support read comment when jdbc dialect without catalog (#8196) | https://github.com/apache/seatunnel/commit/567cd54de5 | 2.3.9 |
| [Improve][Connector-V2] The interface supports jdbc respects the target database field type (#8031) | https://github.com/apache/seatunnel/commit/1de056a9a4 | 2.3.9 |
| [Improve][dist]add shade check rule (#8136) | https://github.com/apache/seatunnel/commit/51ef800016 | 2.3.9 |
| [Improve][Jdbc] Improve ddl write validate (#8158) | https://github.com/apache/seatunnel/commit/9cdaacddd9 | 2.3.9 |
| [Feature][Jdbc] Add Jdbc default dialect for all jdbc series database without dialect (#8132) | https://github.com/apache/seatunnel/commit/399eabcd3f | 2.3.9 |
| [Improve][Jdbc] Refactor ddl change (#8134) | https://github.com/apache/seatunnel/commit/e1f0a238f7 | 2.3.9 |
[Feature][Core] Rename result_table_name/source_table_name to plugin_input/plugin_output (#8072) | https://github.com/apache/seatunnel/commit/c7bbd322db | 2.3.9 |
| [Improve][Connector-V2] Improve schema evolution on column insert after for mysql-jdbc (#8017) | https://github.com/apache/seatunnel/commit/3fb05da365 | 2.3.9 |
| [Feature][Core] Support cdc task ddl restore for zeta (#7463) | https://github.com/apache/seatunnel/commit/8e322281ed | 2.3.9 |
| [Feature][transform] transform support explode (#7928) | https://github.com/apache/seatunnel/commit/132278c06a | 2.3.9 |
| [Feature][Connector-v2] Support schema evolution for Oracle connector (#7908) | https://github.com/apache/seatunnel/commit/79406bcc2f | 2.3.9 |
| [Improve][Connector-V2] Improve jdbc merge table from path and query when type is decimal (#7917) | https://github.com/apache/seatunnel/commit/8baa012ced | 2.3.9 |
| [Fix][Connector-V2] Fix hana type loss of precision (#7912) | https://github.com/apache/seatunnel/commit/18dcca36cd | 2.3.9 |
| [Feature][Connector-V2] Jdbc DB2 support upsert SQL (#7879) | https://github.com/apache/seatunnel/commit/139919334d | 2.3.9 |
| [Improve][Jdbc] Optimize index name conflicts when create table for postgresql (#7875) | https://github.com/apache/seatunnel/commit/312ee866fb | 2.3.9 |
| [Improve][Jdbc] Support postgresql inet type. (#7820) | https://github.com/apache/seatunnel/commit/25b68b3623 | 2.3.9 |
| [Fix][Connector-V2]Oceanbase vector database is added as the source server (#7832) | https://github.com/apache/seatunnel/commit/258f931765 | 2.3.9 |
| [Feature][connector-v2]Support opengauss jdbc connnector using opengauss driver. (#7622) | https://github.com/apache/seatunnel/commit/bbf643772e | 2.3.9 |
| [Improve][Jdbc] Support save mode for the sink of jdbc-dm (#7814) | https://github.com/apache/seatunnel/commit/b87d732c81 | 2.3.9 |
| [Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786) | https://github.com/apache/seatunnel/commit/6b7c53d03c | 2.3.9 |
| [Feature][Connector-V2] SqlServer support user-defined type (#7706) | https://github.com/apache/seatunnel/commit/fb89033273 | 2.3.8 |
| [Hotfix][CDC] Fix ddl duplicate execution error when config multi_table_sink_replica (#7634) | https://github.com/apache/seatunnel/commit/23ab3edbbb | 2.3.8 |
| [Feature][Connector-Paimon] Support dynamic bucket splitting improves Paimon writing efficiency (#7335) | https://github.com/apache/seatunnel/commit/bc0326cba8 | 2.3.8 |
| [Fix][Connector-V2] Fix jdbc test case failed (#7690) | https://github.com/apache/seatunnel/commit/4f5d27f625 | 2.3.8 |
| [Improve][Jdbc] Jdbc truncate table should check table not database (#7654) | https://github.com/apache/seatunnel/commit/0c0eb7e41b | 2.3.8 |
| [Feature][Connector-V2] jdbc saphana source tablepath support view and synonym (#7670) | https://github.com/apache/seatunnel/commit/7e0c20a488 | 2.3.8 |
| [Fix][Connector-v2] Throw Exception in sql query for JdbcCatalog in table or db exists query (#7651) | https://github.com/apache/seatunnel/commit/70ec59ce0e | 2.3.8 |
| [Fix][JDBC] Fix starrocks jdbc dialect catalog conflict with starrocks connector (#7578) | https://github.com/apache/seatunnel/commit/020aab422e | 2.3.8 |
| [Feature] Support tidb cdc connector source #7199 (#7477) | https://github.com/apache/seatunnel/commit/87ec786bd6 | 2.3.8 |
| [bugfix] fix oracle query table length (#7627) | https://github.com/apache/seatunnel/commit/2e002ce09b | 2.3.8 |
| [Hotfix][Connector-v2] Fix the NullPointerException for jdbc oracle which used the table_list (#7544) | https://github.com/apache/seatunnel/commit/555028217a | 2.3.8 |
| [Improve][Connector-v2] Support mysql 8.1/8.2/8.3 for jdbc (#7530) | https://github.com/apache/seatunnel/commit/657fe69b26 | 2.3.8 |
| [Improve][Connector-v2] Release resource in closeStatements even exception occurred in executeBatch (#7533) | https://github.com/apache/seatunnel/commit/590f7d110d | 2.3.8 |
| [Fix][Connector-V2] Fix jdbc query sql can not get table path (#7484) | https://github.com/apache/seatunnel/commit/8e0ca8f725 | 2.3.8 |
[Feature][Connector-V2] Add decimal_type_narrowing option in jdbc (#7461) | https://github.com/apache/seatunnel/commit/696f2948fa | 2.3.8 |
| [Improve][Connector-V2] update vectorType (#7446) | https://github.com/apache/seatunnel/commit/1bba72385b | 2.3.8 |
| [Improve][API] Move catalog open to SaveModeHandler (#7439) | https://github.com/apache/seatunnel/commit/8c2c5c79a1 | 2.3.8 |
| [FIX][E2E]Modify the OceanBase test case to the latest imageChange image (#7452) | https://github.com/apache/seatunnel/commit/6abb83deab | 2.3.8 |
| [Feature][Connector-V2][OceanBase] Support vector types on OceanBase (#7375) | https://github.com/apache/seatunnel/commit/a6b188d552 | 2.3.8 |
| [Improve][Connector-V2] Remove system table limit (#7391) | https://github.com/apache/seatunnel/commit/adf888e008 | 2.3.8 |
| [Fix] Fix oracle sample data from column error (#7340) | https://github.com/apache/seatunnel/commit/2130e0d5ad | 2.3.8 |
| [Improve][Connector-V2] Close all ResultSet after used (#7389) | https://github.com/apache/seatunnel/commit/853e973212 | 2.3.8 |
| [Hotifx][Jdbc] Fix MySQL unsupport 'ZEROFILL' column type (#7407) | https://github.com/apache/seatunnel/commit/7130382123 | 2.3.8 |
| [Improvement] add starrocks jdbc dialect (#7294) | https://github.com/apache/seatunnel/commit/b5140f598e | 2.3.8 |
| [Hotfix][Connector] Fix jdbc compile error (#7359) | https://github.com/apache/seatunnel/commit/2769ed5029 | 2.3.7 |
| [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver (#7311) | https://github.com/apache/seatunnel/commit/3130ae089e | 2.3.7 |
| [Improve][Jdbc] Skip all index when auto create table to improve performance of write (#7288) | https://github.com/apache/seatunnel/commit/dc3c23981b | 2.3.7 |
| [Improve][Jdbc] Remove MysqlType references in JdbcDialect (#7333) | https://github.com/apache/seatunnel/commit/16eeb1c123 | 2.3.7 |
| [Improve][Jdbc] Merge user config primary key when create table (#7313) | https://github.com/apache/seatunnel/commit/819c685651 | 2.3.7 |
| [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence (#7261) | https://github.com/apache/seatunnel/commit/f012b2a6f0 | 2.3.7 |
| [Feature][Jdbc] Support hive compatibleMode add inceptor dialect (#7262) | https://github.com/apache/seatunnel/commit/31e59cdf82 | 2.3.6 |
| [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248) | https://github.com/apache/seatunnel/commit/0d08b20061 | 2.3.6 |
| [Feature][Core] Support using upstream table placeholders in sink options and auto replacement (#7131) | https://github.com/apache/seatunnel/commit/c4ca74122c | 2.3.6 |
| [Fix] Fix Hana type converter decimal scale is 0 convert to int error (#7167) | https://github.com/apache/seatunnel/commit/6e33a97c86 | 2.3.6 |
| [Improve][Jdbc] Support write unicode text into sqlserver (#7159) | https://github.com/apache/seatunnel/commit/e44e8b93bc | 2.3.6 |
| [Improve][Jdbc] Remove user info in catalog-table options (#7178) | https://github.com/apache/seatunnel/commit/4e001be25c | 2.3.6 |
| [Improve][connector-v2-jdbc-mysql] Add support for MySQL 8.4 (#7151) | https://github.com/apache/seatunnel/commit/dbdbdf015b | 2.3.6 |
| [Feature][Connector-V2] Support jdbc hana catalog and type convertor (#6950) | https://github.com/apache/seatunnel/commit/d663398739 | 2.3.6 |
| [Improve] Change catalog table log to debug level (#7136) | https://github.com/apache/seatunnel/commit/b111d2f843 | 2.3.6 |
| [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc (#6929) | https://github.com/apache/seatunnel/commit/cf91e51fc7 | 2.3.6 |
| [connector-jdbc][bugfix] fix sqlServer create table comment special string bug (#7024) | https://github.com/apache/seatunnel/commit/403564db13 | 2.3.6 |
| [bugfix] fix pgsql create table comment special string bug (#7022) | https://github.com/apache/seatunnel/commit/9fe844f62a | 2.3.6 |
| [connector-jdbc][bugfix] fix oracle create table comment special string bug (#7012) | https://github.com/apache/seatunnel/commit/a9e0f67873 | 2.3.6 |
| [bugfix] fix mysql create table comment special string bug (#6998) | https://github.com/apache/seatunnel/commit/904e9cf785 | 2.3.6 |
| [Improve][Jdbc]sink sql support custom field.(#6515) (#6525) | https://github.com/apache/seatunnel/commit/ef3e61dbc4 | 2.3.6 |
| [Feature][Jdbc] Support redshift catalog (#6992) | https://github.com/apache/seatunnel/commit/8d5cbcee74 | 2.3.6 |
| [Improve][Connector-V2] Clean key name in catalog table (#6942) | https://github.com/apache/seatunnel/commit/a399ef48c6 | 2.3.6 |
| [Improve][Zeta] Move SaveMode behavior to master (#6843) | https://github.com/apache/seatunnel/commit/80cf91318d | 2.3.6 |
| [Improve][Jdbc] Quotes the identifier for table path (#6951) | https://github.com/apache/seatunnel/commit/d70ec61f35 | 2.3.6 |
| [Hotfix][Jdbc] Fix oracle savemode create table (#6651) | https://github.com/apache/seatunnel/commit/4b6c13e8fc | 2.3.6 |
| [Improve][JDBC Source] Fix Split can not be cancel (#6825) | https://github.com/apache/seatunnel/commit/ee3b7c3723 | 2.3.6 |
| [Feature][Doris] Add Doris type converter (#6354) | https://github.com/apache/seatunnel/commit/5189991843 | 2.3.6 |
| [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684) | https://github.com/apache/seatunnel/commit/868ba4d7c7 | 2.3.6 |
| [Improve][Connector] Add some sqlserver IDENTITY type for catalog (#6822) | https://github.com/apache/seatunnel/commit/f698396555 | 2.3.6 |
| [Feature][Jdbc] Support the jdbc connector for InterSystems IRIS (#6797) | https://github.com/apache/seatunnel/commit/46600969bb | 2.3.6 |
| [Fix][MySQL]: Fix MySqlTypeConverter could not be instantiated (#6781) | https://github.com/apache/seatunnel/commit/a5609d600e | 2.3.6 |
| [Hotfix][Jdbc] Fix table/query columns order merge for jdbc catalog (#6771) | https://github.com/apache/seatunnel/commit/df1954d520 | 2.3.6 |
| [Fix] Fix Oracle type converter handle negative scale in number type (#6758) | https://github.com/apache/seatunnel/commit/6d710690c5 | 2.3.6 |
| [Improve][mysql-cdc] Support mysql 5.5 versions (#6710) | https://github.com/apache/seatunnel/commit/058f5594a3 | 2.3.6 |
| [Improve][Jdbc] Add quote identifier for sql (#6669) | https://github.com/apache/seatunnel/commit/849d748d3d | 2.3.5 |
| [Improve][Jdbc] Increase tyepe converter when auto creating tables (#6617) | https://github.com/apache/seatunnel/commit/cc660206d8 | 2.3.5 |
| [feature][connector-v2] add xugudb connector (#6561) | https://github.com/apache/seatunnel/commit/80f392afbb | 2.3.5 |
| [Hotfix] Fix DEFAULT TABLE problem (#6352) | https://github.com/apache/seatunnel/commit/cdb1856e84 | 2.3.5 |
| [Improve] Improve MultiTableSinkWriter prepare commit performance (#6495) | https://github.com/apache/seatunnel/commit/2086b0e8a6 | 2.3.5 |
| [Improve][JDBC] Optimized code style for getting jdbc field types (#6583) | https://github.com/apache/seatunnel/commit/ddca95f32c | 2.3.5 |
| [Improve] Add SaveMode log of process detail (#6375) | https://github.com/apache/seatunnel/commit/b0d70ce224 | 2.3.5 |
| [Improve][Jdbc] Support custom case-sensitive config for dameng (#6510) | https://github.com/apache/seatunnel/commit/d6dcb03bf3 | 2.3.5 |
| feat: jdbc support copy in statement. (#6443) | https://github.com/apache/seatunnel/commit/ca4a65fc00 | 2.3.5 |
| [Improve][Jdbc] Using varchar2 datatype store string in oracle (#6392) | https://github.com/apache/seatunnel/commit/14405fa8d4 | 2.3.5 |
| [Improve][API] Unify type system api(data & type) (#5872) | https://github.com/apache/seatunnel/commit/b38c7edcc9 | 2.3.5 |
| Fix Jdbc sink target table name error (#6269) | https://github.com/apache/seatunnel/commit/2f62235e38 | 2.3.4 |
| [Improve][JDBC] Use PreparedStatement to sample data from column (#6242) | https://github.com/apache/seatunnel/commit/bd0e66d533 | 2.3.4 |
| [Improve][JDBC-sink] Improve query Approximate Total Row Count of a Table (#5972) | https://github.com/apache/seatunnel/commit/8156036a2f | 2.3.4 |
| [Feature][JDBC、CDC] Support Short and Byte Type in spliter (#6027) | https://github.com/apache/seatunnel/commit/6f8d0a5040 | 2.3.4 |
[Improve] Support int identity type in sql server (#6186) | https://github.com/apache/seatunnel/commit/1a8da1c843 | 2.3.4 |
| [Bugfix][JDBC、CDC] Fix Spliter Error in Case of Extensive Duplicate Data (#6026) | https://github.com/apache/seatunnel/commit/635c24e8b2 | 2.3.4 |
| [Feature][Connector-V2][Postgres-cdc]Support for Postgres cdc (#5986) | https://github.com/apache/seatunnel/commit/97438b9402 | 2.3.4 |
| Add date type and float type column split support (#6160) | https://github.com/apache/seatunnel/commit/b9a62e5c3f | 2.3.4 |
[Improve] Extend SupportResourceShare to spark/flink (#5847) | https://github.com/apache/seatunnel/commit/c69da93b87 | 2.3.4 |
[Feature] Support uuid in postgres jdbc (#6185) | https://github.com/apache/seatunnel/commit/f56855098b | 2.3.4 |
| [Feature][Connector-V2][Oracle-cdc]Support for oracle cdc (#5196) | https://github.com/apache/seatunnel/commit/aaef22b31b | 2.3.4 |
| [Feature][Connector] update pgsql catalog for save mode (#6080) | https://github.com/apache/seatunnel/commit/84ce516929 | 2.3.4 |
| [Hotfix][Jdbc] Fix dameng catalog query table sql (#6141) | https://github.com/apache/seatunnel/commit/413fa74500 | 2.3.4 |
| [improve][catalog-postgres] Improve get column sql compatibility (#5664) | https://github.com/apache/seatunnel/commit/23ce592ad2 | 2.3.4 |
| [Feature][Connector] update oracle catalog for save mode (#6092) | https://github.com/apache/seatunnel/commit/dfbf92769c | 2.3.4 |
| [Feature][Connectors-V2][Jdbc] Supports Sqlserver Niche Data Types (#6122) | https://github.com/apache/seatunnel/commit/6673f6f771 | 2.3.4 |
| [Improve][Connector-V2][Jdbc] Shade hikari in jdbc connector (#6116) | https://github.com/apache/seatunnel/commit/dd698c95bf | 2.3.4 |
| [Feature][Connector] update sqlserver catalog for save mode (#6086) | https://github.com/apache/seatunnel/commit/edcaacecb1 | 2.3.4 |
| [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key (#6079) | https://github.com/apache/seatunnel/commit/3522eb157c | 2.3.4 |
| [Hotfix][Jdbc] Fix jdbc setFetchSize error (#6005) | https://github.com/apache/seatunnel/commit/d41af8a6ed | 2.3.4 |
| Support using multiple hadoop account (#5903) | https://github.com/apache/seatunnel/commit/d69d88d1aa | 2.3.4 |
| [Feature] Add unsupported datatype check for all catalog (#5890) | https://github.com/apache/seatunnel/commit/b9791285a0 | 2.3.4 |
| [Hotfix][Split] Fix split key not support BigInteger type | https://github.com/apache/seatunnel/commit/5adf5d2b9a | 2.3.4 |
| [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter | https://github.com/apache/seatunnel/commit/1cc1b1b8cd | 2.3.4 |
| [Hotfix][Jdbc] Fix cdc updates were not filtering same primary key (#5923) | https://github.com/apache/seatunnel/commit/38d3b85814 | 2.3.4 |
| [Improve]Change System.out.println to log output. (#5912) | https://github.com/apache/seatunnel/commit/bbedb07a9c | 2.3.4 |
| [Bug] Fix Hive-Jdbc use krb5 overwrite kerberosKeytabPath (#5891) | https://github.com/apache/seatunnel/commit/f0b6092c15 | 2.3.4 |
| Reduce the time cost of getCatalogTable in jdbc (#5908) | https://github.com/apache/seatunnel/commit/51a3737578 | 2.3.4 |
| [Improve] Improve Jdbc connector error message when datatype unsupported (#5864) | https://github.com/apache/seatunnel/commit/69f79af3a4 | 2.3.4 |
[Improve] Rename getCountSql to getExistDataSql (#5838) | https://github.com/apache/seatunnel/commit/2233b3a381 | 2.3.4 |
| [Fix] Fix read from Oracle Date type value lose time (#5814) | https://github.com/apache/seatunnel/commit/2d704e36bd | 2.3.4 |
| [Improve][JdbcSource] Optimize catalog-table metadata merge logic (#5828) | https://github.com/apache/seatunnel/commit/7d8028a60b | 2.3.4 |
| [Improve][Common] Introduce new error define rule (#5793) | https://github.com/apache/seatunnel/commit/9d1b2582b2 | 2.3.4 |
| [Feature][Hive JDBC Source] Support Hive JDBC Source Connector (#5424) | https://github.com/apache/seatunnel/commit/a64e177d06 | 2.3.4 |
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755) | https://github.com/apache/seatunnel/commit/8de7408100 | 2.3.4 |
[Improve][Connector] Add field name to DataTypeConvertor to improve error message (#5782) | https://github.com/apache/seatunnel/commit/ab60790f0d | 2.3.4 |
| [Feature][Oracle] Support XMLTYPE data integration #5716 (#5723) | https://github.com/apache/seatunnel/commit/620f081adb | 2.3.4 |
| [Fix] Fix Postgres create table test case failed (#5778) | https://github.com/apache/seatunnel/commit/b98b6bcee3 | 2.3.4 |
| [Improve][Jdbc] Fix database identifier (#5756) | https://github.com/apache/seatunnel/commit/dbfc8a670a | 2.3.4 |
| [Fix] Fix PG will not create index when using auto create table #5721 | https://github.com/apache/seatunnel/commit/e5fd88dbe7 | 2.3.4 |
[Improve] Remove all useless prepare, getProducedType method (#5741) | https://github.com/apache/seatunnel/commit/ed94fffbb9 | 2.3.4 |
| [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized (#5663) | https://github.com/apache/seatunnel/commit/eff17ccbe5 | 2.3.4 |
| [Bug][connector-jdbc] Nullable Column source have null data could be unexpected results. (#5560) | https://github.com/apache/seatunnel/commit/3f429e1f0a | 2.3.4 |
[Improve] Add default implement for SeaTunnelSink::setTypeInfo (#5682) | https://github.com/apache/seatunnel/commit/86cba87450 | 2.3.4 |
| [BUG][Connector-V2][Jdbc] support postgresql xml type (#5724) | https://github.com/apache/seatunnel/commit/5f5d4da13f | 2.3.4 |
| [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode (#5697) | https://github.com/apache/seatunnel/commit/879c2aa07c | 2.3.4 |
| [Feature][Jdbc] Support read multiple tables (#5581) | https://github.com/apache/seatunnel/commit/33fa8ff248 | 2.3.4 |
| [Feature] Support multi-table sink (#5620) | https://github.com/apache/seatunnel/commit/81ac173189 | 2.3.4 |
| [Improve] Remove catalog tag for config file (#5645) | https://github.com/apache/seatunnel/commit/dc509aa080 | 2.3.4 |
| [Feature][Jdbc] Supporting more ways to configure connection parameters. (#5388) | https://github.com/apache/seatunnel/commit/d31e9478f7 | 2.3.4 |
| [Feature][Connector-V2][Jdbc] Add OceanBase catalog (#5439) | https://github.com/apache/seatunnel/commit/cd4b7ff7d2 | 2.3.4 |
| [BUGFIX][Catalog] oracle catalog create table repeat and oracle pg null point (#5517) | https://github.com/apache/seatunnel/commit/103da931f3 | 2.3.4 |
| Support config column/primaryKey/constraintKey in schema (#5564) | https://github.com/apache/seatunnel/commit/eac76b4e50 | 2.3.4 |
[Improve] Refactor CatalogTable and add SeaTunnelSource::getProducedCatalogTables (#5562) | https://github.com/apache/seatunnel/commit/41173357f8 | 2.3.4 |
| [Feature][Jdbc] Add Dameng catalog (#5451) | https://github.com/apache/seatunnel/commit/c23070919c | 2.3.4 |
| [Feature] Add tidb datatype convertor (#5440) | https://github.com/apache/seatunnel/commit/61391bda9f | 2.3.4 |
| [Feature][Connector-V2] jdbc connector supports Kingbase database (#4803) | https://github.com/apache/seatunnel/commit/9538567159 | 2.3.4 |
| [Feature][Catalog] Catalog add Case Conversion Definition (#5328) | https://github.com/apache/seatunnel/commit/7b5b28bdbe | 2.3.4 |
| [Feature][Jdbc] Jdbc database support identifier (#5089) | https://github.com/apache/seatunnel/commit/38b6d6e4bb | 2.3.4 |
| [Improve][Connector-v2][Jdbc] Refactor AbstractJdbcCatalog (#5096) | https://github.com/apache/seatunnel/commit/dde3104f76 | 2.3.4 |
| [Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260) | https://github.com/apache/seatunnel/commit/51c0d709ba | 2.3.4 |
| [Hotfix] Fix com.google.common.base.Preconditions to seatunnel shade one (#5284) | https://github.com/apache/seatunnel/commit/ed5eadcf73 | 2.3.3 |
| [bug][jdbc][oracle]Fix the Oracle number type mapping problem (#5209) | https://github.com/apache/seatunnel/commit/9d3c3de90d | 2.3.3 |
| [BUG][Connector-V2][Jdbc] support postgresql json type (#5194) | https://github.com/apache/seatunnel/commit/7a862d14b7 | 2.3.3 |
| [Improve][Connector-V2] Remove scheduler in JDBC sink #4736 (#5168) | https://github.com/apache/seatunnel/commit/3b0a393145 | 2.3.3 |
| [CI] Split updated modules integration test for part 5 (#5208) | https://github.com/apache/seatunnel/commit/18f14d6087 | 2.3.3 |
| [Bug][connector-v2] PostgreSQL versions below 9.5 are compatible use cdc sync problem (#5120) | https://github.com/apache/seatunnel/commit/9af696a1dd | 2.3.3 |
| [Improve][Connector-v2][Jdbc] check url not null throw friendly message (#5097) | https://github.com/apache/seatunnel/commit/b0815f2a95 | 2.3.3 |
| [Feature][Catalog] Add JDBC Catalog auto create table (#4917) | https://github.com/apache/seatunnel/commit/63eb137671 | 2.3.3 |
| [Feature][CDC] Support tables without primary keys (with unique keys) (#163) (#5150) | https://github.com/apache/seatunnel/commit/32b7f2b690 | 2.3.3 |
| [Hotfix][Connector][Jdbc] Fix the problem of JdbcOutputFormat database connection leak (#4802) | https://github.com/apache/seatunnel/commit/4cc10e83e7 | 2.3.3 |
| [Feature][JDBC Sink] Add DM upsert support (#5073) | https://github.com/apache/seatunnel/commit/5e8d982e25 | 2.3.3 |
| [Improve] Improve savemode api (#4767) | https://github.com/apache/seatunnel/commit/4acd370d48 | 2.3.3 |
| [Feature][Connector-V2] JDBC source support string type as partition key (#4947) | https://github.com/apache/seatunnel/commit/d1d2677658 | 2.3.3 |
| [Feature][Connector-V2][Jdbc] Add oceanbase dialect factory (#4989) | https://github.com/apache/seatunnel/commit/7ba11cecdf | 2.3.3 |
| Fix XA Transaction bug (#5020) | https://github.com/apache/seatunnel/commit/852fe104bc | 2.3.3 |
| [Improve][CDC]Remove driver for cdc connector (#4952) | https://github.com/apache/seatunnel/commit/b65f40c3c9 | 2.3.3 |
| [Improve] Documentation and partial word optimization. (#4936) | https://github.com/apache/seatunnel/commit/6e8de0e2a6 | 2.3.3 |
| [Improve][Connector-V2][Jdbc-Source] Support for Decimal types as splict keys (#4634) | https://github.com/apache/seatunnel/commit/d56bb1ba1c | 2.3.3 |
| [Bugfix][zeta] Fix the deadlock issue with JDBC driver loading (#4878) | https://github.com/apache/seatunnel/commit/c30a2a1b1c | 2.3.2 |
| [Hotfix][Jdbc] Fix XA DataSource crash(Oracle/Dameng/SqlServer) (#4866) | https://github.com/apache/seatunnel/commit/bde19b6377 | 2.3.2 |
| [Feature][Connector-v2] Add Snowflake Source&Sink connector (#4470) | https://github.com/apache/seatunnel/commit/06c59a25f3 | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Fix the error of extracting primary key column in sink (#4815) | https://github.com/apache/seatunnel/commit/0eff3aeed0 | 2.3.2 |
| [Hotfix][Connector][Jdbc] Fix reconnect throw close statement exception (#4801) | https://github.com/apache/seatunnel/commit/ea3bc1a673 | 2.3.2 |
| [Hotfix][Connector][Jdbc] Fix sqlserver system table case sensitivity (#4806) | https://github.com/apache/seatunnel/commit/2ca7426d22 | 2.3.2 |
| [Hotfix][Jdbc][Oracle] Fix oracle sql table identifier (#4754) | https://github.com/apache/seatunnel/commit/84cb51ff83 | 2.3.2 |
| [Improve][Jdbc] Populate primary key when jdbc sink is created using CatalogTable (#4755) | https://github.com/apache/seatunnel/commit/4af3bf9015 | 2.3.2 |
| [Feature][PostgreSQL-jdbc] Supports GEOMETRY data type for PostgreSQL… (#4673) | https://github.com/apache/seatunnel/commit/a5af4d9b6e | 2.3.2 |
| [Improve][Core] Add check of sink and source config to avoid null pointer exception. (#4734) | https://github.com/apache/seatunnel/commit/8f66ce96cb | 2.3.2 |
| [Hotfix][JDBC-SINK] Fix TiDBCatalog without open (#4718) | https://github.com/apache/seatunnel/commit/34a7f3eaa4 | 2.3.2 |
| [Feature][E2E] Add mysql-cdc e2e testcase (#4639) | https://github.com/apache/seatunnel/commit/87001dfd16 | 2.3.2 |
| [Hotfix][JDBC Sink] Fix JDBC Sink oom bug (#4690) | https://github.com/apache/seatunnel/commit/08b6f992aa | 2.3.2 |
| Improve the option rule for jdbc sink (#4694) | https://github.com/apache/seatunnel/commit/a6b3704414 | 2.3.2 |
| [feature][catalog] Support for multiplexing connections (#4550) | https://github.com/apache/seatunnel/commit/41277d7f78 | 2.3.2 |
| [Bugfix][Jdbc-Mysql Mysql-CDC] Fix MySQL BIT type incorrectly converted to Boolean type (#4671) | https://github.com/apache/seatunnel/commit/89b0099ff4 | 2.3.2 |
| [Hotfix]Jdbc[SqlServer] Fix sqlserver jdbc url parse (#4697) | https://github.com/apache/seatunnel/commit/b24c3226ec | 2.3.2 |
| Revert "[Improve][Catalog] refactor catalog (#4540)" (#4628) | https://github.com/apache/seatunnel/commit/2d1933195d | 2.3.2 |
| [Feature][Connector][Jdbc] Add DataTypeConvertor for JDBC-Postgres (#4575) | https://github.com/apache/seatunnel/commit/91f5125976 | 2.3.2 |
| [Improve][Catalog] refactor catalog (#4540) | https://github.com/apache/seatunnel/commit/b0a701cb83 | 2.3.2 |
| [Bug][JDBC Source] fix split exception when source table is empty (#4570) | https://github.com/apache/seatunnel/commit/c73b9331ce | 2.3.2 |
| [Feature][Connector][Jdbc] Add vertica connector. (#4303) | https://github.com/apache/seatunnel/commit/e6b4f98721 | 2.3.2 |
| [Hotfix][Catalog] Filter out unavailable constrain keys (#4557) | https://github.com/apache/seatunnel/commit/5e5859546a | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Simple sql has the highest priority (#4548) | https://github.com/apache/seatunnel/commit/74d4d24858 | 2.3.2 |
| [Improve][Connector-V2][Jdbc] Jdbc source supports factory SPI (#4264) | https://github.com/apache/seatunnel/commit/a97f33797d | 2.3.2 |
| [Jdbc][Chore] improve the exception message when primary key not found in row (#4474) | https://github.com/apache/seatunnel/commit/06fa850da9 | 2.3.2 |
| [hotfix][JDBC] Fix the table name is not automatically obtained when multiple tables (#4514) | https://github.com/apache/seatunnel/commit/c84d6f8d11 | 2.3.2 |
| [Chore][Jdbc] add the log for sql and update some style (#4475) | https://github.com/apache/seatunnel/commit/a9e6503045 | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Set default value to false of JdbcOption: generate_sink_sql (#4471) | https://github.com/apache/seatunnel/commit/7da11c2f44 | 2.3.2 |
| [feature][jdbc][TiDB] add TiDB catalog (#4438) | https://github.com/apache/seatunnel/commit/9a32db6fc0 | 2.3.2 |
| [Hotfix][Connector] Fix sqlserver catalog (#4441) | https://github.com/apache/seatunnel/commit/8540c7f9f3 | 2.3.2 |
| [Feature][CDC][SqlServer] Support multi-table read (#4377) | https://github.com/apache/seatunnel/commit/c4e3f2dc03 | 2.3.2 |
| [Improve][JdbcSink]Fix connection failure caused by connection timeout. (#4322) | https://github.com/apache/seatunnel/commit/e1f6d3b3fd | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Field aliases are not supported in the query of jdbc source. (#4158) (#4210) | https://github.com/apache/seatunnel/commit/3d7ff831f9 | 2.3.1 |
| Change file type to file_format_type in file source/sink (#4249) | https://github.com/apache/seatunnel/commit/973a2fae3c | 2.3.1 |
| Change redshift type to lowercase (#4248) | https://github.com/apache/seatunnel/commit/10447ae103 | 2.3.1 |
| Add redshift datatype convertor (#4245) | https://github.com/apache/seatunnel/commit/b19011517f | 2.3.1 |
| [improve][zeta] fix zeta bugs | https://github.com/apache/seatunnel/commit/3a82e8b39f | 2.3.1 |
| [Improve] Support MySqlCatalog Use JDBC URL With Custom Suffix | https://github.com/apache/seatunnel/commit/210d0ff1f8 | 2.3.1 |
| [hotfix] fixed jdbc IT error | https://github.com/apache/seatunnel/commit/dd20af0a9e | 2.3.1 |
| Merge branch 'dev' into merge/cdc | https://github.com/apache/seatunnel/commit/4324ee1912 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. | https://github.com/apache/seatunnel/commit/423b583038 | 2.3.1 |
| [improve][jdbc] use ReadonlyConfig instead of Config (#4236) | https://github.com/apache/seatunnel/commit/c90c58e243 | 2.3.1 |
| [Improve][Jdbc-sink] add database field to sink config (#4199) | https://github.com/apache/seatunnel/commit/ec368902f4 | 2.3.1 |
| [improve][jdbc] Reduce jdbc options configuration (#4218) | https://github.com/apache/seatunnel/commit/ddd8f808b5 | 2.3.1 |
| Fix mysql get default value (#4204) | https://github.com/apache/seatunnel/commit/6848434f2d | 2.3.1 |
| [hotfix][zeta] fix zeta multi-table parser error (#4193) | https://github.com/apache/seatunnel/commit/98f2ad0c19 | 2.3.1 |
| [Improve] Remove AUTO_COMMIT To Optional In JDBC OptionRule (#4194) | https://github.com/apache/seatunnel/commit/9d088017a3 | 2.3.1 |
| [Improve][Connector-V2] [StarRocks] Starrocks Support Auto Create Table (#4177) | https://github.com/apache/seatunnel/commit/7e0008e6fb | 2.3.1 |
| [improve][catalog][jdbc] Add MySQL catalog factory (#4168) | https://github.com/apache/seatunnel/commit/95e3cbf875 | 2.3.1 |
| [Improve][build] Give the maven module a human readable name (#4114) | https://github.com/apache/seatunnel/commit/d7cd601051 | 2.3.1 |
| Add convertor factory (#4119) | https://github.com/apache/seatunnel/commit/cbdea45d95 | 2.3.1 |
| Add ElasticSearch catalog (#4108) | https://github.com/apache/seatunnel/commit/9ee4d8394c | 2.3.1 |
| Add Kafka catalog (#4106) | https://github.com/apache/seatunnel/commit/34f1f21e48 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. (#4101) | https://github.com/apache/seatunnel/commit/a2ab166561 | 2.3.1 |
| Add DataTypeConvertor in Catalog (#4094) | https://github.com/apache/seatunnel/commit/840c3e5eb4 | 2.3.1 |
| [Feature][Catalog] Support create/drop table, create/drop database in catalog (#4075) | https://github.com/apache/seatunnel/commit/d8a0be84ca | 2.3.1 |
| [Bug][Connector-V2][Jdbc] Fixed no exception throwing problem (#3957) | https://github.com/apache/seatunnel/commit/6ab266e594 | 2.3.1 |
| [Bug][CDC] Fix jdbc sink generate update sql (#3940) | https://github.com/apache/seatunnel/commit/233465d4e4 | 2.3.1 |
| [Improve][JDBC] improve jdbc sink option (#3864) | https://github.com/apache/seatunnel/commit/768a9300e8 | 2.3.1 |
| Fix Source Class Support Parallelism judge & Add UT for it (#3878) | https://github.com/apache/seatunnel/commit/ce85a8c68b | 2.3.1 |
| [Feature][Connector] add get source method to all source connector (#3846) | https://github.com/apache/seatunnel/commit/417178fb84 | 2.3.1 |
| [Feature][Connector-V2] Jdbc connector support SAP HANA. (#3017) | https://github.com/apache/seatunnel/commit/fe0180fab2 | 2.3.1 |
| [Feature][API & Connector & Doc] add parallelism and column projection interface (#3829) | https://github.com/apache/seatunnel/commit/b9164b8ba1 | 2.3.1 |
| [Improve][JDBC Connector]improve option rule (#3802) | https://github.com/apache/seatunnel/commit/139256741a | 2.3.1 |
| [Hotfix][Jdbc Sink] fix xa transaction commit failure on pipeline restore (#3809) | https://github.com/apache/seatunnel/commit/39dae4cfd9 | 2.3.1 |
| [Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector (#3750) | https://github.com/apache/seatunnel/commit/5328e9d847 | 2.3.1 |
| [Improve][Connector-v2] Remove unused options for jdbc source factory (#3794) | https://github.com/apache/seatunnel/commit/861004d309 | 2.3.1 |
| [Feature][Connector-jdbc] Fix JDBC Connector Throw Exception Error. (#3796) | https://github.com/apache/seatunnel/commit/38646b11b8 | 2.3.1 |
| [hotfix][ST-Engine] fix jdbc connector exactly-once null pointer (#3730) | https://github.com/apache/seatunnel/commit/0c5986fbec | 2.3.0 |
| [Improve][connector-jdbc] Add config item enable upsert by query (#3708) | https://github.com/apache/seatunnel/commit/e1f951f782 | 2.3.0 |
| [Hotfix][connector-v2] fix SemanticXidGenerator#generateXid indexOutOfBounds #3701 (#3705) | https://github.com/apache/seatunnel/commit/f351ceaf4b | 2.3.0 |
| [Hotfix][Connector-V2][jdbc] fix jdbc connection reset bug (#3670) | https://github.com/apache/seatunnel/commit/6fe0e6aece | 2.3.0 |
| [Improve][Connector-V2][JDBC] Unified exception for JDBC source & sink (#3598) | https://github.com/apache/seatunnel/commit/865ca2bba9 | 2.3.0 |
| [Connector][JDBC]Support Redshift sink and source (#3615) | https://github.com/apache/seatunnel/commit/8d9d8638d2 | 2.3.0 |
| [Improve][Connectors-V2][jdbc] Adapts to multiple versions of Flink #3589 | https://github.com/apache/seatunnel/commit/e77fdbbef7 | 2.3.0 |
| [Hotfix][OptionRule] Fix option rule about all connectors (#3592) | https://github.com/apache/seatunnel/commit/226dc6a119 | 2.3.0 |
| [Feature][Connector-V2][Doris]Add Doris Source & Sink connector (#3586) | https://github.com/apache/seatunnel/commit/3d46b79614 | 2.3.0 |
| [Feature][Connector-V2][Teradata] Add Teradata Source And Sink Connector | https://github.com/apache/seatunnel/commit/3a095d30fd | 2.3.0 |
| [Feature][Connector-V2][JDBC] support sqlite Source & Sink (#3089) | https://github.com/apache/seatunnel/commit/a73bb3e714 | 2.3.0 |
| Bump postgresql in /seatunnel-connectors-v2/connector-jdbc (#3559) | https://github.com/apache/seatunnel/commit/c8dfdf3e46 | 2.3.0 |
| [feature][connector][cdc] add SeaTunnelRowDebeziumDeserializeSchema (#3499) | https://github.com/apache/seatunnel/commit/ff44db116e | 2.3.0 |
| [JDBC][ORACLE] Improve Oracle Type to SeaTunnel Type Mapping (#3486) | https://github.com/apache/seatunnel/commit/8fe0dda6e2 | 2.3.0 |
| [JDBC][Config] Add JDBC Fetch Size Config And Custom Postgres PrepareStatement (#3478) | https://github.com/apache/seatunnel/commit/d60a705f5d | 2.3.0 |
| [feature][connector][jdbc] expose configurable options in JDBC (#3410) | https://github.com/apache/seatunnel/commit/72b8a73cab | 2.3.0 |
| [feature][connector][jdbc] Support write cdc changelog event in jdbc sink (#3444) | https://github.com/apache/seatunnel/commit/b12a908f01 | 2.3.0 |
| [Improve][Connector-v2][Jdbc] Add AutoCommit to jdbcConfig (#3453) | https://github.com/apache/seatunnel/commit/cfb1e97853 | 2.3.0 |
| [Improve][Connector-v2] Unset AutoCommit default to true (#3451) | https://github.com/apache/seatunnel/commit/439f686d92 | 2.3.0 |
| [Feature][connector-v2] add tablestore source and sink (#3309) | https://github.com/apache/seatunnel/commit/ebebf0b633 | 2.3.0 |
| Close jdbc connection after use. (#3358) | https://github.com/apache/seatunnel/commit/219fea517c | 2.3.0 |
| [Improve][Engine] Improve Engine performance. (#3216) | https://github.com/apache/seatunnel/commit/7393c47327 | 2.3.0 |
| [Bug][Connector-V2][JDBC]fix jdbc split bug (#3220) | https://github.com/apache/seatunnel/commit/40d67ab902 | 2.3.0 |
| [Feature][Connector-V2][JDBC] Support DB2 Source & Sink (#2410) | https://github.com/apache/seatunnel/commit/bf1ef69e84 | 2.3.0 |
| update org.postgresql:postgresql 42.3.3 to 42.4.1 (#3097) | https://github.com/apache/seatunnel/commit/2852516490 | 2.3.0 |
| [Feature][Connector-V2][Jdbc] support gbase 8a (#3026) | https://github.com/apache/seatunnel/commit/dc6e85d06f | 2.3.0-beta |
| [Bug][sqlserver] timestamp convert exception (#3024) | https://github.com/apache/seatunnel/commit/99ac1a655e | 2.3.0-beta |
| [Feature][Connector-V2] oracle connector (#2550) | https://github.com/apache/seatunnel/commit/384ece1913 | 2.3.0-beta |
| [Improve][Connector-v2][jdbc] Support for specify number of partitions when parallel reading (#2950) | https://github.com/apache/seatunnel/commit/fc284ac32e | 2.3.0-beta |
| [Feature][Connector-V2] add sqlserver connector (#2646) | https://github.com/apache/seatunnel/commit/05d105dea3 | 2.3.0-beta |
| [Improve][e2e] Unified e2e IT for DaMengDB (#2946) | https://github.com/apache/seatunnel/commit/15636bdea1 | 2.3.0-beta |
| [Improve][e2e] modify DM-driver by downLoad and add the value comparison of all columns (#2772) | https://github.com/apache/seatunnel/commit/f3ff39bdfe | 2.3.0-beta |
| [Improve][e2e] Improve jdbc driver management (#2770) | https://github.com/apache/seatunnel/commit/f907927a35 | 2.3.0-beta |
| [hotfix][connector][jdbc] fix JDBC split exception (#2904) | https://github.com/apache/seatunnel/commit/57342c6545 | 2.3.0-beta |
| [Improve][connector-jdbc] Calculate splits only once in JdbcSourceSplitEnumerator (#2900) | https://github.com/apache/seatunnel/commit/7622f28999 | 2.3.0-beta |
| [Feature][Connector-V2 E2E] Add mysql and postgres e2e test and bug fix (#2838) | https://github.com/apache/seatunnel/commit/db434adc15 | 2.2.0-beta |
| fix XAConnection being wrongly submitted (#2805) | https://github.com/apache/seatunnel/commit/d9a6039fd3 | 2.2.0-beta |
| fix spark execute exception is not thrown (#2791) | https://github.com/apache/seatunnel/commit/b1711c984e | 2.2.0-beta |
| [Improve][e2e] Add driver-jar to lib (#2719) | https://github.com/apache/seatunnel/commit/d64d452c86 | 2.2.0-beta |
| [DEV][Api] Replace SeaTunnelContext with JobContext and remove singleton pattern (#2706) | https://github.com/apache/seatunnel/commit/cbf82f755c | 2.2.0-beta |
| [Connector-V2][JDBC-connector] support Jdbc dm (#2377) | https://github.com/apache/seatunnel/commit/7278209ca2 | 2.2.0-beta |
| [#2606]Dependency management split (#2630) | https://github.com/apache/seatunnel/commit/fc047be69b | 2.2.0-beta |
| [Bug][connector-jdbc-v2] Fix transaction force commit when autoCommit is enabled (#2636) | https://github.com/apache/seatunnel/commit/8cd8cf7aa2 | 2.2.0-beta |
| [Feature][Connector-V2] Add phoenix connector sink (#2499) | https://github.com/apache/seatunnel/commit/05ccf9d68c | 2.2.0-beta |
| [Connector-V2][JDBC] Support database: greenplum (#2429) | https://github.com/apache/seatunnel/commit/3561d3878f | 2.2.0-beta |
| Add jdbc connector e2e test (#2321) | https://github.com/apache/seatunnel/commit/5fbcb811c6 | 2.2.0-beta |
StateT of SeaTunnelSource should extend Serializable (#2214) | https://github.com/apache/seatunnel/commit/8c426ef850 | 2.2.0-beta |
| update the condition to 1 = 0 about get table operation (#2186) | https://github.com/apache/seatunnel/commit/7c56d7143b | 2.2.0-beta |
| [SeaTunnel API][Sink] remove useless context field (#2124) | https://github.com/apache/seatunnel/commit/a31fdeedcc | 2.2.0-beta |
| [bugfix] Check isOpen before closing (#2107) | https://github.com/apache/seatunnel/commit/7ec0ada2b9 | 2.2.0-beta |
| [API-DRAFT][MERGE] fix merge error | https://github.com/apache/seatunnel/commit/3c0e984648 | 2.2.0-beta |
| merge dev to api-draft | https://github.com/apache/seatunnel/commit/d265597c64 | 2.2.0-beta |
| [api-draft][Optimize] Optimize module name (#2062) | https://github.com/apache/seatunnel/commit/f79e3112b1 | 2.2.0-beta |