⭐️
PostgreSql
JDBC PostgreSql 数据接收器
支持的引擎
Spark
Flink
SeaTunnel Zeta
描述
PostgreSQL Sink 连接器通过 JDBC 驱动将行写入 PostgreSQL 数据库。支持批处理模式和流式模式， 写入并发度由作业或管道的并行度控制，并通过 XA 事务保证精确一次语义。
当上游数据需要落到关系型数据库，并且目标表遵循下方“数据类型映射”小节中描述的标准 PostgreSQL
类型体系时，可以使用该连接器。它既可以写入固定的 database.table，也可以根据 schema 自动生成
INSERT 语句，或者使用自定义的 query 模板，因此既适合 CDC 场景，也适合纯批量加载场景。
使用依赖
对于 Spark/Flink 引擎
- 您需要确保 jdbc 驱动 jar 包 已放置在目录
${SEATUNNEL_HOME}/plugins/中。
对于 SeaTunnel Zeta 引擎
- 您需要确保 jdbc 驱动 jar 包 已放置在目录
${SEATUNNEL_HOME}/lib/中。
主要特性
精确一次要求目标数据库支持 XA 事务。需要设置 is_exactly_once=true、
max_retries=0，并提供对应的 xa_data_source_class_name。
支持的数据源信息
| 数据源 | 支持的版本 | 驱动 | URL | Maven |
|---|---|---|---|---|
| PostgreSQL | 不同的依赖版本有不同的驱动类。 | org.postgresql.Driver | jdbc:postgresql://localhost:5432/test | 下载 |
| PostgreSQL | 如果您想在 PostgreSQL 中处理 GEOMETRY 类型。 | org.postgresql.Driver | jdbc:postgresql://localhost:5432/test | 下载 |
数据库依赖
请下载与 'Maven' 对应的支持列表，并将其复制到 '$SEATUNNEL_HOME/plugins/jdbc/lib/' 工作目录中。
例如 PostgreSQL 数据源：cp postgresql-xxx.jar $SEATUNNEL_HOME/plugins/jdbc/lib/
如果您想在 PostgreSQL 中处理 GEOMETRY 类型，请将postgresql-xxx.jar和postgis-jdbc-xxx.jar添加到$SEATUNNEL_HOME/plugins/jdbc/lib/中。
数据类型映射
| PostgreSQL 数据类型 | SeaTunnel 数据类型 |
|---|---|
| BOOL | BOOLEAN |
| _BOOL | ARRAY<BOOLEAN> |
| BYTEA | BYTES |
| _BYTEA | ARRAY<TINYINT> |
| INT2 SMALLSERIAL INT4 SERIAL | INT |
| _INT2 _INT4 | ARRAY<INT> |
| INT8 BIGSERIAL | BIGINT |
| _INT8 | ARRAY<BIGINT> |
| FLOAT4 | FLOAT |
| _FLOAT4 | ARRAY<FLOAT> |
| FLOAT8 | DOUBLE |
| _FLOAT8 | ARRAY<DOUBLE> |
| NUMERIC(指定列的列大小>0) | DECIMAL(指定列的列大小，获取指定列小数点右侧的数字位数) |
| NUMERIC(指定列的列大小<0) | DECIMAL(38, 18) |
| BPCHAR CHARACTER VARCHAR TEXT GEOMETRY GEOGRAPHY JSON JSONB UUID | STRING |
| _BPCHAR _CHARACTER _VARCHAR _TEXT | ARRAY<STRING> |
| TIMESTAMP | TIMESTAMP |
| TIME | TIME |
| DATE | DATE |
| 其他数据类型 | 目前不支持 |
选项
| 名称 | 类型 | 必填 | 默认 | 描述 |
|---|---|---|---|---|
| url | String | 是 | - | JDBC 连接的 URL。参见示例：jdbc:postgresql://localhost:5432/test 如果您使用 json 或 jsonb 类型插入，请添加 jdbc url 字符串 stringtype=unspecified 选项。 |
| driver | String | 是 | - | 用于连接远程数据源的 JDBC 类名， 如果使用 PostgreSQL，则该值为 org.postgresql.Driver。 |
| username | String | 否 | - | 连接实例的用户名。 |
| password | String | 否 | - | 连接实例的密码。 |
| query | String | 否 | - | 使用此 SQL 将上游输入数据写入数据库。例如 INSERT ...，query 的优先级更高。 |
| database | String | 否 | - | 使用此 database 和 table-name 自动生成 SQL，并接收上游输入数据写入数据库。仅当 generate_sink_sql = true 时用于自动生成 SQL；设置 query 时以 query 为准 |
| table | String | 否 | - | 使用数据库和此表名自动生成 SQL，并接收上游输入数据写入数据库。 仅当 generate_sink_sql = true 时用于自动生成 SQL；设置 query 时以 query 为准表参数可以填写一个不想的表的名称，最终将作为创建表的表名，并支持变量（${table_name}，${schema_name}）。替换规则： ${schema_name} 将替换为传递给目标端的 SCHEMA 名称，${table_name} 将替换为传递给目标端的表名称。 |
| primary_keys | Array | 否 | - | 此选项用于支持在自动生成 SQL 时进行 insert，delete 和 update 操作。 |
| connection_check_timeout_sec | Int | 否 | 30 | 用于验证连接的数据库操作完成的等待时间（秒）。 |
| max_retries | Int | 否 | 0 | 提交失败的重试次数（executeBatch）。 |
| batch_size | Int | 否 | 1000 | 对于批量写入，当缓冲记录的数量达到 batch_size 或时间达到 checkpoint.interval时，数据将刷新到数据库。 |
| batch_interval_ms | Long | 否 | 0 | 写入触发的定时刷新间隔，单位毫秒。0 表示关闭定时刷新；大于 0 时，写入器会在每条记录写入时检查间隔，达到间隔后同步刷新。 |
| is_exactly_once | Boolean | 否 | false | 是否启用精确一次语义，将使用 XA 事务。如果启用，您需要 设置 xa_data_source_class_name。 |
| generate_sink_sql | Boolean | 否 | false | 根据要写入的数据库表生成 SQL 语句。 |
| xa_data_source_class_name | String | 否 | - | 数据库驱动的 XA 数据源类名，例如，PostgreSQL 是 org.postgresql.xa.PGXADataSource，并请参阅附录以获取其他数据源。 |
| max_commit_attempts | Int | 否 | 3 | 事务提交失败的重试次数。 |
| transaction_timeout_sec | Int | 否 | -1 | 事务开启后的超时时间，默认值为 -1（永不超时）。注意设置超时可能会影响 精确一次语义。 |
| auto_commit | Boolean | 否 | true | 默认启用自动事务提交。 |
| field_ide | String | 否 | - | 识别字段在从源到 Sink 的同步时是否需要转换。ORIGINAL 表示无需转换；UPPERCASE 表示转换为大写；LOWERCASE 表示转换为小写。 |
| properties | Map | 否 | - | 附加连接配置参数，当 properties 和 URL 具有相同参数时，优先级由 驱动的具体实现决定。例如，在 MySQL 中，properties 优先于 URL。 |
| common-options | 否 | - | Sink 插件的公共参数，请参阅 Sink 公共选项 以获取详细信息。 | |
| schema_save_mode | Enum | 否 | CREATE_SCHEMA_WHEN_NOT_EXIST | 在同步任务开启之前，根据目标端现有表结构选择不同处理方案。 |
| data_save_mode | Enum | 否 | APPEND_DATA | 在同步任务开启之前，根据目标端现有数据选择不同处理方案。 |
| custom_sql | String | 否 | - | 当 data_save_mode 选择 CUSTOM_PROCESSING 时，您应该填写 CUSTOM_SQL 参数。此参数通常填入可执行的 SQL。SQL 将在同步任务之前执行。 |
| enable_upsert | Boolean | 否 | true | 通过主键存在启用 upsert，如果任务没有重复数据，设置此参数为 false 可以加快数据导入。 |
| use_copy_statement | Boolean | 否 | false | 直接使用 PostgreSQL COPY <table> (...) FROM STDIN WITH CSV 进行批量导入。该选项优先级高于常规 INSERT / UPSERT 路径；要求 JDBC 驱动连接对象提供 getCopyAPI()，且当前不支持 MAP、ARRAY、ROW 类型。 |
| multi_table_sink_replica | Int | 否 | 1 | 多表写入时使用的 Sink Writer 副本数量。 |
table [字符串]
使用 database 和此 table-name 自动生成 SQL，并接收上游输入数据写入数据库。
仅当 generate_sink_sql = true 时用于自动生成 SQL；设置 query 时以 query 为准
表参数可以填写一个不想的表的名称，最终将作为创建表的表名，并支持变量（${table_name}，${schema_name}）。替换规则：${schema_name} 将替换为传递给目标端的 SCHEMA 名称，${table_name} 将替换为传递给目标端的表名称。
例如：
${schema_name}.${table_name}_testdbo.tt_${table_name}_sinkpublic.sink_table
schema_save_mode [枚举]
在同步任务开启之前，根据目标端现有表结构选择不同处理方案。
选项介绍：
RECREATE_SCHEMA ：当表不存在时将创建，保存时删除并重建。
CREATE_SCHEMA_WHEN_NOT_EXIST ：当表不存在时创建，保存时跳过。
ERROR_WHEN_SCHEMA_NOT_EXIST ：当表不存在时报告错误。
IGNORE ：忽略对表的处理。
data_save_mode [枚举]
在同步任务开启之前，根据目标端现有数据选择不同处理方案。
选项介绍：
DROP_DATA：保留数据库结构并删除数据。
APPEND_DATA：保留数据库结构，保留数据。
CUSTOM_PROCESSING：用户定义处理。
ERROR_WHEN_DATA_EXISTS：当存在数据时报告错误。
custom_sql [字符串]
当 data_save_mode 选择 CUSTOM_PROCESSING 时，您应该填写 CUSTOM_SQL 参数。此参数通常填入可以执行的 SQL。SQL 将在同步任务之前执行。
提示
Sink 的写入并发度由作业或管道的并行度决定。
partition_column是 JDBC Source 用于拆分读取的选项，不控制 Sink 的写入分配。
任务示例
简单示例
此示例定义了一个 SeaTunnel 同步任务，通过 FakeSource 自动生成数据并将其发送到 JDBC Sink。FakeSource 生成总共 16 行数据（
row.num=16），每行有两个字段，name（字符串类型）和age（整数类型）。最终目标表test_table也将包含 16 行数据。在运行此作业之前，您需要在 PostgreSQL 中创建数据库test和表test_table。如果您还未安装和部署 SeaTunnel，请按照 安装 SeaTunnel 中的说明进行安装和部署。然后按照 快速开始 SeaTunnel 引擎 中的说明运行此作业。
# Defining the runtime environment
env {
parallelism = 1
job.mode = "BATCH"
}
source {
FakeSource {
parallelism = 1
plugin_output = "fake"
row.num = 16
schema = {
fields {
name = "string"
age = "int"
}
}
}
# If you would like to get more information about how to configure seatunnel and see full list of source plugins,
# please go to https://seatunnel.apache.org/docs/connectors/source
}
transform {
# If you would like to get more information about how to configure seatunnel and see full list of transform plugins,
# please go to https://seatunnel.apache.org/docs/transforms
}
sink {
jdbc {
# if you would use json or jsonb type insert please add jdbc url stringtype=unspecified option
url = "jdbc:postgresql://localhost:5432/test"
driver = "org.postgresql.Driver"
username = root
password = 123456
query = "insert into test_table(name,age) values(?,?)"
}
# If you would like to get more information about how to configure seatunnel and see full list of sink plugins,
# please go to https://seatunnel.apache.org/docs/connectors/sink
}
生成 Sink SQL
此示例不需要编写复杂的 SQL 语句，您可以配置数据库名称和表名称，系统将自动为您生成添加语句。
sink {
Jdbc {
# if you would use json or jsonb type insert please add jdbc url stringtype=unspecified option
url = "jdbc:postgresql://localhost:5432/test"
driver = org.postgresql.Driver
username = root
password = 123456
generate_sink_sql = true
database = test
table = "public.test_table"
}
}
精确一次
对于精确写入场景，我们保证精确一次。
sink {
jdbc {
# if you would use json or jsonb type insert please add jdbc url stringtype=unspecified option
url = "jdbc:postgresql://localhost:5432/test"
driver = "org.postgresql.Driver"
max_retries = 0
username = root
password = 123456
query = "insert into test_table(name,age) values(?,?)"
is_exactly_once = "true"
xa_data_source_class_name = "org.postgresql.xa.PGXADataSource"
}
}
CDC（变更数据捕获）事件
我们也支持 CDC 变更数据。在这种情况下，您需要配置数据库、表和主键。
sink {
jdbc {
# if you would use json or jsonb type insert please add jdbc url stringtype=unspecified option
url = "jdbc:postgresql://localhost:5432/test"
driver = "org.postgresql.Driver"
username = root
password = 123456
generate_sink_sql = true
# You need to configure both database and table
database = test
table = sink_table
primary_keys = ["id","name"]
field_ide = UPPERCASE
}
}
保存模式功能
sink {
Jdbc {
# if you would use json or jsonb type insert please add jdbc url stringtype=unspecified option
url = "jdbc:postgresql://localhost:5432/test"
driver = org.postgresql.Driver
username = root
password = 123456
generate_sink_sql = true
database = test
table = "public.test_table"
schema_save_mode = "CREATE_SCHEMA_WHEN_NOT_EXIST"
data_save_mode="APPEND_DATA"
}
}
常见问题
PostgreSQL Sink 什么时候会生成 ON CONFLICT？
只有在最终拿到了主键/唯一键信息，并且 enable_upsert = true 时，PostgreSQL Sink 才会生成
INSERT ... ON CONFLICT (...) DO UPDATE。
这个 key 可以来自两种地方：
- 你显式配置的
primary_keys - 你没有显式配置时，SeaTunnel 从上游 catalog 元数据继承到的主键；如果没有主键，还会尝试第一组 unique key
如果所有字段本身都是主键，没有可更新列，PostgreSQL 会退化为
ON CONFLICT (...) DO NOTHING。
目标表没有主键时会发生什么？
如果既没有显式配置 primary_keys，上游元数据里也没有可继承的主键或 unique key，
PostgreSQL Sink 会退回普通 INSERT，不会生成 ON CONFLICT。进入这个无 key 模式后，
Sink 也不会再使用按 RowKind 执行 UPDATE / DELETE 的写入器，因此 CDC 输入会实质上退化为普通
INSERT batching。这时重复键是否报错，完全取决于目标表自身约束。
use_copy_statement 和 enable_upsert 应该怎么选？
use_copy_statement = true 会优先进入 PostgreSQL COPY 批量导入路径，而不是常规 INSERT / UPSERT 语句。也就是说，即使同时配置了 primary_keys 和 enable_upsert = true，COPY 仍然会优先执行。
适合开启 COPY 的场景：
- 目标是 PostgreSQL
- 重点是高吞吐批量导入
- 不依赖
ON CONFLICT处理重复键覆盖逻辑
不适合开启 COPY 的场景：
- 你希望通过 PostgreSQL 原生 upsert 语义处理冲突
- 你的数据包含
MAP、ARRAY、ROW类型 - 当前 JDBC 驱动连接对象不提供
getCopyAPI()
流式定时刷新
对于长时间运行的流式作业，可以同时设置 batch_size 与 batch_interval_ms。刷新是写入触发的：每条记录进入写入路径时都会检查缓冲行数和耗时，达到任一阈值就同步刷新，并没有后台调度线程。因此在空闲（没有新记录）的时段，缓冲行会一直保留到下一条记录到达或下一个 checkpoint 完成——batch_interval_ms 自身并不能保证严格的 wall-clock 时延边界，生产环境建议把 batch_interval_ms 设为几秒以上。
env {
parallelism = 2
job.mode = "STREAMING"
checkpoint.interval = 10000
}
sink {
Jdbc {
url = "jdbc:postgresql://datasource01:5432/demo"
driver = "org.postgresql.Driver"
username = "postgres"
password = "postgres"
generate_sink_sql = true
database = "demo"
table = "public.orders_sink"
primary_keys = ["id"]
batch_size = 2000
batch_interval_ms = 5000
}
}
使用占位符的多表写入
当上游行携带表标识时，可以在 table 中使用 ${schema_name} 和 ${table_name} 占位符，把每行路由到对应的目标表。配合 multi_table_sink_replica，SeaTunnel 并行写入多张表。
sink {
Jdbc {
url = "jdbc:postgresql://datasource01:5432/demo"
driver = "org.postgresql.Driver"
username = "postgres"
password = "postgres"
generate_sink_sql = true
database = "demo"
table = "${schema_name}.${table_name}_SINK"
primary_keys = ["id"]
multi_table_sink_replica = 2
}
}
变更日志
Change Log
| Change | Commit | Version |
|---|---|---|
| [Fix][Connector-xugu] Fix several bugs in the xugu connector (#9820) | https://github.com/apache/seatunnel/commit/75c9adb280 | dev |
[Feature][Transform-V2] Support AT TIME ZONE statement for sql transform (#9784) | https://github.com/apache/seatunnel/commit/ad5278c5bb | dev |
| [Feature][Transform-V2] Support vector series sql function (#9765) | https://github.com/apache/seatunnel/commit/a40114cf7a | 2.3.12 |
| [Chore] fix typos filed -> field (#9757) | https://github.com/apache/seatunnel/commit/e3e1c67d29 | 2.3.12 |
| [Feature][Core] Add plugin directory support for each connector (#9650) | https://github.com/apache/seatunnel/commit/4beb2b9336 | 2.3.12 |
| [Improve][Core] Update apache common to apache common lang3 (#9694) | https://github.com/apache/seatunnel/commit/6e5737c1ec | 2.3.12 |
| [Improve][API] Optimize the enumerator API semantics and reduce lock calls at the connector level (#9671) | https://github.com/apache/seatunnel/commit/9212a77140 | 2.3.12 |
| [Fix][connector-jdbc] prevent precision loss in Float to BigDecimal conversion (#9670) | https://github.com/apache/seatunnel/commit/6e11285bf6 | 2.3.12 |
| [Fix][Connector-Jdbc] Supports reading and writing Postgres network dress types (#9618) | https://github.com/apache/seatunnel/commit/3dc79c1ddf | 2.3.12 |
| [improve] jdbc options (#9541) | https://github.com/apache/seatunnel/commit/d041e5fb32 | 2.3.12 |
| [Fix][Connector-Jdbc]Fixed Vertica data source cannot upsert data. (#9607) | https://github.com/apache/seatunnel/commit/7b4d05171b | 2.3.12 |
[Fix][Connectors-Jdbc] Postgres supports streaming and batch reading and writing of the interval data type (#9590) | https://github.com/apache/seatunnel/commit/58ab917024 | 2.3.12 |
| [Feature][Connectors-v2] Optimize the size of CDC JAR Files (#9546) | https://github.com/apache/seatunnel/commit/1dd19c6823 | 2.3.12 |
| [improve][Connector-jdbc] add comments when schema not include all columns (#9559) | https://github.com/apache/seatunnel/commit/02d2b69d85 | 2.3.12 |
| [Hotfix][Connector-Jdbc] Write MySQL to support set collection data type (#9553) | https://github.com/apache/seatunnel/commit/3836c97a62 | 2.3.12 |
| [Feature][Jdbc] Support read multiple tables by regular expressions (#9380) | https://github.com/apache/seatunnel/commit/670a52a918 | 2.3.12 |
| [bugfix][Connector-V2] Fixed the load driver inaccurate situation (#9468) | https://github.com/apache/seatunnel/commit/c6639e81fe | 2.3.12 |
| [Fix][Connector-V2] Fix OceanBase Oracle create unsupported data type (#9383) | https://github.com/apache/seatunnel/commit/f4178c72f1 | 2.3.12 |
| [improve][Connector-V2] delete jdbc param support_upsert_by_query_primary_key_exist (#9408) | https://github.com/apache/seatunnel/commit/d247fe1d8d | 2.3.12 |
| [Feature][Connector-V2] Jdbc mysql support read tinyint(1) to byte(tinyint) (#9373) | https://github.com/apache/seatunnel/commit/7b87aa6f12 | 2.3.12 |
| [Improve] JdbcInputFormat nextRecord Exception throw TableId (#9374) | https://github.com/apache/seatunnel/commit/484aef593d | 2.3.12 |
| [Feature][Connector-V2][JDBC] Add presto/trino dialect (#9388) | https://github.com/apache/seatunnel/commit/3cac2bd126 | 2.3.12 |
| [Feature][Connector-JDBC] Supprot read Oracle BLOB data as string instead of bytes (#9305) | https://github.com/apache/seatunnel/commit/454a88f81a | 2.3.11 |
| [Fix][Connector-jdbc] Fix postgresql sink trying to update unique key (#9293) (#9298) | https://github.com/apache/seatunnel/commit/d0c1de8357 | 2.3.11 |
| [Fix][Connector-V2] Fix oceanbase mysql jdbc sink create statement error (#9267) | https://github.com/apache/seatunnel/commit/79f8125ea6 | 2.3.11 |
| [Feature][Transform] Support define sink column type (#9114) | https://github.com/apache/seatunnel/commit/ab7119e507 | 2.3.11 |
| [Feature][Checkpoint] Add check script for source/sink state class serialVersionUID missing (#9118) | https://github.com/apache/seatunnel/commit/4f5adeb1c7 | 2.3.11 |
[Fix][API] Fixed not invoke the SinkAggregatedCommitter's init method (#9070) | https://github.com/apache/seatunnel/commit/df0d11d632 | 2.3.11 |
| [Fix][Connector-V2] Fix SqlServer create table when database with dot (#9007) | https://github.com/apache/seatunnel/commit/e09445c789 | 2.3.11 |
| [Fix][Connector-V2][OceanBase] oceanbase vector support simple vector index (#9072) | https://github.com/apache/seatunnel/commit/4140cd1d8f | 2.3.11 |
| [Improve][Connector-V2] Optimize dialect selection in jdbc (#8820) | https://github.com/apache/seatunnel/commit/92c62c5e63 | 2.3.11 |
| [Fix][JDBC] fix jdbc default connection parameter invalid (#8185) | https://github.com/apache/seatunnel/commit/f85eb78b37 | 2.3.11 |
| [Hotfix][Jdbc] Fix mysql tinyint(1) type mapping for TypeMapper (#9012) | https://github.com/apache/seatunnel/commit/5f85d7668a | 2.3.11 |
| [Feature][Jdbc] Add String type column split Support by charset-based splitting algorithm (#9002) | https://github.com/apache/seatunnel/commit/dbe41e74cd | 2.3.11 |
| [Fix][Paimon] nullable and comment attribute was lost during automatic table creation (#9020) | https://github.com/apache/seatunnel/commit/eb54fdd52c | 2.3.11 |
| [Fix][Connector-JDBC] Fix JDBC driver selection for data source connections (#8986) | https://github.com/apache/seatunnel/commit/a5aafa7301 | 2.3.11 |
| [Improve][Jdbc] Upgrade sap-hana driver from 2.14.7 to 2.23.10 (#9013) | https://github.com/apache/seatunnel/commit/9ba9f169be | 2.3.11 |
| [Feature][Jdbc] Support sink ddl for sqlserver #8114 (#8936) | https://github.com/apache/seatunnel/commit/30aa485b38 | 2.3.10 |
| [Fix][Connector-V2] Fix parse SqlServer JDBC Url error (#8784) | https://github.com/apache/seatunnel/commit/373d2162d3 | 2.3.10 |
| [Improve][Jdbc] Support upsert for opengauss (#8627) | https://github.com/apache/seatunnel/commit/56110bf392 | 2.3.10 |
| [Improve][Jdbc] Remove useless utils. (#8793) | https://github.com/apache/seatunnel/commit/36a7533e85 | 2.3.10 |
| [Improve][Jdbc] Improve catalog connection cache (#8626) | https://github.com/apache/seatunnel/commit/6205065b25 | 2.3.10 |
| [Fix][Connector-V2] Fix jdbc sink statement buffer wrong time to clear (#8653) | https://github.com/apache/seatunnel/commit/cf35eecdfc | 2.3.10 |
| [Feature][Jdbc] Support sink ddl for dameng (#8380) | https://github.com/apache/seatunnel/commit/5ff3427428 | 2.3.10 |
| [Improve] restruct connector common options (#8634) | https://github.com/apache/seatunnel/commit/f3499a6eeb | 2.3.10 |
| [Improve][Jdbc] Remove oracle 'v$database' query (#8571) | https://github.com/apache/seatunnel/commit/3cf09f61ca | 2.3.10 |
| [Fix][Connector-V2] Postgres support for multiple primary keys (#8526) | https://github.com/apache/seatunnel/commit/04db40d973 | 2.3.10 |
| [Feature][JDBC source] pg support char types (#8420) | https://github.com/apache/seatunnel/commit/776ac94478 | 2.3.9 |
| [Feature][Jdbc] Support sink ddl for postgresql (#8276) | https://github.com/apache/seatunnel/commit/353bbd21a1 | 2.3.9 |
| [Feature][Connector-V2] Support the jdbc connector for highgo db (#8282) | https://github.com/apache/seatunnel/commit/aa381cbfb4 | 2.3.9 |
| [Improve][Jdbc] Support nvarchar in dm (#8270) | https://github.com/apache/seatunnel/commit/2f1c54ee2e | 2.3.9 |
| [Improve][Connector-v2] Use regex to match filedName placeholders in jdbc sink (#8222) | https://github.com/apache/seatunnel/commit/c02d4fed36 | 2.3.9 |
| [Improve][Connector-V2] Support read comment when jdbc dialect without catalog (#8196) | https://github.com/apache/seatunnel/commit/567cd54de5 | 2.3.9 |
| [Improve][Connector-V2] The interface supports jdbc respects the target database field type (#8031) | https://github.com/apache/seatunnel/commit/1de056a9a4 | 2.3.9 |
| [Improve][dist]add shade check rule (#8136) | https://github.com/apache/seatunnel/commit/51ef800016 | 2.3.9 |
| [Improve][Jdbc] Improve ddl write validate (#8158) | https://github.com/apache/seatunnel/commit/9cdaacddd9 | 2.3.9 |
| [Feature][Jdbc] Add Jdbc default dialect for all jdbc series database without dialect (#8132) | https://github.com/apache/seatunnel/commit/399eabcd3f | 2.3.9 |
| [Improve][Jdbc] Refactor ddl change (#8134) | https://github.com/apache/seatunnel/commit/e1f0a238f7 | 2.3.9 |
[Feature][Core] Rename result_table_name/source_table_name to plugin_input/plugin_output (#8072) | https://github.com/apache/seatunnel/commit/c7bbd322db | 2.3.9 |
| [Improve][Connector-V2] Improve schema evolution on column insert after for mysql-jdbc (#8017) | https://github.com/apache/seatunnel/commit/3fb05da365 | 2.3.9 |
| [Feature][Core] Support cdc task ddl restore for zeta (#7463) | https://github.com/apache/seatunnel/commit/8e322281ed | 2.3.9 |
| [Feature][transform] transform support explode (#7928) | https://github.com/apache/seatunnel/commit/132278c06a | 2.3.9 |
| [Feature][Connector-v2] Support schema evolution for Oracle connector (#7908) | https://github.com/apache/seatunnel/commit/79406bcc2f | 2.3.9 |
| [Improve][Connector-V2] Improve jdbc merge table from path and query when type is decimal (#7917) | https://github.com/apache/seatunnel/commit/8baa012ced | 2.3.9 |
| [Fix][Connector-V2] Fix hana type loss of precision (#7912) | https://github.com/apache/seatunnel/commit/18dcca36cd | 2.3.9 |
| [Feature][Connector-V2] Jdbc DB2 support upsert SQL (#7879) | https://github.com/apache/seatunnel/commit/139919334d | 2.3.9 |
| [Improve][Jdbc] Optimize index name conflicts when create table for postgresql (#7875) | https://github.com/apache/seatunnel/commit/312ee866fb | 2.3.9 |
| [Improve][Jdbc] Support postgresql inet type. (#7820) | https://github.com/apache/seatunnel/commit/25b68b3623 | 2.3.9 |
| [Fix][Connector-V2]Oceanbase vector database is added as the source server (#7832) | https://github.com/apache/seatunnel/commit/258f931765 | 2.3.9 |
| [Feature][connector-v2]Support opengauss jdbc connnector using opengauss driver. (#7622) | https://github.com/apache/seatunnel/commit/bbf643772e | 2.3.9 |
| [Improve][Jdbc] Support save mode for the sink of jdbc-dm (#7814) | https://github.com/apache/seatunnel/commit/b87d732c81 | 2.3.9 |
| [Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786) | https://github.com/apache/seatunnel/commit/6b7c53d03c | 2.3.9 |
| [Feature][Connector-V2] SqlServer support user-defined type (#7706) | https://github.com/apache/seatunnel/commit/fb89033273 | 2.3.8 |
| [Hotfix][CDC] Fix ddl duplicate execution error when config multi_table_sink_replica (#7634) | https://github.com/apache/seatunnel/commit/23ab3edbbb | 2.3.8 |
| [Feature][Connector-Paimon] Support dynamic bucket splitting improves Paimon writing efficiency (#7335) | https://github.com/apache/seatunnel/commit/bc0326cba8 | 2.3.8 |
| [Fix][Connector-V2] Fix jdbc test case failed (#7690) | https://github.com/apache/seatunnel/commit/4f5d27f625 | 2.3.8 |
| [Improve][Jdbc] Jdbc truncate table should check table not database (#7654) | https://github.com/apache/seatunnel/commit/0c0eb7e41b | 2.3.8 |
| [Feature][Connector-V2] jdbc saphana source tablepath support view and synonym (#7670) | https://github.com/apache/seatunnel/commit/7e0c20a488 | 2.3.8 |
| [Fix][Connector-v2] Throw Exception in sql query for JdbcCatalog in table or db exists query (#7651) | https://github.com/apache/seatunnel/commit/70ec59ce0e | 2.3.8 |
| [Fix][JDBC] Fix starrocks jdbc dialect catalog conflict with starrocks connector (#7578) | https://github.com/apache/seatunnel/commit/020aab422e | 2.3.8 |
| [Feature] Support tidb cdc connector source #7199 (#7477) | https://github.com/apache/seatunnel/commit/87ec786bd6 | 2.3.8 |
| [bugfix] fix oracle query table length (#7627) | https://github.com/apache/seatunnel/commit/2e002ce09b | 2.3.8 |
| [Hotfix][Connector-v2] Fix the NullPointerException for jdbc oracle which used the table_list (#7544) | https://github.com/apache/seatunnel/commit/555028217a | 2.3.8 |
| [Improve][Connector-v2] Support mysql 8.1/8.2/8.3 for jdbc (#7530) | https://github.com/apache/seatunnel/commit/657fe69b26 | 2.3.8 |
| [Improve][Connector-v2] Release resource in closeStatements even exception occurred in executeBatch (#7533) | https://github.com/apache/seatunnel/commit/590f7d110d | 2.3.8 |
| [Fix][Connector-V2] Fix jdbc query sql can not get table path (#7484) | https://github.com/apache/seatunnel/commit/8e0ca8f725 | 2.3.8 |
[Feature][Connector-V2] Add decimal_type_narrowing option in jdbc (#7461) | https://github.com/apache/seatunnel/commit/696f2948fa | 2.3.8 |
| [Improve][Connector-V2] update vectorType (#7446) | https://github.com/apache/seatunnel/commit/1bba72385b | 2.3.8 |
| [Improve][API] Move catalog open to SaveModeHandler (#7439) | https://github.com/apache/seatunnel/commit/8c2c5c79a1 | 2.3.8 |
| [FIX][E2E]Modify the OceanBase test case to the latest imageChange image (#7452) | https://github.com/apache/seatunnel/commit/6abb83deab | 2.3.8 |
| [Feature][Connector-V2][OceanBase] Support vector types on OceanBase (#7375) | https://github.com/apache/seatunnel/commit/a6b188d552 | 2.3.8 |
| [Improve][Connector-V2] Remove system table limit (#7391) | https://github.com/apache/seatunnel/commit/adf888e008 | 2.3.8 |
| [Fix] Fix oracle sample data from column error (#7340) | https://github.com/apache/seatunnel/commit/2130e0d5ad | 2.3.8 |
| [Improve][Connector-V2] Close all ResultSet after used (#7389) | https://github.com/apache/seatunnel/commit/853e973212 | 2.3.8 |
| [Hotifx][Jdbc] Fix MySQL unsupport 'ZEROFILL' column type (#7407) | https://github.com/apache/seatunnel/commit/7130382123 | 2.3.8 |
| [Improvement] add starrocks jdbc dialect (#7294) | https://github.com/apache/seatunnel/commit/b5140f598e | 2.3.8 |
| [Hotfix][Connector] Fix jdbc compile error (#7359) | https://github.com/apache/seatunnel/commit/2769ed5029 | 2.3.7 |
| [Fix][Connector-V2][OceanBase] Remove OceanBase catalog's dependency on mysql driver (#7311) | https://github.com/apache/seatunnel/commit/3130ae089e | 2.3.7 |
| [Improve][Jdbc] Skip all index when auto create table to improve performance of write (#7288) | https://github.com/apache/seatunnel/commit/dc3c23981b | 2.3.7 |
| [Improve][Jdbc] Remove MysqlType references in JdbcDialect (#7333) | https://github.com/apache/seatunnel/commit/16eeb1c123 | 2.3.7 |
| [Improve][Jdbc] Merge user config primary key when create table (#7313) | https://github.com/apache/seatunnel/commit/819c685651 | 2.3.7 |
| [Improve][Connector-v2] Optimize the way of databases and tables are checked for existence (#7261) | https://github.com/apache/seatunnel/commit/f012b2a6f0 | 2.3.7 |
| [Feature][Jdbc] Support hive compatibleMode add inceptor dialect (#7262) | https://github.com/apache/seatunnel/commit/31e59cdf82 | 2.3.6 |
| [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248) | https://github.com/apache/seatunnel/commit/0d08b20061 | 2.3.6 |
| [Feature][Core] Support using upstream table placeholders in sink options and auto replacement (#7131) | https://github.com/apache/seatunnel/commit/c4ca74122c | 2.3.6 |
| [Fix] Fix Hana type converter decimal scale is 0 convert to int error (#7167) | https://github.com/apache/seatunnel/commit/6e33a97c86 | 2.3.6 |
| [Improve][Jdbc] Support write unicode text into sqlserver (#7159) | https://github.com/apache/seatunnel/commit/e44e8b93bc | 2.3.6 |
| [Improve][Jdbc] Remove user info in catalog-table options (#7178) | https://github.com/apache/seatunnel/commit/4e001be25c | 2.3.6 |
| [Improve][connector-v2-jdbc-mysql] Add support for MySQL 8.4 (#7151) | https://github.com/apache/seatunnel/commit/dbdbdf015b | 2.3.6 |
| [Feature][Connector-V2] Support jdbc hana catalog and type convertor (#6950) | https://github.com/apache/seatunnel/commit/d663398739 | 2.3.6 |
| [Improve] Change catalog table log to debug level (#7136) | https://github.com/apache/seatunnel/commit/b111d2f843 | 2.3.6 |
| [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc (#6929) | https://github.com/apache/seatunnel/commit/cf91e51fc7 | 2.3.6 |
| [connector-jdbc][bugfix] fix sqlServer create table comment special string bug (#7024) | https://github.com/apache/seatunnel/commit/403564db13 | 2.3.6 |
| [bugfix] fix pgsql create table comment special string bug (#7022) | https://github.com/apache/seatunnel/commit/9fe844f62a | 2.3.6 |
| [connector-jdbc][bugfix] fix oracle create table comment special string bug (#7012) | https://github.com/apache/seatunnel/commit/a9e0f67873 | 2.3.6 |
| [bugfix] fix mysql create table comment special string bug (#6998) | https://github.com/apache/seatunnel/commit/904e9cf785 | 2.3.6 |
| [Improve][Jdbc]sink sql support custom field.(#6515) (#6525) | https://github.com/apache/seatunnel/commit/ef3e61dbc4 | 2.3.6 |
| [Feature][Jdbc] Support redshift catalog (#6992) | https://github.com/apache/seatunnel/commit/8d5cbcee74 | 2.3.6 |
| [Improve][Connector-V2] Clean key name in catalog table (#6942) | https://github.com/apache/seatunnel/commit/a399ef48c6 | 2.3.6 |
| [Improve][Zeta] Move SaveMode behavior to master (#6843) | https://github.com/apache/seatunnel/commit/80cf91318d | 2.3.6 |
| [Improve][Jdbc] Quotes the identifier for table path (#6951) | https://github.com/apache/seatunnel/commit/d70ec61f35 | 2.3.6 |
| [Hotfix][Jdbc] Fix oracle savemode create table (#6651) | https://github.com/apache/seatunnel/commit/4b6c13e8fc | 2.3.6 |
| [Improve][JDBC Source] Fix Split can not be cancel (#6825) | https://github.com/apache/seatunnel/commit/ee3b7c3723 | 2.3.6 |
| [Feature][Doris] Add Doris type converter (#6354) | https://github.com/apache/seatunnel/commit/5189991843 | 2.3.6 |
| [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684) | https://github.com/apache/seatunnel/commit/868ba4d7c7 | 2.3.6 |
| [Improve][Connector] Add some sqlserver IDENTITY type for catalog (#6822) | https://github.com/apache/seatunnel/commit/f698396555 | 2.3.6 |
| [Feature][Jdbc] Support the jdbc connector for InterSystems IRIS (#6797) | https://github.com/apache/seatunnel/commit/46600969bb | 2.3.6 |
| [Fix][MySQL]: Fix MySqlTypeConverter could not be instantiated (#6781) | https://github.com/apache/seatunnel/commit/a5609d600e | 2.3.6 |
| [Hotfix][Jdbc] Fix table/query columns order merge for jdbc catalog (#6771) | https://github.com/apache/seatunnel/commit/df1954d520 | 2.3.6 |
| [Fix] Fix Oracle type converter handle negative scale in number type (#6758) | https://github.com/apache/seatunnel/commit/6d710690c5 | 2.3.6 |
| [Improve][mysql-cdc] Support mysql 5.5 versions (#6710) | https://github.com/apache/seatunnel/commit/058f5594a3 | 2.3.6 |
| [Improve][Jdbc] Add quote identifier for sql (#6669) | https://github.com/apache/seatunnel/commit/849d748d3d | 2.3.5 |
| [Improve][Jdbc] Increase tyepe converter when auto creating tables (#6617) | https://github.com/apache/seatunnel/commit/cc660206d8 | 2.3.5 |
| [feature][connector-v2] add xugudb connector (#6561) | https://github.com/apache/seatunnel/commit/80f392afbb | 2.3.5 |
| [Hotfix] Fix DEFAULT TABLE problem (#6352) | https://github.com/apache/seatunnel/commit/cdb1856e84 | 2.3.5 |
| [Improve] Improve MultiTableSinkWriter prepare commit performance (#6495) | https://github.com/apache/seatunnel/commit/2086b0e8a6 | 2.3.5 |
| [Improve][JDBC] Optimized code style for getting jdbc field types (#6583) | https://github.com/apache/seatunnel/commit/ddca95f32c | 2.3.5 |
| [Improve] Add SaveMode log of process detail (#6375) | https://github.com/apache/seatunnel/commit/b0d70ce224 | 2.3.5 |
| [Improve][Jdbc] Support custom case-sensitive config for dameng (#6510) | https://github.com/apache/seatunnel/commit/d6dcb03bf3 | 2.3.5 |
| feat: jdbc support copy in statement. (#6443) | https://github.com/apache/seatunnel/commit/ca4a65fc00 | 2.3.5 |
| [Improve][Jdbc] Using varchar2 datatype store string in oracle (#6392) | https://github.com/apache/seatunnel/commit/14405fa8d4 | 2.3.5 |
| [Improve][API] Unify type system api(data & type) (#5872) | https://github.com/apache/seatunnel/commit/b38c7edcc9 | 2.3.5 |
| Fix Jdbc sink target table name error (#6269) | https://github.com/apache/seatunnel/commit/2f62235e38 | 2.3.4 |
| [Improve][JDBC] Use PreparedStatement to sample data from column (#6242) | https://github.com/apache/seatunnel/commit/bd0e66d533 | 2.3.4 |
| [Improve][JDBC-sink] Improve query Approximate Total Row Count of a Table (#5972) | https://github.com/apache/seatunnel/commit/8156036a2f | 2.3.4 |
| [Feature][JDBC、CDC] Support Short and Byte Type in spliter (#6027) | https://github.com/apache/seatunnel/commit/6f8d0a5040 | 2.3.4 |
[Improve] Support int identity type in sql server (#6186) | https://github.com/apache/seatunnel/commit/1a8da1c843 | 2.3.4 |
| [Bugfix][JDBC、CDC] Fix Spliter Error in Case of Extensive Duplicate Data (#6026) | https://github.com/apache/seatunnel/commit/635c24e8b2 | 2.3.4 |
| [Feature][Connector-V2][Postgres-cdc]Support for Postgres cdc (#5986) | https://github.com/apache/seatunnel/commit/97438b9402 | 2.3.4 |
| Add date type and float type column split support (#6160) | https://github.com/apache/seatunnel/commit/b9a62e5c3f | 2.3.4 |
[Improve] Extend SupportResourceShare to spark/flink (#5847) | https://github.com/apache/seatunnel/commit/c69da93b87 | 2.3.4 |
[Feature] Support uuid in postgres jdbc (#6185) | https://github.com/apache/seatunnel/commit/f56855098b | 2.3.4 |
| [Feature][Connector-V2][Oracle-cdc]Support for oracle cdc (#5196) | https://github.com/apache/seatunnel/commit/aaef22b31b | 2.3.4 |
| [Feature][Connector] update pgsql catalog for save mode (#6080) | https://github.com/apache/seatunnel/commit/84ce516929 | 2.3.4 |
| [Hotfix][Jdbc] Fix dameng catalog query table sql (#6141) | https://github.com/apache/seatunnel/commit/413fa74500 | 2.3.4 |
| [improve][catalog-postgres] Improve get column sql compatibility (#5664) | https://github.com/apache/seatunnel/commit/23ce592ad2 | 2.3.4 |
| [Feature][Connector] update oracle catalog for save mode (#6092) | https://github.com/apache/seatunnel/commit/dfbf92769c | 2.3.4 |
| [Feature][Connectors-V2][Jdbc] Supports Sqlserver Niche Data Types (#6122) | https://github.com/apache/seatunnel/commit/6673f6f771 | 2.3.4 |
| [Improve][Connector-V2][Jdbc] Shade hikari in jdbc connector (#6116) | https://github.com/apache/seatunnel/commit/dd698c95bf | 2.3.4 |
| [Feature][Connector] update sqlserver catalog for save mode (#6086) | https://github.com/apache/seatunnel/commit/edcaacecb1 | 2.3.4 |
| [Feature][Connector-V2][PostgresSql] add JDBC source support string type as partition key (#6079) | https://github.com/apache/seatunnel/commit/3522eb157c | 2.3.4 |
| [Hotfix][Jdbc] Fix jdbc setFetchSize error (#6005) | https://github.com/apache/seatunnel/commit/d41af8a6ed | 2.3.4 |
| Support using multiple hadoop account (#5903) | https://github.com/apache/seatunnel/commit/d69d88d1aa | 2.3.4 |
| [Feature] Add unsupported datatype check for all catalog (#5890) | https://github.com/apache/seatunnel/commit/b9791285a0 | 2.3.4 |
| [Hotfix][Split] Fix split key not support BigInteger type | https://github.com/apache/seatunnel/commit/5adf5d2b9a | 2.3.4 |
| [Improve] Replace SeaTunnelRowType with TableSchema in the JdbcRowConverter | https://github.com/apache/seatunnel/commit/1cc1b1b8cd | 2.3.4 |
| [Hotfix][Jdbc] Fix cdc updates were not filtering same primary key (#5923) | https://github.com/apache/seatunnel/commit/38d3b85814 | 2.3.4 |
| [Improve]Change System.out.println to log output. (#5912) | https://github.com/apache/seatunnel/commit/bbedb07a9c | 2.3.4 |
| [Bug] Fix Hive-Jdbc use krb5 overwrite kerberosKeytabPath (#5891) | https://github.com/apache/seatunnel/commit/f0b6092c15 | 2.3.4 |
| Reduce the time cost of getCatalogTable in jdbc (#5908) | https://github.com/apache/seatunnel/commit/51a3737578 | 2.3.4 |
| [Improve] Improve Jdbc connector error message when datatype unsupported (#5864) | https://github.com/apache/seatunnel/commit/69f79af3a4 | 2.3.4 |
[Improve] Rename getCountSql to getExistDataSql (#5838) | https://github.com/apache/seatunnel/commit/2233b3a381 | 2.3.4 |
| [Fix] Fix read from Oracle Date type value lose time (#5814) | https://github.com/apache/seatunnel/commit/2d704e36bd | 2.3.4 |
| [Improve][JdbcSource] Optimize catalog-table metadata merge logic (#5828) | https://github.com/apache/seatunnel/commit/7d8028a60b | 2.3.4 |
| [Improve][Common] Introduce new error define rule (#5793) | https://github.com/apache/seatunnel/commit/9d1b2582b2 | 2.3.4 |
| [Feature][Hive JDBC Source] Support Hive JDBC Source Connector (#5424) | https://github.com/apache/seatunnel/commit/a64e177d06 | 2.3.4 |
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755) | https://github.com/apache/seatunnel/commit/8de7408100 | 2.3.4 |
[Improve][Connector] Add field name to DataTypeConvertor to improve error message (#5782) | https://github.com/apache/seatunnel/commit/ab60790f0d | 2.3.4 |
| [Feature][Oracle] Support XMLTYPE data integration #5716 (#5723) | https://github.com/apache/seatunnel/commit/620f081adb | 2.3.4 |
| [Fix] Fix Postgres create table test case failed (#5778) | https://github.com/apache/seatunnel/commit/b98b6bcee3 | 2.3.4 |
| [Improve][Jdbc] Fix database identifier (#5756) | https://github.com/apache/seatunnel/commit/dbfc8a670a | 2.3.4 |
| [Fix] Fix PG will not create index when using auto create table #5721 | https://github.com/apache/seatunnel/commit/e5fd88dbe7 | 2.3.4 |
[Improve] Remove all useless prepare, getProducedType method (#5741) | https://github.com/apache/seatunnel/commit/ed94fffbb9 | 2.3.4 |
| [feature][connector-jdbc]Add Save Mode function and Connector-JDBC (MySQL) connector has been realized (#5663) | https://github.com/apache/seatunnel/commit/eff17ccbe5 | 2.3.4 |
| [Bug][connector-jdbc] Nullable Column source have null data could be unexpected results. (#5560) | https://github.com/apache/seatunnel/commit/3f429e1f0a | 2.3.4 |
[Improve] Add default implement for SeaTunnelSink::setTypeInfo (#5682) | https://github.com/apache/seatunnel/commit/86cba87450 | 2.3.4 |
| [BUG][Connector-V2][Jdbc] support postgresql xml type (#5724) | https://github.com/apache/seatunnel/commit/5f5d4da13f | 2.3.4 |
| [Improve][E2E][Jdbc] Enable IT case for Oceanbase Mysql mode (#5697) | https://github.com/apache/seatunnel/commit/879c2aa07c | 2.3.4 |
| [Feature][Jdbc] Support read multiple tables (#5581) | https://github.com/apache/seatunnel/commit/33fa8ff248 | 2.3.4 |
| [Feature] Support multi-table sink (#5620) | https://github.com/apache/seatunnel/commit/81ac173189 | 2.3.4 |
| [Improve] Remove catalog tag for config file (#5645) | https://github.com/apache/seatunnel/commit/dc509aa080 | 2.3.4 |
| [Feature][Jdbc] Supporting more ways to configure connection parameters. (#5388) | https://github.com/apache/seatunnel/commit/d31e9478f7 | 2.3.4 |
| [Feature][Connector-V2][Jdbc] Add OceanBase catalog (#5439) | https://github.com/apache/seatunnel/commit/cd4b7ff7d2 | 2.3.4 |
| [BUGFIX][Catalog] oracle catalog create table repeat and oracle pg null point (#5517) | https://github.com/apache/seatunnel/commit/103da931f3 | 2.3.4 |
| Support config column/primaryKey/constraintKey in schema (#5564) | https://github.com/apache/seatunnel/commit/eac76b4e50 | 2.3.4 |
[Improve] Refactor CatalogTable and add SeaTunnelSource::getProducedCatalogTables (#5562) | https://github.com/apache/seatunnel/commit/41173357f8 | 2.3.4 |
| [Feature][Jdbc] Add Dameng catalog (#5451) | https://github.com/apache/seatunnel/commit/c23070919c | 2.3.4 |
| [Feature] Add tidb datatype convertor (#5440) | https://github.com/apache/seatunnel/commit/61391bda9f | 2.3.4 |
| [Feature][Connector-V2] jdbc connector supports Kingbase database (#4803) | https://github.com/apache/seatunnel/commit/9538567159 | 2.3.4 |
| [Feature][Catalog] Catalog add Case Conversion Definition (#5328) | https://github.com/apache/seatunnel/commit/7b5b28bdbe | 2.3.4 |
| [Feature][Jdbc] Jdbc database support identifier (#5089) | https://github.com/apache/seatunnel/commit/38b6d6e4bb | 2.3.4 |
| [Improve][Connector-v2][Jdbc] Refactor AbstractJdbcCatalog (#5096) | https://github.com/apache/seatunnel/commit/dde3104f76 | 2.3.4 |
| [Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260) | https://github.com/apache/seatunnel/commit/51c0d709ba | 2.3.4 |
| [Hotfix] Fix com.google.common.base.Preconditions to seatunnel shade one (#5284) | https://github.com/apache/seatunnel/commit/ed5eadcf73 | 2.3.3 |
| [bug][jdbc][oracle]Fix the Oracle number type mapping problem (#5209) | https://github.com/apache/seatunnel/commit/9d3c3de90d | 2.3.3 |
| [BUG][Connector-V2][Jdbc] support postgresql json type (#5194) | https://github.com/apache/seatunnel/commit/7a862d14b7 | 2.3.3 |
| [Improve][Connector-V2] Remove scheduler in JDBC sink #4736 (#5168) | https://github.com/apache/seatunnel/commit/3b0a393145 | 2.3.3 |
| [CI] Split updated modules integration test for part 5 (#5208) | https://github.com/apache/seatunnel/commit/18f14d6087 | 2.3.3 |
| [Bug][connector-v2] PostgreSQL versions below 9.5 are compatible use cdc sync problem (#5120) | https://github.com/apache/seatunnel/commit/9af696a1dd | 2.3.3 |
| [Improve][Connector-v2][Jdbc] check url not null throw friendly message (#5097) | https://github.com/apache/seatunnel/commit/b0815f2a95 | 2.3.3 |
| [Feature][Catalog] Add JDBC Catalog auto create table (#4917) | https://github.com/apache/seatunnel/commit/63eb137671 | 2.3.3 |
| [Feature][CDC] Support tables without primary keys (with unique keys) (#163) (#5150) | https://github.com/apache/seatunnel/commit/32b7f2b690 | 2.3.3 |
| [Hotfix][Connector][Jdbc] Fix the problem of JdbcOutputFormat database connection leak (#4802) | https://github.com/apache/seatunnel/commit/4cc10e83e7 | 2.3.3 |
| [Feature][JDBC Sink] Add DM upsert support (#5073) | https://github.com/apache/seatunnel/commit/5e8d982e25 | 2.3.3 |
| [Improve] Improve savemode api (#4767) | https://github.com/apache/seatunnel/commit/4acd370d48 | 2.3.3 |
| [Feature][Connector-V2] JDBC source support string type as partition key (#4947) | https://github.com/apache/seatunnel/commit/d1d2677658 | 2.3.3 |
| [Feature][Connector-V2][Jdbc] Add oceanbase dialect factory (#4989) | https://github.com/apache/seatunnel/commit/7ba11cecdf | 2.3.3 |
| Fix XA Transaction bug (#5020) | https://github.com/apache/seatunnel/commit/852fe104bc | 2.3.3 |
| [Improve][CDC]Remove driver for cdc connector (#4952) | https://github.com/apache/seatunnel/commit/b65f40c3c9 | 2.3.3 |
| [Improve] Documentation and partial word optimization. (#4936) | https://github.com/apache/seatunnel/commit/6e8de0e2a6 | 2.3.3 |
| [Improve][Connector-V2][Jdbc-Source] Support for Decimal types as splict keys (#4634) | https://github.com/apache/seatunnel/commit/d56bb1ba1c | 2.3.3 |
| [Bugfix][zeta] Fix the deadlock issue with JDBC driver loading (#4878) | https://github.com/apache/seatunnel/commit/c30a2a1b1c | 2.3.2 |
| [Hotfix][Jdbc] Fix XA DataSource crash(Oracle/Dameng/SqlServer) (#4866) | https://github.com/apache/seatunnel/commit/bde19b6377 | 2.3.2 |
| [Feature][Connector-v2] Add Snowflake Source&Sink connector (#4470) | https://github.com/apache/seatunnel/commit/06c59a25f3 | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Fix the error of extracting primary key column in sink (#4815) | https://github.com/apache/seatunnel/commit/0eff3aeed0 | 2.3.2 |
| [Hotfix][Connector][Jdbc] Fix reconnect throw close statement exception (#4801) | https://github.com/apache/seatunnel/commit/ea3bc1a673 | 2.3.2 |
| [Hotfix][Connector][Jdbc] Fix sqlserver system table case sensitivity (#4806) | https://github.com/apache/seatunnel/commit/2ca7426d22 | 2.3.2 |
| [Hotfix][Jdbc][Oracle] Fix oracle sql table identifier (#4754) | https://github.com/apache/seatunnel/commit/84cb51ff83 | 2.3.2 |
| [Improve][Jdbc] Populate primary key when jdbc sink is created using CatalogTable (#4755) | https://github.com/apache/seatunnel/commit/4af3bf9015 | 2.3.2 |
| [Feature][PostgreSQL-jdbc] Supports GEOMETRY data type for PostgreSQL… (#4673) | https://github.com/apache/seatunnel/commit/a5af4d9b6e | 2.3.2 |
| [Improve][Core] Add check of sink and source config to avoid null pointer exception. (#4734) | https://github.com/apache/seatunnel/commit/8f66ce96cb | 2.3.2 |
| [Hotfix][JDBC-SINK] Fix TiDBCatalog without open (#4718) | https://github.com/apache/seatunnel/commit/34a7f3eaa4 | 2.3.2 |
| [Feature][E2E] Add mysql-cdc e2e testcase (#4639) | https://github.com/apache/seatunnel/commit/87001dfd16 | 2.3.2 |
| [Hotfix][JDBC Sink] Fix JDBC Sink oom bug (#4690) | https://github.com/apache/seatunnel/commit/08b6f992aa | 2.3.2 |
| Improve the option rule for jdbc sink (#4694) | https://github.com/apache/seatunnel/commit/a6b3704414 | 2.3.2 |
| [feature][catalog] Support for multiplexing connections (#4550) | https://github.com/apache/seatunnel/commit/41277d7f78 | 2.3.2 |
| [Bugfix][Jdbc-Mysql Mysql-CDC] Fix MySQL BIT type incorrectly converted to Boolean type (#4671) | https://github.com/apache/seatunnel/commit/89b0099ff4 | 2.3.2 |
| [Hotfix]Jdbc[SqlServer] Fix sqlserver jdbc url parse (#4697) | https://github.com/apache/seatunnel/commit/b24c3226ec | 2.3.2 |
| Revert "[Improve][Catalog] refactor catalog (#4540)" (#4628) | https://github.com/apache/seatunnel/commit/2d1933195d | 2.3.2 |
| [Feature][Connector][Jdbc] Add DataTypeConvertor for JDBC-Postgres (#4575) | https://github.com/apache/seatunnel/commit/91f5125976 | 2.3.2 |
| [Improve][Catalog] refactor catalog (#4540) | https://github.com/apache/seatunnel/commit/b0a701cb83 | 2.3.2 |
| [Bug][JDBC Source] fix split exception when source table is empty (#4570) | https://github.com/apache/seatunnel/commit/c73b9331ce | 2.3.2 |
| [Feature][Connector][Jdbc] Add vertica connector. (#4303) | https://github.com/apache/seatunnel/commit/e6b4f98721 | 2.3.2 |
| [Hotfix][Catalog] Filter out unavailable constrain keys (#4557) | https://github.com/apache/seatunnel/commit/5e5859546a | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Simple sql has the highest priority (#4548) | https://github.com/apache/seatunnel/commit/74d4d24858 | 2.3.2 |
| [Improve][Connector-V2][Jdbc] Jdbc source supports factory SPI (#4264) | https://github.com/apache/seatunnel/commit/a97f33797d | 2.3.2 |
| [Jdbc][Chore] improve the exception message when primary key not found in row (#4474) | https://github.com/apache/seatunnel/commit/06fa850da9 | 2.3.2 |
| [hotfix][JDBC] Fix the table name is not automatically obtained when multiple tables (#4514) | https://github.com/apache/seatunnel/commit/c84d6f8d11 | 2.3.2 |
| [Chore][Jdbc] add the log for sql and update some style (#4475) | https://github.com/apache/seatunnel/commit/a9e6503045 | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Set default value to false of JdbcOption: generate_sink_sql (#4471) | https://github.com/apache/seatunnel/commit/7da11c2f44 | 2.3.2 |
| [feature][jdbc][TiDB] add TiDB catalog (#4438) | https://github.com/apache/seatunnel/commit/9a32db6fc0 | 2.3.2 |
| [Hotfix][Connector] Fix sqlserver catalog (#4441) | https://github.com/apache/seatunnel/commit/8540c7f9f3 | 2.3.2 |
| [Feature][CDC][SqlServer] Support multi-table read (#4377) | https://github.com/apache/seatunnel/commit/c4e3f2dc03 | 2.3.2 |
| [Improve][JdbcSink]Fix connection failure caused by connection timeout. (#4322) | https://github.com/apache/seatunnel/commit/e1f6d3b3fd | 2.3.2 |
| [Hotfix][Connector-V2][Jdbc] Field aliases are not supported in the query of jdbc source. (#4158) (#4210) | https://github.com/apache/seatunnel/commit/3d7ff831f9 | 2.3.1 |
| Change file type to file_format_type in file source/sink (#4249) | https://github.com/apache/seatunnel/commit/973a2fae3c | 2.3.1 |
| Change redshift type to lowercase (#4248) | https://github.com/apache/seatunnel/commit/10447ae103 | 2.3.1 |
| Add redshift datatype convertor (#4245) | https://github.com/apache/seatunnel/commit/b19011517f | 2.3.1 |
| [improve][zeta] fix zeta bugs | https://github.com/apache/seatunnel/commit/3a82e8b39f | 2.3.1 |
| [Improve] Support MySqlCatalog Use JDBC URL With Custom Suffix | https://github.com/apache/seatunnel/commit/210d0ff1f8 | 2.3.1 |
| [hotfix] fixed jdbc IT error | https://github.com/apache/seatunnel/commit/dd20af0a9e | 2.3.1 |
| Merge branch 'dev' into merge/cdc | https://github.com/apache/seatunnel/commit/4324ee1912 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. | https://github.com/apache/seatunnel/commit/423b583038 | 2.3.1 |
| [improve][jdbc] use ReadonlyConfig instead of Config (#4236) | https://github.com/apache/seatunnel/commit/c90c58e243 | 2.3.1 |
| [Improve][Jdbc-sink] add database field to sink config (#4199) | https://github.com/apache/seatunnel/commit/ec368902f4 | 2.3.1 |
| [improve][jdbc] Reduce jdbc options configuration (#4218) | https://github.com/apache/seatunnel/commit/ddd8f808b5 | 2.3.1 |
| Fix mysql get default value (#4204) | https://github.com/apache/seatunnel/commit/6848434f2d | 2.3.1 |
| [hotfix][zeta] fix zeta multi-table parser error (#4193) | https://github.com/apache/seatunnel/commit/98f2ad0c19 | 2.3.1 |
| [Improve] Remove AUTO_COMMIT To Optional In JDBC OptionRule (#4194) | https://github.com/apache/seatunnel/commit/9d088017a3 | 2.3.1 |
| [Improve][Connector-V2] [StarRocks] Starrocks Support Auto Create Table (#4177) | https://github.com/apache/seatunnel/commit/7e0008e6fb | 2.3.1 |
| [improve][catalog][jdbc] Add MySQL catalog factory (#4168) | https://github.com/apache/seatunnel/commit/95e3cbf875 | 2.3.1 |
| [Improve][build] Give the maven module a human readable name (#4114) | https://github.com/apache/seatunnel/commit/d7cd601051 | 2.3.1 |
| Add convertor factory (#4119) | https://github.com/apache/seatunnel/commit/cbdea45d95 | 2.3.1 |
| Add ElasticSearch catalog (#4108) | https://github.com/apache/seatunnel/commit/9ee4d8394c | 2.3.1 |
| Add Kafka catalog (#4106) | https://github.com/apache/seatunnel/commit/34f1f21e48 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. (#4101) | https://github.com/apache/seatunnel/commit/a2ab166561 | 2.3.1 |
| Add DataTypeConvertor in Catalog (#4094) | https://github.com/apache/seatunnel/commit/840c3e5eb4 | 2.3.1 |
| [Feature][Catalog] Support create/drop table, create/drop database in catalog (#4075) | https://github.com/apache/seatunnel/commit/d8a0be84ca | 2.3.1 |
| [Bug][Connector-V2][Jdbc] Fixed no exception throwing problem (#3957) | https://github.com/apache/seatunnel/commit/6ab266e594 | 2.3.1 |
| [Bug][CDC] Fix jdbc sink generate update sql (#3940) | https://github.com/apache/seatunnel/commit/233465d4e4 | 2.3.1 |
| [Improve][JDBC] improve jdbc sink option (#3864) | https://github.com/apache/seatunnel/commit/768a9300e8 | 2.3.1 |
| Fix Source Class Support Parallelism judge & Add UT for it (#3878) | https://github.com/apache/seatunnel/commit/ce85a8c68b | 2.3.1 |
| [Feature][Connector] add get source method to all source connector (#3846) | https://github.com/apache/seatunnel/commit/417178fb84 | 2.3.1 |
| [Feature][Connector-V2] Jdbc connector support SAP HANA. (#3017) | https://github.com/apache/seatunnel/commit/fe0180fab2 | 2.3.1 |
| [Feature][API & Connector & Doc] add parallelism and column projection interface (#3829) | https://github.com/apache/seatunnel/commit/b9164b8ba1 | 2.3.1 |
| [Improve][JDBC Connector]improve option rule (#3802) | https://github.com/apache/seatunnel/commit/139256741a | 2.3.1 |
| [Hotfix][Jdbc Sink] fix xa transaction commit failure on pipeline restore (#3809) | https://github.com/apache/seatunnel/commit/39dae4cfd9 | 2.3.1 |
| [Improve][Connector-V2][JDBC] Add exactly-once for JDBC source connector (#3750) | https://github.com/apache/seatunnel/commit/5328e9d847 | 2.3.1 |
| [Improve][Connector-v2] Remove unused options for jdbc source factory (#3794) | https://github.com/apache/seatunnel/commit/861004d309 | 2.3.1 |
| [Feature][Connector-jdbc] Fix JDBC Connector Throw Exception Error. (#3796) | https://github.com/apache/seatunnel/commit/38646b11b8 | 2.3.1 |
| [hotfix][ST-Engine] fix jdbc connector exactly-once null pointer (#3730) | https://github.com/apache/seatunnel/commit/0c5986fbec | 2.3.0 |
| [Improve][connector-jdbc] Add config item enable upsert by query (#3708) | https://github.com/apache/seatunnel/commit/e1f951f782 | 2.3.0 |
| [Hotfix][connector-v2] fix SemanticXidGenerator#generateXid indexOutOfBounds #3701 (#3705) | https://github.com/apache/seatunnel/commit/f351ceaf4b | 2.3.0 |
| [Hotfix][Connector-V2][jdbc] fix jdbc connection reset bug (#3670) | https://github.com/apache/seatunnel/commit/6fe0e6aece | 2.3.0 |
| [Improve][Connector-V2][JDBC] Unified exception for JDBC source & sink (#3598) | https://github.com/apache/seatunnel/commit/865ca2bba9 | 2.3.0 |
| [Connector][JDBC]Support Redshift sink and source (#3615) | https://github.com/apache/seatunnel/commit/8d9d8638d2 | 2.3.0 |
| [Improve][Connectors-V2][jdbc] Adapts to multiple versions of Flink #3589 | https://github.com/apache/seatunnel/commit/e77fdbbef7 | 2.3.0 |
| [Hotfix][OptionRule] Fix option rule about all connectors (#3592) | https://github.com/apache/seatunnel/commit/226dc6a119 | 2.3.0 |
| [Feature][Connector-V2][Doris]Add Doris Source & Sink connector (#3586) | https://github.com/apache/seatunnel/commit/3d46b79614 | 2.3.0 |
| [Feature][Connector-V2][Teradata] Add Teradata Source And Sink Connector | https://github.com/apache/seatunnel/commit/3a095d30fd | 2.3.0 |
| [Feature][Connector-V2][JDBC] support sqlite Source & Sink (#3089) | https://github.com/apache/seatunnel/commit/a73bb3e714 | 2.3.0 |
| Bump postgresql in /seatunnel-connectors-v2/connector-jdbc (#3559) | https://github.com/apache/seatunnel/commit/c8dfdf3e46 | 2.3.0 |
| [feature][connector][cdc] add SeaTunnelRowDebeziumDeserializeSchema (#3499) | https://github.com/apache/seatunnel/commit/ff44db116e | 2.3.0 |
| [JDBC][ORACLE] Improve Oracle Type to SeaTunnel Type Mapping (#3486) | https://github.com/apache/seatunnel/commit/8fe0dda6e2 | 2.3.0 |
| [JDBC][Config] Add JDBC Fetch Size Config And Custom Postgres PrepareStatement (#3478) | https://github.com/apache/seatunnel/commit/d60a705f5d | 2.3.0 |
| [feature][connector][jdbc] expose configurable options in JDBC (#3410) | https://github.com/apache/seatunnel/commit/72b8a73cab | 2.3.0 |
| [feature][connector][jdbc] Support write cdc changelog event in jdbc sink (#3444) | https://github.com/apache/seatunnel/commit/b12a908f01 | 2.3.0 |
| [Improve][Connector-v2][Jdbc] Add AutoCommit to jdbcConfig (#3453) | https://github.com/apache/seatunnel/commit/cfb1e97853 | 2.3.0 |
| [Improve][Connector-v2] Unset AutoCommit default to true (#3451) | https://github.com/apache/seatunnel/commit/439f686d92 | 2.3.0 |
| [Feature][connector-v2] add tablestore source and sink (#3309) | https://github.com/apache/seatunnel/commit/ebebf0b633 | 2.3.0 |
| Close jdbc connection after use. (#3358) | https://github.com/apache/seatunnel/commit/219fea517c | 2.3.0 |
| [Improve][Engine] Improve Engine performance. (#3216) | https://github.com/apache/seatunnel/commit/7393c47327 | 2.3.0 |
| [Bug][Connector-V2][JDBC]fix jdbc split bug (#3220) | https://github.com/apache/seatunnel/commit/40d67ab902 | 2.3.0 |
| [Feature][Connector-V2][JDBC] Support DB2 Source & Sink (#2410) | https://github.com/apache/seatunnel/commit/bf1ef69e84 | 2.3.0 |
| update org.postgresql:postgresql 42.3.3 to 42.4.1 (#3097) | https://github.com/apache/seatunnel/commit/2852516490 | 2.3.0 |
| [Feature][Connector-V2][Jdbc] support gbase 8a (#3026) | https://github.com/apache/seatunnel/commit/dc6e85d06f | 2.3.0-beta |
| [Bug][sqlserver] timestamp convert exception (#3024) | https://github.com/apache/seatunnel/commit/99ac1a655e | 2.3.0-beta |
| [Feature][Connector-V2] oracle connector (#2550) | https://github.com/apache/seatunnel/commit/384ece1913 | 2.3.0-beta |
| [Improve][Connector-v2][jdbc] Support for specify number of partitions when parallel reading (#2950) | https://github.com/apache/seatunnel/commit/fc284ac32e | 2.3.0-beta |
| [Feature][Connector-V2] add sqlserver connector (#2646) | https://github.com/apache/seatunnel/commit/05d105dea3 | 2.3.0-beta |
| [Improve][e2e] Unified e2e IT for DaMengDB (#2946) | https://github.com/apache/seatunnel/commit/15636bdea1 | 2.3.0-beta |
| [Improve][e2e] modify DM-driver by downLoad and add the value comparison of all columns (#2772) | https://github.com/apache/seatunnel/commit/f3ff39bdfe | 2.3.0-beta |
| [Improve][e2e] Improve jdbc driver management (#2770) | https://github.com/apache/seatunnel/commit/f907927a35 | 2.3.0-beta |
| [hotfix][connector][jdbc] fix JDBC split exception (#2904) | https://github.com/apache/seatunnel/commit/57342c6545 | 2.3.0-beta |
| [Improve][connector-jdbc] Calculate splits only once in JdbcSourceSplitEnumerator (#2900) | https://github.com/apache/seatunnel/commit/7622f28999 | 2.3.0-beta |
| [Feature][Connector-V2 E2E] Add mysql and postgres e2e test and bug fix (#2838) | https://github.com/apache/seatunnel/commit/db434adc15 | 2.2.0-beta |
| fix XAConnection being wrongly submitted (#2805) | https://github.com/apache/seatunnel/commit/d9a6039fd3 | 2.2.0-beta |
| fix spark execute exception is not thrown (#2791) | https://github.com/apache/seatunnel/commit/b1711c984e | 2.2.0-beta |
| [Improve][e2e] Add driver-jar to lib (#2719) | https://github.com/apache/seatunnel/commit/d64d452c86 | 2.2.0-beta |
| [DEV][Api] Replace SeaTunnelContext with JobContext and remove singleton pattern (#2706) | https://github.com/apache/seatunnel/commit/cbf82f755c | 2.2.0-beta |
| [Connector-V2][JDBC-connector] support Jdbc dm (#2377) | https://github.com/apache/seatunnel/commit/7278209ca2 | 2.2.0-beta |
| [#2606]Dependency management split (#2630) | https://github.com/apache/seatunnel/commit/fc047be69b | 2.2.0-beta |
| [Bug][connector-jdbc-v2] Fix transaction force commit when autoCommit is enabled (#2636) | https://github.com/apache/seatunnel/commit/8cd8cf7aa2 | 2.2.0-beta |
| [Feature][Connector-V2] Add phoenix connector sink (#2499) | https://github.com/apache/seatunnel/commit/05ccf9d68c | 2.2.0-beta |
| [Connector-V2][JDBC] Support database: greenplum (#2429) | https://github.com/apache/seatunnel/commit/3561d3878f | 2.2.0-beta |
| Add jdbc connector e2e test (#2321) | https://github.com/apache/seatunnel/commit/5fbcb811c6 | 2.2.0-beta |
StateT of SeaTunnelSource should extend Serializable (#2214) | https://github.com/apache/seatunnel/commit/8c426ef850 | 2.2.0-beta |
| update the condition to 1 = 0 about get table operation (#2186) | https://github.com/apache/seatunnel/commit/7c56d7143b | 2.2.0-beta |
| [SeaTunnel API][Sink] remove useless context field (#2124) | https://github.com/apache/seatunnel/commit/a31fdeedcc | 2.2.0-beta |
| [bugfix] Check isOpen before closing (#2107) | https://github.com/apache/seatunnel/commit/7ec0ada2b9 | 2.2.0-beta |
| [API-DRAFT][MERGE] fix merge error | https://github.com/apache/seatunnel/commit/3c0e984648 | 2.2.0-beta |
| merge dev to api-draft | https://github.com/apache/seatunnel/commit/d265597c64 | 2.2.0-beta |
| [api-draft][Optimize] Optimize module name (#2062) | https://github.com/apache/seatunnel/commit/f79e3112b1 | 2.2.0-beta |