跳到主要内容
版本:2.3.10

connector-cdc-base

Change Log
ChangeCommitVersion
[Improve][CDC] Extract duplicate code (#8906)https://github.com/apache/seatunnel/commit/b922bb90e2.3.10
[Improve][CDC] Filter heartbeat event (#8569)https://github.com/apache/seatunnel/commit/1870653392.3.10
[Improve] restruct connector common options (#8634)https://github.com/apache/seatunnel/commit/f3499a6ee2.3.10
[Fix][MySQL-CDC]fix recovery task failure caused by binlog deletion (#8587)https://github.com/apache/seatunnel/commit/087087e592.3.10
[Feature][Postgre CDC]support array type (#8560)https://github.com/apache/seatunnel/commit/021af147c2.3.10
[Feature][MySQL-CDC] Support database/table wildcards scan read (#8323)https://github.com/apache/seatunnel/commit/2116843ce2.3.9
[Feature][CDC] Add 'schema-changes.enabled' options (#8285)https://github.com/apache/seatunnel/commit/8e29ecf542.3.9
Revert "[Feature][Redis] Flush data when the time reaches checkpoint interval" and "[Feature][CDC] Add 'schema-changes.enabled' options" (#8278)https://github.com/apache/seatunnel/commit/fcb2938282.3.9
[Feature][CDC] Add 'schema-changes.enabled' options (#8252)https://github.com/apache/seatunnel/commit/d783f94472.3.9
[Improve][dist]add shade check rule (#8136)https://github.com/apache/seatunnel/commit/51ef800012.3.9
[Improve][Connector-V2] Add pre-check for table enable cdc (#8152)https://github.com/apache/seatunnel/commit/9a5da78172.3.9
[Feature][Connector-V2]Jdbc chunk split add snapshotSplitColumn config #7794 (#7840)https://github.com/apache/seatunnel/commit/b6c6dc0432.3.9
[Feature][Core] Support cdc task ddl restore for zeta (#7463)https://github.com/apache/seatunnel/commit/8e322281e2.3.9
[Feature][Transform-v2] Add metadata transform (#7899)https://github.com/apache/seatunnel/commit/699d165522.3.9
[Feature][Connector-v2] Support schema evolution for Oracle connector (#7908)https://github.com/apache/seatunnel/commit/79406bcc22.3.9
[Fix][Connector-V2] Fix cdc use default value when value is null (#7950)https://github.com/apache/seatunnel/commit/3b432125a2.3.9
[Hotfix][CDC] Fix occasional database connection leak when read snapshot split (#7918)https://github.com/apache/seatunnel/commit/a8d0d4ce72.3.9
[Fix][Connector-V2] Fix some throwable error not be caught (#7657)https://github.com/apache/seatunnel/commit/e19d732822.3.8
[Improve][Connector-V2] Close all ResultSet after used (#7389)https://github.com/apache/seatunnel/commit/853e973212.3.8
[Feature][Connector-V2] Support jdbc hana catalog and type convertor (#6950)https://github.com/apache/seatunnel/commit/d663398732.3.6
[Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE (#7119)https://github.com/apache/seatunnel/commit/ae81879212.3.6
[Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc (#6929)https://github.com/apache/seatunnel/commit/cf91e51fc2.3.6
[Hotfix][CDC] Fix split schema change stream (#7003)https://github.com/apache/seatunnel/commit/0c3044e3f2.3.6
[Improve][CDC] Bump the version of debezium to 1.9.8.Final (#6740)https://github.com/apache/seatunnel/commit/c3ac953522.3.6
[Improve][CDC] Close idle subtasks gorup(reader/writer) in increment phase (#6526)https://github.com/apache/seatunnel/commit/454c339b92.3.6
[Improve][JDBC Source] Fix Split can not be cancel (#6825)https://github.com/apache/seatunnel/commit/ee3b7c3722.3.6
[Hotfix][Postgres-CDC/OpenGauss-CDC] Fix read data missing when restore (#6785)https://github.com/apache/seatunnel/commit/67c32607e2.3.6
[Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684)https://github.com/apache/seatunnel/commit/868ba4d7c2.3.6
[Chore] remove useless interface (#6746)https://github.com/apache/seatunnel/commit/3c1aeb3782.3.6
[Feature] Support listening for message delayed events in cdc source (#6634)https://github.com/apache/seatunnel/commit/01159ec922.3.5
[Improve][CDC] Optimize split state memory allocation in increment phase (#6554)https://github.com/apache/seatunnel/commit/fe33422162.3.5
[Improve][CDC] Improve read performance when record not contains schema field (#6571)https://github.com/apache/seatunnel/commit/e60beb28e2.3.5
[Feature][Core] Support event listener for job (#6419)https://github.com/apache/seatunnel/commit/831d0022e2.3.5
[Improve][CDC] Optimize memory allocation for snapshot split reading (#6281)https://github.com/apache/seatunnel/commit/4856645832.3.5
[Improve][API] Unify type system api(data & type) (#5872)https://github.com/apache/seatunnel/commit/b38c7edcc2.3.5
[Feature] Supports iceberg sink #6198 (#6265)https://github.com/apache/seatunnel/commit/18d3e86192.3.5
[Bugfix][cdc base] Fix negative values in CDCRecordEmitDelay metric (#6259)https://github.com/apache/seatunnel/commit/68978dbb42.3.4
[BugFix][CDC Base] Fix added columns cannot be parsed after job restore (#6118)https://github.com/apache/seatunnel/commit/0c593a39e2.3.4
[Feature][JDBC、CDC] Support Short and Byte Type in spliter (#6027)https://github.com/apache/seatunnel/commit/6f8d0a5042.3.4
[Improve][CDC] Disable exactly_once by default to improve stability (#6244)https://github.com/apache/seatunnel/commit/f474955542.3.4
[Bugfix][JDBC、CDC] Fix Spliter Error in Case of Extensive Duplicate Data (#6026)https://github.com/apache/seatunnel/commit/635c24e8b2.3.4
[Feature][Connector-V2][Postgres-cdc]Support for Postgres cdc (#5986)https://github.com/apache/seatunnel/commit/97438b9402.3.4
[Bugfix][CDC Base] Fix NPE caused by adding a table for restore job (#6145)https://github.com/apache/seatunnel/commit/8d3f8e4622.3.4
[Feature][CDC] Support custom table primary key (#6106)https://github.com/apache/seatunnel/commit/1312a1dd22.3.4
[Bugfix][CDC base] Fix CDC job cannot consume incremental data After restore run (#625) (#6094)https://github.com/apache/seatunnel/commit/37567ebb72.3.4
[Feature][CDC] Support read no primary key table (#6098)https://github.com/apache/seatunnel/commit/b42d78de32.3.4
[Improve][CDC] Disable memory buffering when exactly_once is turned off (#6017)https://github.com/apache/seatunnel/commit/300a624c52.3.4
[Improve][Zeta] Remove assert key words (#5947)https://github.com/apache/seatunnel/commit/dcb4549102.3.4
[Bug][CDC] Fix state recovery error when switching a single table to multiple tables (#5784)https://github.com/apache/seatunnel/commit/37fcff3472.3.4
[Fix] Fix MultiTableSink restore failed when add new table (#5746)https://github.com/apache/seatunnel/commit/21503bd772.3.4
[improve][mysql-cdc] Optimize the default value range of mysql server-id to reduce conflicts. (#5550)https://github.com/apache/seatunnel/commit/5174639462.3.4
[Improve] Add default implement for SeaTunnelSource::getProducedType (#5670)https://github.com/apache/seatunnel/commit/a04add6992.3.4
[Improve][Pom] Add junit4 to the root pom (#5611)https://github.com/apache/seatunnel/commit/7b4f7db2a2.3.4
[Hotfix][CDC] Fix thread-unsafe collection container in cdc enumerator (#5614)https://github.com/apache/seatunnel/commit/b2f70fd402.3.4
[Improve][CDC] Use Source to output the CatalogTable (#5626)https://github.com/apache/seatunnel/commit/3e6a20acf2.3.4
Support config column/primaryKey/constraintKey in schema (#5564)https://github.com/apache/seatunnel/commit/eac76b4e52.3.4
[Fix]: fix the cdc bug about NPE when the original table deletes a field (#5579)https://github.com/apache/seatunnel/commit/f5ed477952.3.4
[Improve] Refactor CatalogTable and add SeaTunnelSource::getProducedCatalogTables (#5562)https://github.com/apache/seatunnel/commit/41173357f2.3.4
[Feature][CDC] Support for preferring numeric fields as split keys (#5384)https://github.com/apache/seatunnel/commit/c687050d82.3.4
[Feature][Connector-V2][CDC] Support flink running cdc job (#4918)https://github.com/apache/seatunnel/commit/5e378831e2.3.4
[Improve][CheckStyle] Remove useless 'SuppressWarnings' annotation of checkstyle. (#5260)https://github.com/apache/seatunnel/commit/51c0d709b2.3.4
[Hotfix] Fix com.google.common.base.Preconditions to seatunnel shade one (#5284)https://github.com/apache/seatunnel/commit/ed5eadcf72.3.3
[Imporve][CDC Base] Add a fast sampling method that supports character types (#5179)https://github.com/apache/seatunnel/commit/c0422dbfe2.3.3
[Bugfix][cdc] Fix mysql bit column to java byte (#4817)https://github.com/apache/seatunnel/commit/aae3e913d2.3.3
[Feature][CDC][Zeta] Support schema evolution framework(DDL) (#5125)https://github.com/apache/seatunnel/commit/4f89c1d272.3.3
[Improve][CDC] support exactly-once of cdc and fix the BinlogOffset comparing bug (#5057)https://github.com/apache/seatunnel/commit/0e4190ab22.3.3
[Hotfix][MongodbCDC]Refine data format to adapt to universal logic (#5162)https://github.com/apache/seatunnel/commit/4b4b5f9642.3.3
[Feature][Connector-V2][CDC] Support string type shard fields. (#5147)https://github.com/apache/seatunnel/commit/e1be9d7f82.3.3
[Feature][CDC] Support tables without primary keys (with unique keys) (#163) (#5150)https://github.com/apache/seatunnel/commit/32b7f2b692.3.3
[Feature][connector-v2][mongodbcdc]Support source mongodb cdc (#4923)https://github.com/apache/seatunnel/commit/d729fcba42.3.3
[Chore] Modify repeat des (#5088)https://github.com/apache/seatunnel/commit/936afc2a92.3.3
[Feature][Connector-V2][cdc] Change the time zone to the default time zone (#5030)https://github.com/apache/seatunnel/commit/3cff923a72.3.3
[Bugfix][zeta] Fix cdc connection does not close (#4922)https://github.com/apache/seatunnel/commit/a2d2f2dda2.3.3
[Feature][CDC] Support disable/enable exactly once for INITIAL (#4921)https://github.com/apache/seatunnel/commit/6d9a3e5952.3.3
[Improve] Documentation and partial word optimization. (#4936)https://github.com/apache/seatunnel/commit/6e8de0e2a2.3.3
[Bugfix][zeta] Fix the deadlock issue with JDBC driver loading (#4878)https://github.com/apache/seatunnel/commit/c30a2a1b12.3.2
[improve][CDC base] Implement Sample-based Sharding Strategy with Configurable Sampling Rate (#4856)https://github.com/apache/seatunnel/commit/d827c700f2.3.2
[Bugfix][CDC Base] Solving the ConcurrentModificationException caused by snapshotState being modified concurrently. (#4877)https://github.com/apache/seatunnel/commit/9a2efa51c2.3.2
[Hotfix][CDC] Fix chunk start/end parameter type error (#4777)https://github.com/apache/seatunnel/commit/c13c031992.3.2
[Bug][CDC] Fix TemporalConversions (#4542)https://github.com/apache/seatunnel/commit/d2094bf2e2.3.2
[Feature][CDC][SqlServer] Support multi-table read (#4377)https://github.com/apache/seatunnel/commit/c4e3f2dc02.3.2
[Improve][CDC] Improve startup.mode/stop.mode options (#4360)https://github.com/apache/seatunnel/commit/b71d8739d2.3.1
[Improve][CDC] Optimize options & add docs for compatible_debezium_json (#4351)https://github.com/apache/seatunnel/commit/336f590492.3.1
Update CDC StartupMode and StopMode option to SingleChoiceOption (#4357)https://github.com/apache/seatunnel/commit/f60ac1a5e2.3.1
[bugfix][cdc-base] Fix cdc base shutdown thread not cleared (#4327)https://github.com/apache/seatunnel/commit/ac61409bd2.3.1
[Feature][CDC] Support export debezium-json format to kafka (#4339)https://github.com/apache/seatunnel/commit/5817ec07b2.3.1
[Feature][CDC] Support add & dorp tables when restore cdc jobs (#4254)https://github.com/apache/seatunnel/commit/add75d7d52.3.1
[Feature][CDC][Mysql] Support read database list (#4255)https://github.com/apache/seatunnel/commit/3ca60c6fe2.3.1
[improve][zeta] fix zeta bugshttps://github.com/apache/seatunnel/commit/3a82e8b392.3.1
[Improve] Support MySqlCatalog Use JDBC URL With Custom Suffixhttps://github.com/apache/seatunnel/commit/210d0ff1f2.3.1
Merge branch 'dev' into merge/cdchttps://github.com/apache/seatunnel/commit/4324ee1912.3.1
[Improve][Project] Code format with spotless plugin.https://github.com/apache/seatunnel/commit/423b583032.3.1
[Hotfix][Zeta] Fix shuffle checkpoint (#4224)https://github.com/apache/seatunnel/commit/507ca85612.3.1
[improve][cdc] support sharding-tables (#4207)https://github.com/apache/seatunnel/commit/5c3f0c9b02.3.1
[Hotfix][CDC] Fix multiple-table data read (#4200)https://github.com/apache/seatunnel/commit/7f5671d2c2.3.1
[hotfix][zeta] fix zeta multi-table parser error (#4193)https://github.com/apache/seatunnel/commit/98f2ad0c12.3.1
[Feature][Zeta] Support shuffle multiple rows by tableId (#4147)https://github.com/apache/seatunnel/commit/8348f1a102.3.1
[Feature][API] Add Metrics for Connector-V2 (#4017)https://github.com/apache/seatunnel/commit/32e1f91c72.3.1
[Improve][build] Give the maven module a human readable name (#4114)https://github.com/apache/seatunnel/commit/d7cd601052.3.1
[Improve][Project] Code format with spotless plugin. (#4101)https://github.com/apache/seatunnel/commit/a2ab166562.3.1
[Feature][CDC] MySQL CDC supports deserialization of multi-tables (#4067)https://github.com/apache/seatunnel/commit/21ef45fcc2.3.1
fix cdc option rule error (#4018)https://github.com/apache/seatunnel/commit/ea160429d2.3.1
[Bug][CDC] Fix concurrent modify of splits (#3937)https://github.com/apache/seatunnel/commit/29b04e2402.3.1
[Improve][CDC][base] Guaranteed to be exactly-once in the process of switching from SnapshotTask to IncrementalTask (#3837)https://github.com/apache/seatunnel/commit/8379aaf872.3.1
[Hotfix][SqlServer CDC] fix SqlServerCDC IT failure (#3807)https://github.com/apache/seatunnel/commit/fd66de5f92.3.1
[Improve][CDC] Add mysql-cdc source factory (#3791)https://github.com/apache/seatunnel/commit/356538de82.3.1
[feature][connector-v2] add sqlServer CDC (#3686)https://github.com/apache/seatunnel/commit/0f0afb58a2.3.0
[doc][connector][cdc] add MySQL CDC Source doc (#3707)https://github.com/apache/seatunnel/commit/555905b0b2.3.0
[feature][cdc] Fixed error in mysql cdc under real-time job (#3666)https://github.com/apache/seatunnel/commit/2238fda302.3.0
[feature][connector][cdc] add SeaTunnelRowDebeziumDeserializeSchema (#3499)https://github.com/apache/seatunnel/commit/ff44db1162.3.0
[feature][connector][mysql-cdc] add MySQL CDC enumerator (#3481)https://github.com/apache/seatunnel/commit/ff4b32dc22.3.0
[feature][connector] add mysql cdc reader (#3455)https://github.com/apache/seatunnel/commit/ae981df672.3.0
[feature][connector][cdc] add cdc reader jdbc related (#3433)https://github.com/apache/seatunnel/commit/7bf00fb192.3.0
[feature][connector][cdc] add CDC enumerator base classes (#3419)https://github.com/apache/seatunnel/commit/9b1821f472.3.0
[feature][Connector-v2][cdc] Add cdc base reader (#3407)https://github.com/apache/seatunnel/commit/e454b80dc2.3.0
[bigfix][Connector-v2][cdc] move version to 1.6.4 (#3389)https://github.com/apache/seatunnel/commit/b50b543c32.3.0
[feature][connector][cdc] CDC base classes (#3363)https://github.com/apache/seatunnel/commit/2586f305b2.3.0