Skip to content

Release-2.1.0
Compare
Choose a tag to compare
@leonardBang leonardBang released this 15 Nov 07:15
· 942 commits to master since this release
release-2.1.0
670c964

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.1/

Features and Improvements

  1. [tests] Add end-to-end tests for cdc connector uber jars (#594)
  2. [tests] Upgrade testcontainers dependency to 1.16.2 (#591)
  3. [mysql] Reading a null column with default value defined should return null instead of default value (#555)
  4. [mysql] Optimize the dynamic chunk size calculation for table with dense distribution (#599)
  5. [mongodb] Fix MongoDBConnectorITCase is timeout on Azure (#600)
  6. [hotfix][mysql] Fix number overflow in ObjectUtils.minus (#598)
  7. [mongodb] Fix problem of cannot look up fields on non-struct type (#588)
  8. [hotfix][mongodb] Fix NullPointException when heartbeat option is enabled (#586)
  9. [postgres] Support 'schema-name' metadata column for postgres-cdc connector
  10. [oracle] Support metadata columns for oracle connector
  11. [tests] Split the CI pipeline into multiple stages for better performance (#572)
  12. [hotfix][mongodb] Correct the connection uri building of MongoDB (#568)
  13. [mysql] Skip ddl events in snapshot split normalization (#577)
  14. [mysql] Support dynamic chunk size for evenly distribution table
  15. [mysql][minor] Use 'table.include.list' key instead of legacy key 'table.whitelist' in SnapshotSplitReader
  16. [mysql] Set server time zone information for connection pool factory (#566)
  17. [mysql] Polish binlog offset compare semantic (#543)
  18. [build] Update NOTICE file for sql connector jar (#565)
  19. [postgres] Support metadata columns for postgres-cdc connector (#500)
  20. [debezium] Bump up debezium version to 1.5.4.Final (#554)
  21. [oracle] Shade dependencies for oracle-cdc connector (#519)
  22. [hotfix][docs] Fix the display of github star button
  23. [common] Fix NPE of JsonConverter when job run on cluster(#470)
  24. [mongodb] Support metadata columns for mongodb-cdc connector (#476)
  25. [mysql] Reduce the connection usage in table discovery process
  26. [build] bump maven shade plugin version to 3.2.4
  27. [mysql] Introduce Jdbc connection pools
  28. [mysql] support all mysql data types (#438)
  29. [hotfix][docs] Correct the Kibana link in Oracle connector documentation (#539)
  30. [mysql] Support binlog split with huge snapshot split meta
  31. [mysql] Support tables with different split key
  32. [mysql] Validate the regex pattern of database-name and table-name in table factory (#526)
  33. [build] Add necessary shaded dependencies (#512)
  34. [oracle][test] Fix oracle tests failure in azure due to ORA-01882
  35. [oracle][minor] Fix checkstyle and typo
  36. [oracle] Add docker build 'on-the-fly' and refactor test image
  37. [oracle] Added validator for oracle
  38. [oracle] Updated package naming to com.ververica in oracle connector
  39. [oracle] Fixing unit tests, cleaning up after adding oracle cdc
  40. [oracle] Add oracle cdc connector
  41. [build] Upgrade azure environment from ubuntu-16.04 to ubuntu-18.04 (#517)
  42. [hotfix][mysql] Correct the usage of includeSchemaChanges parameter (#501)
  43. [build] Follow Flink builtin connector shade style (#49)
  44. [mysql] Expose MySqlSource API that supports incremental snapshot (#495)
  45. [mysql] Support metadata columns for mysql-cdc connector (#496)
  46. [common] Support to read tables of inconsistent schema (#494)
  47. [build] Fix maven connection timeout issue in azure CI
  48. [mysql] Support wide table with huge number of columns
  49. [tests] Correct the argument order of assertArrayEqualInOrder/assertArrayEqualAnyOrder
  50. [tests] Introduce assertEqualsInOrder/assertEqualsInAnyOrder methods for test
  51. [tests] Improve the unstable test testStartupFromLatestOffset in MySqlConnectorITCase
  52. [mysql] Fix the restoration failure when checkpoint happened in one MySQL transaction
  53. [mysql] Optimization that skips the binlog read if the low watermark equals high watermark
  54. [mysql] Add source metrics for MySqlParallelSource
  55. [build] Use tools with stable version in building docs
  56. [mysql] Use min/max of split key and row count to describe the distribution of table
  57. [mysql] Fix the ClassCastException in RecordUtils
  58. [mongodb][docs] Add documentation for mongodb-cdc connector (#395)
  59. [mongodb] Remove no need config option prefix 'debezium.' (#420)
  60. [mongodb] Support MongoDB CDC connector (#225)
  61. [common] Shade kafka-related dependency (#386)
  62. [common] Support json deserialization schema
  63. [mysql] Improve the tests code
  64. [mysql] Fix the MySqlSnapshotSplitAssigner may assign duplicate splits
  65. [mysql] Add tests to check mysql-cdc works well under various timezones (#367)
  66. [mysql] Optimize the checkpoint be optional under single parallelism (#365)
  67. [postgres] Fix postgres-cdc connector cannot recognize the optional option 'slot.name'
  68. [mysql] Correct the initial binlog offset for MySqlHybridSplitAssigner
  69. [mysql] Add default value for 'database.history.instance.name' in MySqlParallelSource
  70. [common] Remove useless parameter 'converter.schemas.enable'
  71. [build] Run integration tests for each building
  72. [mysql] Improve the code format in SignalEventDispatcher
  73. [postgres] Fix Validator didn't implement Serializable
  74. [changelog] fix changelog-deserialize exception message typo.
  75. [build] Update issue templates
  76. [docs] Add tutorial about building real-time data lake for MySQL sharding table with Flink CDC (#551)
  77. [docs] Add metadata column example for mysql-cdc and mongodb-cdc connector
  78. [docs] Add checkpoint configuration limitation for Oracle and Postgres connector (#580)
  79. [docs] Fix the link of 'edit on github' on site (#578)
  80. [docs] Use SNAPSHOT version dependency in master documentation (#497)
  81. [docs] Use more generic term 'transaction logs' in README
  82. [docs] Add MySQL HA cluster support explanation
  83. [docs] Update the dependency version to 2.1.0
  84. [docs] Add checkpoint configuration limitation for Oracle and Postgres connector
  85. [docs] Fix the link of 'edit on github' on site (#578)
  86. [docs][oracle] Fix oracle DATE type mapping in documentation (#569)
  87. [docs] Translate "Streaming ETL for MySQL and Postgres with Flink CDC" into Chinese (#550)
  88. [docs] Add GitHub star button to documentation (#547)
  89. [docs] Add Oracle support in README
  90. [docs] Restructure the "tutorials" to "quickstart"
  91. [docs] Add documentation for oracle-cdc (#515)
  92. [docs] Rewrite tutorial doc for mysql-postgres-tutorial (#514)
  93. [docs] Add favicon for docs website (#525)
  94. [docs] Use new MySqlSource API in documentation
  95. [docs] Correct DataStream API usage in document examples
  96. [docs] Use JsonDeserializationSchema as output format in examples
  97. [docs] Update documentation of tutorial
  98. [docs] Add meaningful title for tutorial
  99. [docs] Support build document website locally
  100. [docs] Fix the broken link in readme
  101. [docs] Update the debezium document link to version 1.5
  102. [docs][mysql] Fix LowerCase Class name typo
  103. [docs] Add checkpoint config in document example
  104. [docs] Add FAQ for MySQL 8.0 Public Key Retrieval setting
  105. [docs] Add checkpoint and primary key setting for example in tutorials
  106. [docs] Fix the imports in document demo
  107. [docs] Set the content width of the website
  108. [docs] Update DingTalk group picture size in README.md
  109. [docs] Update the supported connector version and link

Download

Contributor list

Gunnar Morling, Jark Wu, Jiabao Sun, Leonard Xu, MartijnVisser, Marton Balassi, Shengkai, Tamas Kiss, Tamas Zseder, Zongwen Li, dongdongking008, frey66, gongzhongqiang, ili zh, jpatel, lsy, luoyuxia, manmao, mincwang, taox, tuple, wangminchao, yangbin09

Assets 2
Loading