42 Pull requests merged by 18 people

• [core] RESTCatalog: support data token IT test

  #5184 merged Mar 4, 2025

• [hotfix] ArrowFormatWriter should reset ArrowFieldWriters after flushing

  #5207 merged Mar 4, 2025

• [doc] Add lookup compaction description in primary key compaction page

  #5205 merged Mar 4, 2025

• [hotfix] ignore .vscode folder in .gitignore

  #5201 merged Mar 3, 2025

• [core] Support cross-partition for fallback branch feature

  #5198 merged Mar 3, 2025

• [hotfix] Fix unstable test case: testRefreshDLFAuthTokenFileAuthProvider

  #5186 merged Mar 3, 2025

• [refactor] Move #earlierThanTimeMills to TimeTravelUtil

  #5197 merged Mar 3, 2025

• [core]Support enums without spaces in TagPeriodFormatter

  #5165 merged Mar 3, 2025

• [iceberg][doc] add docs about iceberg migration

  #5097 merged Mar 3, 2025

• [build] Optimize github actions structure and execution

  #5134 merged Mar 3, 2025

• [core] Extract ChangelogManager from SnapshotManager

  #5188 merged Mar 3, 2025

• [core] Introduce gentle lookup compaction mode to reduce overall compaction frequency

  #5178 merged Mar 3, 2025

• [hotfix] fix the unreliability test of AlignedSourceReaderTest#testCheckpointTrigger.

  #5194 merged Mar 3, 2025

• [doc] Add mysql cdc synchronization table comment document.

  #5173 merged Mar 3, 2025

• [flink] Use RuntimeContextUtils to keep compatible

  #5192 merged Mar 3, 2025

• [spark][test] Fix spark parquet dependency conflict when executing tests locally.

  #5191 merged Mar 3, 2025

• [paimon-e2e-tests] Fix [Bug] Cannot run program "zip" exception repor…

  #5190 merged Mar 3, 2025

• [spark] Eliminate the union stage when merging into with out notMatch…

  #5137 merged Mar 2, 2025

• [flink] fix parallelismConfigured in cases when sink parallelism is set

  #5183 merged Mar 1, 2025

• [spark] Enable TagCreationMode#batch for spark writer

  #5185 merged Mar 1, 2025

• [flink] Fix StoreMultiCommitter with eager init mode

  #5187 merged Feb 28, 2025

• [bug][spark] fix ambiguous __paimon_file_path when merging from paimo…

  #5026 merged Feb 28, 2025

• [core] RESTCatalog: update parse region from dlf uri

  #5182 merged Feb 28, 2025

• [core] RESTCatalog refactor RESTCatalogServer and add test

  #5143 merged Feb 28, 2025

• [core] Enables buffer spill when targetFileSize is greater than the w…

  #5121 merged Feb 28, 2025

• [cdc] Set eager_init with option during kafka_sync_database

  #5175 merged Feb 27, 2025

• [spark] Fix the column projection when writing by DataFrameWriter

  #5164 merged Feb 27, 2025

• [cdc] Eager init to force creating snapshot even no data

  #5170 merged Feb 27, 2025

• [Bug] Delete external paths when drop table

  #5122 merged Feb 27, 2025

• [metrics] Add total file size metrics of active buckets for primary key tables

  #5158 merged Feb 27, 2025

• [Bug] Fix NumberFoematException of Dedicated Compaction

  #5153 merged Feb 27, 2025

• [rest] Implement SupportsBranches in REST Catalog

  #5168 merged Feb 27, 2025

• [iceberg] support migrating iceberg table which had suffered schema evolution

  #5083 merged Feb 27, 2025

• [doc] Add catalog prefix to Flink procedure

  #5166 merged Feb 27, 2025

• [build] Optimize Kafka container to use KRaft instead of relying on ZooKeeper

  #5167 merged Feb 27, 2025

• [core] Support in memory catalog for test RESTCatalog

  #5154 merged Feb 26, 2025

• [core] Use PriorityQueue intead of TreeSet. TreeSet will deduplicate record if comparator return 0

  #5162 merged Feb 26, 2025

• [core] Support get config by warehouse in RESTCatalog

  #5160 merged Feb 26, 2025

• [core] Introduce SupportsBranches to put branch management to Catalog

  #5157 merged Feb 26, 2025

• [flink] fix the issue where AlignedSourceReader might hang, and add detailed comments.

  #5155 merged Feb 26, 2025

• [cdc] Fix canal cdc data field value is null judgment condition.

  #5151 merged Feb 25, 2025

• [rest] Add commit statistics when commit to REST Server

  #5152 merged Feb 25, 2025

10 Pull requests opened by 9 people

• [flink] Bump flink version from 1.19.2 to 1.19.2 and from 1.20.0 to 1.20.1

  #5156 opened Feb 26, 2025

• [spark] Eliminate the De/serialization process when writing to the ap…

  #5159 opened Feb 26, 2025

• [iceberg] support migrating iceberg table with nested types

  #5171 opened Feb 27, 2025

• [Log] Add log to help debug

  #5180 opened Feb 28, 2025

• [flink] Add default parallelism for source and sink in rescale procedure, also make them configurable

  #5193 opened Mar 3, 2025

• [spark] Eliminate the union stage when merging into without notMatche…

  #5195 opened Mar 3, 2025

• [core] RestCatalog: set up paged list tables/views/partitions

  #5200 opened Mar 3, 2025

• [core] Support partition strategy for unaware bucket partitioned Appe…

  #5202 opened Mar 3, 2025

• [hotfix] Fix some typos in documents and code

  #5204 opened Mar 4, 2025

• [doc] Introduce Paimon upgrade compatibility description page

  #5206 opened Mar 4, 2025

10 Issues closed by 4 people

• [Feature] TagPeriodFormatter support Dates and hours without spaces

  #5161 closed Mar 3, 2025

• [Feature] Support a time-aware compaction strategy for historical partitions in PK Table

  #4917 closed Mar 3, 2025

• [Feature] Improve the spark merge into performance for append table

  #5136 closed Mar 2, 2025

• [Feature] TagCreationMode#batch should also work for spark writer

  #5181 closed Mar 1, 2025

• [Bug] Merge into paimon table from another paimon table will have ambiguous __paimon_file_path

  #5024 closed Feb 28, 2025

• [Bug] CDC eager_init is not set by option

  #5174 closed Feb 27, 2025

• [Bug] The Dataframe writer should project the partition column by the target table

  #5163 closed Feb 27, 2025

• [Feature] Force creating snapshot for those specified tables even no data ingested

  #5169 closed Feb 27, 2025

• [Bug] The default value of scan.startup.mode causes an exception to occur when kafka is first consumed

  #5120 closed Feb 27, 2025

• [Bug] The Cast is not compatible between spark 3.2 and spark 3.5

  #5038 closed Feb 26, 2025

5 Issues opened by 4 people

• [Question] How to monitor data latency in DV table query

  #5199 opened Mar 3, 2025

• [Feature] Integrate statistics with PaimonSplitScan

  #5196 opened Mar 3, 2025

• [Bug] Deletion of older Iceberg metadata files on new writes causes Iceberg Readers to fail

  #5189 opened Feb 28, 2025

• [Bug] aggregate function in partial update inconsistency

  #5179 opened Feb 28, 2025

• [Feature] Exposing Paimon tags to Iceberg metadata

  #5176 opened Feb 27, 2025

9 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Cdc audit time

  #5138 commented on Mar 3, 2025 • 1 new comment

• [Bug] aggregation options are not verified when executing DDL

  #5079 commented on Feb 25, 2025 • 0 new comments

• [Bug] java.lang.NoSuchMethodError: org.apache.parquet.hadoop.ParquetFileReader.<init> when running BranchSqlITCase in IDEA

  #4517 commented on Feb 28, 2025 • 0 new comments

• [Question] FileStoreCommitImpl.tryCommitOnce failed

  #3496 commented on Feb 28, 2025 • 0 new comments

• [Bug] Apache Paimon schema evolution

  #5004 commented on Mar 4, 2025 • 0 new comments

• [core] Unify the order of procedure loading properties

  #4657 commented on Feb 25, 2025 • 0 new comments

• [cdc] Add debezium-bson format document and bugfix bson value convert to java value

  #4935 commented on Mar 3, 2025 • 0 new comments

• [filesystems] Listing OSS objects with metadata

  #5046 commented on Mar 3, 2025 • 0 new comments

• [doc] Fixes on typo, grammar and format

  #5048 commented on Mar 4, 2025 • 0 new comments