11 Pull requests merged by 11 people

• Revert "Skip getFileStatus call during iceberg to delta clone"

  #3855 merged Nov 8, 2024

• [Spark] Accept generated columns of nested types that differ in nullability

  #3859 merged Nov 8, 2024

• [Hudi] Disable a flaky UniForm Hudi unit test

  #3854 merged Nov 7, 2024

• [SPARK] Add metric for DV-related errors

  #3858 merged Nov 7, 2024

• Implement parser changes for Lite Vacuum

  #3857 merged Nov 7, 2024

• [Spark] Reflect a new parameter in the constructor of LogicalRelation for Spark 4.0

  #3847 merged Nov 7, 2024

• [Spark] Add DeltaTable.addFeatureSupport API to PySpark

  #3786 merged Nov 7, 2024

• [Spark] Support partition-like data filters

  #3831 merged Nov 6, 2024

• [Spark] Fix wrong entry in COLUMN_MAPPING_METADATA_KEYS

  #3848 merged Nov 6, 2024

• [INFRA] Add structured logging linter script to github workflow

  #3840 merged Nov 5, 2024

• [Spark] Move some ICT test helper utils to InCommitTimestampTestUtils.scala

  #3843 merged Nov 5, 2024

10 Pull requests opened by 7 people

• [SPARK] Add SQL metrics for ConvertToDelta

  #3841 opened Nov 4, 2024

• [Other] Fix typos in the documentation

  #3842 opened Nov 4, 2024

• Fixes the behavior of throwing table not found error during CREATE OR REPLACE Delta uniform table

  #3845 opened Nov 5, 2024

• [Spark] Validate computed state against checksum on checkpoint

  #3846 opened Nov 5, 2024

• [Spark] Ignore internal metadata when detecting schema changes in Delta source

  #3849 opened Nov 6, 2024

• [WIP] [Kernel] ICT log replay

  #3850 opened Nov 6, 2024

• [Spark]Add OPTIMUZE FULL history support

  #3852 opened Nov 6, 2024

• [Test][Don't merge] test failed tests

  #3853 opened Nov 6, 2024

• add retry logic for delta uniform iceberg conversion

  #3856 opened Nov 7, 2024

• [Spark] Remove use of current_date in MERGE test

  #3860 opened Nov 8, 2024

2 Issues opened by 2 people

• [Feature Request] OPTIMIZE FULL/Force reclustering full table

  #3844 opened Nov 4, 2024

• [BUG][Spark] UniForm table creation fails with "shadedForDelta.org.apache.iceberg.mr.hive.HiveIcebergSerDe not found" if Hive is Iceberg-enabled

  #3839 opened Nov 2, 2024

12 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [Kernel] Added Domain Metadata support to Delta Kernel

  #3835 commented on Nov 8, 2024 • 103 new comments

• [Kernel] [CC Refactor #3] Add `ConfigurationProvider` and `AbstractCommitCoordinatorBuilder` APIs

  #3798 commented on Nov 4, 2024 • 19 new comments

• [Kernel] [CC Refactor #4] Add InMemoryCommitCoordinatorClient and new FileSystemClient APIs

  #3803 commented on Nov 4, 2024 • 13 new comments

• [Spark] Delta Tables with Unity Catalog (UC) as Commit Coordinator

  #3837 commented on Nov 6, 2024 • 6 new comments

• [Kernel] Add `Snapshot::getTimestamp` public API

  #3791 commented on Nov 6, 2024 • 4 new comments

• [Spark] Allow missing fields with implicit casting during streaming write

  #3822 commented on Nov 5, 2024 • 4 new comments

• One Commit Coordinator Interface to rule them all

  #3817 commented on Nov 4, 2024 • 0 new comments

• [Bug] Output parsed stats for delta lake tables

  #2000 commented on Nov 5, 2024 • 0 new comments

• [Feature Request]Delta kernel can not get file stats

  #3771 commented on Nov 5, 2024 • 0 new comments

• [Feature Request] Make VACUUM more efficient via optimistic execution mode

  #3106 commented on Nov 5, 2024 • 0 new comments

• [Delta Sharing] Enable D2D delta sharing with type widening

  #3675 commented on Nov 4, 2024 • 0 new comments

• [Kernel] Reduce deprecate Path class usage

  #3824 commented on Nov 7, 2024 • 0 new comments