Re: [DISCUSS] Evaluate usage of Immutables library

My intention was not to rewrite significant pieces of existing & working code. The experiment with *TableMetadata* was for example to show an alternative approach to writing simple hand-written builders (since we get the builder for free). #3580 just co

Re: Vendor integration strategy

Thanks Jack for bringing this up, and thanks Ryan for sharing your point. > Getting a minimal set of transitive dependencies, relocating the classes that they pull in to avoid conflicts, and tracking licensing is a huge amount of work that has so far been done or validated by a very small set of p

Re: [DISCUSS] Evaluate usage of Immutables library

I created #3697 that gives an example of how subclasses of *FileScanTask* can be converted to Immutables. On Thu, Dec 9, 2021 at 1:53 AM Jack Ye wrote: > For JSON serialization of objects such as FileScanTask, I have been > experimenting about the be

Re: Some questions related to compaction support.

Ajantha, Thanks for reverting the change that removed the compaction action from Spark 2.4. I just wanted to understand the difference between the compaction action in Spark 2.4 and Spark >= 3.0 . What is functionally different between the two implementations? In other words, what would we miss out