Re: [VOTE] Release Apache Iceberg 1.7.0 RC0

FYI, I just identified a Parquet data loss issue(newly introduced in 1.14.0), and I confirmed it affects the Spark use cases, I’m not sure if it also affects Iceberg cases. https://github.com/apache/parquet-java/issues/3040 Thanks, Cheng Pan > On Oct 31, 2024, at 06:06, Russell Spit

Re: Building with JDK 21

A basic question, is iceberg-hive-metastore considered part of the "Hive module"? I suppose that HMS 2.x is still widely used. AFAIK, the current iceberg-hive-metastore is compatible with HMS 2.1+, based on Iceberg and Spark CI, I also suppose it works well with Java 8 to 21. Thanks,

RE: [VOTE] Release Apache Iceberg 1.5.2 RC0

+1 (non-binding) Integrated with Apache Kyuubi[1], the CI covers - Iceberg Spark 3.3-3.5 with Scala 2.12 - Iceberg Spark 3.5 with Scala 2.13 [1] https://github.com/apache/kyuubi/pull/6361 Thanks, Cheng Pan On 2024/05/01 17:25:08 Amogh Jahagirdar wrote: > Hi Everyone, > > I propos

Re: allowing configs to be specified in SQLConf for Spark reads/writes

classifying a configuration into SQLConf or OPTION? Thanks, Cheng Pan > On Jul 5, 2023, at 16:26, Cheng Pan wrote: > > I would argue that the SQLConf way is more in line with Spark > user/administrator habits. > > It’s a common practice that Spark administrators set configur

Re: allowing configs to be specified in SQLConf for Spark reads/writes

mostly is: can it be fixed by adding a spark configuration? The OPTIONS way brings additional learning efforts to Spark users and how can Spark administrators set them at cluster level? Thanks, Cheng Pan > On Jun 17, 2023, at 04:01, Wing Yew Poon wrote: > > Hi, > I recently put up

Re: [DISCUSS] Apache Iceberg Release 1.2.1

Hi Daniel, Thanks for bringing up this discussion, I suppose the following PR should be included in 1.2.1 https://github.com/apache/iceberg/pull/7153 Thanks, Cheng Pan On Apr 3, 2023 at 12:08:26, Daniel Weeks wrote: > Hey Iceberg Community, > > I wanted to start a discussion aroun

Re: [VOTE] Release Apache Iceberg 1.1.0 RC4

+1 (non-binding) Passed integration test[1] w/ Apache Kyuubi [1] https://github.com/apache/incubator-kyuubi/pull/3810 Thanks, Cheng Pan On Nov 23, 2022 at 16:13:34, Ajantha Bhat wrote: > +1 (non-binding) > > - verified tests against spark-3.3 runtime jar with Nessie catalog. >

Re: [VOTE] Release Apache Iceberg 0.12.1 RC0

+1 (non-binding) The integration test based on the master branch of Apache Kyuubi (Incubating) passed. https://github.com/apache/incubator-kyuubi/pull/1338 Thanks, Cheng Pan On Fri, Nov 5, 2021 at 1:19 PM Kyle Bendickson wrote: > > > +1 (binding) > > - Validated checksums,

Re: Iceberg 0.12.1 Patch Release - Call for Bug Fixes and Patches

Hope this can get in. https://github.com/apache/iceberg/pull/3203 Thanks, Cheng Pan On Thu, Oct 21, 2021 at 11:34 AM Reo Lei wrote: > Thanks Kyle for syncing this! > > I think PR#3240 should be include in this release. Because in our Dingding > group, we have received feedback fro