Re: [VOTE] Clarify writer requirements in the spec to prevent orphan DVs

+1 (non-binding) Thanks, Steve Zhang > On May 14, 2025, at 8:52 AM, Anton Okolnychyi wrote: > > Hi all, > > I propose the following update to the spec to clarify that writers must > remove any deletion vector that applies to a data file when that data file is > remo

Re: [VOTE] Merge details about GZip metadata files to the spec.

+1 (non-binding) Thanks, Steve Zhang > On May 11, 2025, at 6:45 PM, Gang Wu wrote: > > +1 (non-binding)

Re: [VOTE] Small spec change for default values

+1 (non binding) Thanks, Steve Zhang > On Apr 22, 2025, at 1:41 PM, Prashant Singh wrote: > > +1 (non-binding) > > Best, > Prashant Singh > > On Tue, Apr 22, 2025 at 2:55 AM Eduard Tudenhöfner <mailto:etudenhoef...@apache.org>> wrote: >> +1 >

Re: [VOTE] Spec Update: Variant Field Lower/Upper Bounds

+1 (non-binding) Thanks, Steve Zhang > On Apr 18, 2025, at 1:29 PM, huaxin gao wrote: > > +1 (non-binding)

Re: [VOTE] Simplify multi-argument field-id(s) encoding

+1 (non-binding) Thanks, Steve Zhang > On Apr 18, 2025, at 12:53 AM, Prashant Singh wrote: > > +1 (non-binding)

Re: [VOTE] Row lineage required for v3

+1 (non binding) Thanks, Steve Zhang > On Mar 31, 2025, at 11:05 PM, Jean-Baptiste Onofré wrote: > > +1 (non binding)

Re: Table metadata swap not work for REST Catalog (#12134)

metadata.json have a different table UUI as the existing one. We appreciate any insights or suggestions you may have. Best, Steve Zhang > On Feb 10, 2025, at 4:47 PM, Steve Zhang > wrote: > > Thank you Russell and Ryan. > > Let me start to work on a new API to support force tab

Re: [VOTE] Minor simplifications for Geo Spec

+1 (non-binding) Thanks, Steve Zhang > On Mar 18, 2025, at 6:29 PM, Gang Wu wrote: > > +1 (non-binding)

Re: [VOTE] Release Apache Iceberg 1.8.1 RC1

+1 (non-binding) - Checked signature/SHA512 - Ran RAT license check - Ran tests on JDK17 Thanks, Steve Zhang > On Feb 27, 2025, at 11:45 AM, Daniel Weeks wrote: > > +1 (binding) > > Verified sigs/sums/license/build/test (Java 17) > > -Dan > > On Thu, Feb 27

Re: [VOTE] Java implementation notes around current-snapshot-id

+1 (nb) Thanks, Steve Zhang > On Feb 24, 2025, at 6:32 PM, Renjie Liu wrote: > > +1 > > On Tue, Feb 25, 2025 at 7:00 AM Szehon Ho <mailto:szehon.apa...@gmail.com>> wrote: >> +1 >> >> Thanks >> Szehon >> >> On Mon, Feb 2

Re: Remove deprecated table properties

Thanks Fokko for removing deprecated properties! Just want to highlight the worst case for tables with old configuration and not aware of this deprecation might experience silent behavior change. But considering this has been deprecated for past 3 years, here’s my +1. Thanks, Steve Zhang

Re: [Discuss] Print un-pretty metadata JSON files without whitespace

+1. Configure table property `write.metadata.compression-codec` to gzip is usually suggested to reduce metadata size but drop whitespace can still help here. Thanks, Steve Zhang > On Feb 17, 2025, at 8:32 AM, Fokko Driesprong wrote: > > Hey Ian, > > Thanks for raising th

Re: [VOTE] Add overwriteRequested to RegisterTableRequest in REST spec

Thanks everyone for participating and reviewing! The vote has passed with the following results: +1 binding votes: 8 (Russell,Steven,Fokko,Daniel,Ryan,Yufei,Szhon,Eduard) +1 non-binding votes: 4 (Huang-Hsiang,Anurag,Huaxin,myself) 0 votes: none -1 votes: none Thanks, Steve Zhang > On Feb

[VOTE] Add overwriteRequested to RegisterTableRequest in REST spec

ps://github.com/apache/iceberg/pull/12239 This vote will be open for at least 72 hours. [ ] +1 Add overwriteRequested to RegisterTableRequest in REST spec [ ] +0 [ ] -1 I have questions and/or concerns Thanks, Steve Zhang

Re: [VOTE] Release Apache Iceberg 1.8.0 RC0

+1 (non-binding) - Checked signature/SHA512 - Ran RAT check - Ran tests on JDK17 Thanks, Steve Zhang > On Feb 12, 2025, at 9:52 AM, Eduard Tudenhöfner > wrote: > > +1 (binding) > > Verified sigs/checksums/build/tests with JDK17 > > I also saw the same TestS3Fi

Re: [VOTE] Add RemoveSchemas update type to REST spec

+1 nb Thanks, Steve Zhang > On Feb 11, 2025, at 10:26 AM, Honah J. wrote: > > +1 > > On Tue, Feb 11, 2025 at 10:16 AM Christian Thiel <mailto:christian.t.b...@gmail.com>> wrote: >> +1 (non-binding) >> Thanks Gabor! >> >> On Tue,

Re: Table metadata swap not work for REST Catalog (#12134)

Thank you Russell and Ryan. Let me start to work on a new API to support force table registration in catalog. Thanks, Steve Zhang > On Feb 10, 2025, at 4:29 PM, rdb...@gmail.com wrote: > > Yeah, it sounds like a "register table force" is the right concept here. I >

Re: Table metadata swap not work for REST Catalog (#12134)

metadata swap on an existing table. However, it was suggested that use TableOperations.commit(base, new) is preferred to achieve atomicity. Thanks, Steve Zhang > On Feb 10, 2025, at 1:49 PM, Daniel Weeks wrote: > > Hey Steve, > > I think the issue here is that you're using the

Re: [VOTE] Simplify multi-arg table metadata

+1 (non-binding). Thanks, Steve Zhang > On Feb 9, 2025, at 1:01 AM, Fokko Driesprong wrote: > > (Second attempt, the cat <https://ibb.co/Wv4M2TDY> ran over the keyboard) > > Hey everyone, > > After the positive responses on the devlist > &l

Table metadata swap not work for REST Catalog (#12134)

/apache/iceberg/issues/12134, where it works on JDBC and in-memory catalogs, but not with RESTCatalog. Best Regards, Steve Zhang

Re: [VOTE] Add Geometry and Geography types for V3

+1 (non-binding), Thank you Szehon for driving this over 5+ months and looking forward to see in V3 spec. Thanks, Steve Zhang > On Feb 6, 2025, at 12:11 PM, Jia Yu wrote: > > +1 (non-binding) > > I can’t wait to see the impact it will have on the broader geospatial > c

Re: Welcome Huaxin Gao as a committer!

Congratulations Huaxin, well deserved! Thanks, Steve Zhang > On Feb 6, 2025, at 8:16 AM, Xingyuan Lin wrote: > > Congrats Huaxin! > > On Thu, Feb 6, 2025 at 11:11 AM Denny Lee <mailto:denny.g@gmail.com>> wrote: >> Congratulations Huaxin!!! >> >

Re: [DISCUSS/VOTE] Add in ChangeLog Reserved Field IDs to Spec and Decrement Row Lineage Reserved IDs

+1 (non-binding) Thanks, Steve Zhang > On Jan 25, 2025, at 10:48 AM, huaxin gao wrote: > > +1 (non-binding)

Re: [Discuss][Vote] Spec Change - Add optional field added-rows to Snapshot for Row Lineage

Thank you Russell! +1 (non-binding) Thanks, Steve Zhang > On Jan 15, 2025, at 10:53 PM, huaxin gao wrote: > > +1 (non-binding)

Re: [VOTE] Document Snapshot Summary Optional Fields as Appendix in Spec

+1 non-binding Thanks, Steve Zhang > On Jan 14, 2025, at 1:14 PM, Kevin Liu wrote: > > +1 non-binding.

Re: New committer: Scott Donnelly

Congratulations Scott! Thanks, Steve Zhang > On Dec 11, 2024, at 4:47 AM, Fokko Driesprong wrote: > > Congratulations Scott! >

Re: New committer: Matt Topol

Congrats Matt! Thanks, Steve Zhang > On Dec 10, 2024, at 7:24 AM, Gang Wu wrote: > > Congrats Matt!

Re: [Discuss] Simplify tableExists API in HiveCatalog

plans to change other existing behaviors. I've addressed the feedback from reviewers and also added explicit tests coverage, PR is ready for another look in https://github.com/apache/iceberg/pull/11597. Thanks, Steve Zhang > On Nov 27, 2024, at 10:15 PM, Péter Váry wrote: > > +

[Discuss] Simplify tableExists API in HiveCatalog

://github.com/apache/iceberg/pull/11597 [2]: https://github.com/apache/iceberg/blob/3badfe0c1fcf0c0adfc7aa4a10f0b50365c48cf9/open-api/rest-catalog-open-api.yaml#L1129-L1133 Best regards, Steve Zhang

Re: [DISCUSS] Deprecate embedded manifests

+1 to deprecate Thanks, Steve Zhang > On Nov 19, 2024, at 3:32 AM, Fokko Driesprong wrote: > > Hi everyone, > > I would like to propose to deprecate embedded manifests > <https://github.com/apache/iceberg/pull/11586>. This has been used before the > manifest

Re: [VOTE] Deprecate and remove last-column-id

+1 nb Thanks, Steve Zhang > On Nov 19, 2024, at 12:18 AM, Fokko Driesprong wrote: > > Hi everyone, > > Based on the positive feedback on the [DISCUSS] thread > <https://lists.apache.org/thread/jz5s7pm2bhbm87ft495d6yrsh3bqvtb9> and the > pull-request on GitHub

Re: [DISCUSS] Spark 3.3 support?

+1 to deprecating and removing it Thanks, Steve Zhang > On Nov 13, 2024, at 11:23 AM, Eduard Tudenhöfner > wrote: > > +1 to deprecating and removing it

Re: [VOTE] Deletion Vectors in V3

+1 (non-binding) Thanks, Steve Zhang > On Oct 31, 2024, at 3:41 PM, rdb...@gmail.com wrote: > > +1 > > Thanks, Anton! > > On Wed, Oct 30, 2024 at 11:58 PM Fokko Driesprong <mailto:fo...@apache.org>> wrote: >> +1 >> >> I had to read up a

Re: [DISCUSS] Remove iceberg-pig module ?

+1 Thanks, Steve Zhang > On Oct 17, 2024, at 11:16 PM, roryqi wrote: > > +1. > > Péter Váry mailto:peter.vary.apa...@gmail.com>> > 于2024年10月18日周五 13:44写道： >> +1 >> >> On Fri, Oct 18, 2024, 04:50 Manu Zhang > <mailto:owenzhang1...@gmail.com&

Re: [DISCUSS] Drop Hive 2 support

+1 Thanks, Steve Zhang > On Sep 9, 2024, at 11:45 AM, Russell Spitzer > wrote: > > +1 > > On Mon, Sep 9, 2024 at 7:59 AM Eduard Tudenhöfner <mailto:etudenhoef...@apache.org>> wrote: >> +1 on deprecating Hive 2 in Iceberg 1.7 and removing it in 1.8 >

Re: [VOTE] Merge REST Spec Change To Add New Scan Planning APIs

, Steve Zhang > On Sep 4, 2024, at 9:53 AM, Chertara, Rahil > wrote: > > An endpoint fetchScanTasks was added in order for a client to get the > file-scan-tasks associated with a plan-task by providing a plan-task as input. >

Re: [Discuss] test logging is broken and Avro 1.12.0 upgraded slf4j-api dep to 2.x

I believe dependabot tried to upgrade self4j to 2.x in [1] but JB mentioned there's -1 on this upgrade, maybe he has more context. [1]https://github.com/apache/iceberg/pull/9688 Thanks, Steve Zhang > On Aug 24, 2024, at 7:37 PM, Steven Wu wrote: > > Hi, > > It seems

Re: clarification on changelog behavior for equality deletes

cannot be used together. Thanks, Steve Zhang > On Aug 22, 2024, at 8:50 AM, Steven Wu wrote: > > > It should emit changes for each snapshot in the requested range. > > Wing Yew has a good point here. +1 > > On Thu, Aug 22, 2024 at 8:46 AM Wing Yew Poon > wrote:

Re: clarification on changelog behavior for equality deletes

I agree that option (a) is what user expects for row level changes. I feel the added deletes in given snapshots provides a PK of DELETED entry, existing deletes are used to read together with data files to find DELETED value (V1b) and result of columns. Thanks, Steve Zhang > On Aug

Re: [VOTE] Spec changes in preparation for v3

+1 (non-binding) Thanks, Steve Zhang > On Aug 19, 2024, at 1:47 PM, John Zhuge wrote: > > +1 (non-binding) > > On Mon, Aug 19, 2024 at 1:34 PM Yufei Gu <mailto:flyrain...@gmail.com>> wrote: >> +1 >> Yufei >> >> >> On Mon,

Re: Welcome Péter, Amogh and Eduard to the Apache Iceberg PMC

Congrats everyone, well deserved! Thanks, Steve Zhang > On Aug 13, 2024, at 1:31 PM, Bill Zhang wrote: > > Congratulations everyone. > > On Tue, Aug 13, 2024 at 1:28 PM Szehon Ho <mailto:szehon.apa...@gmail.com>> wrote: >> Congratulations all, very well des

Re: [VOTE] Clarify "File System Tables" in the table spec

+1 (non-binding) Thanks, Steve Zhang > On Aug 1, 2024, at 2:25 PM, John Zhuge wrote: > > +1 (non-binding) > > On Thu, Aug 1, 2024 at 10:55 AM Amogh Jahagirdar <2am...@gmail.com > <mailto:2am...@gmail.com>> wrote: >> +1 (non-binding) >> &g

Re: [VOTE] Drop Java 8 support in Iceberg 1.7.0

+1 (non-binding) Thanks, Steve Zhang > On Jul 26, 2024, at 9:15 AM, Amogh Jahagirdar <2am...@gmail.com> wrote: > > +1 (non-binding)

Re: Java String to Expression Util?

/caf03aed926665014c22cc4a68902bf684f258f9/core/src/main/java/org/apache/iceberg/expressions/ExpressionParser.java#L262-L264 Thanks, Steve Zhang > On Jul 25, 2024, at 11:54 AM, Pucheng Yang wrote: > > Hi dev community, > > If I read the codebase correctly, there seems to be no utility for converting

Re: [ANNOUNCE] Welcoming new committers and PMC members

Congrats everyone! Thanks, Steve Zhang > On Jul 23, 2024, at 9:20 AM, Anton Okolnychyi wrote: > > Congrats everyone!

Re: Dropping JDK 8 support

+1 (non-binding) Thanks, Steve Zhang > On Jul 22, 2024, at 10:13 PM, Ajantha Bhat wrote: > > +1 (non-binding)

Re: [ANNOUNCE] Welcoming new committers and PMC members

Congrats everyone! Thanks, Steve Zhang > On Jul 23, 2024, at 9:20 AM, Anton Okolnychyi wrote: > > Congrats everyone!

Re: [VOTE] Release Apache Iceberg 1.6.0 RC1

+1 non-binding Checked signature, SHA512 and license, built and ran tests against java 17 Thanks, Steve Zhang > On Jul 22, 2024, at 3:29 PM, Jack Ye wrote: > > +1 (binding) > > Checked signature, checksum, license > Ran unit and integration tests with JDK17 > Ran ma

Re: [DISCUSS] DROP PARTITION in Spark

-iceberg-do-differently Thanks, Steve Zhang > On Jul 17, 2024, at 2:36 PM, Walaa Eldin Moustafa > wrote: > > Hi Jean, One use case is Hive to Iceberg migration, where DROP PARTITION does > not need to change to DELETE queries prior to the migration. > > That said, I am not in

Re: [DISCUSS] Enable the discussion tab for iceberg github repos

+1, looking forward to see it in action, would 3 months be a good evaluation window for rest of the iceberg repo? Thanks, Steve Zhang > On Jul 11, 2024, at 9:52 AM, Yufei Gu wrote: > > +1. It is a no-brainer to me given it is more search-engine friendly compared > to slack a

Re: [Vote] Deprecate oauth tokens endpoint

+1 (non binding) Thanks, Steve Zhang > On Jul 10, 2024, at 7:31 AM, Renjie Liu wrote: > > +1 (non binding)

Re: [VOTE] Fix property names in REST spec for statistics / partition statistics

+1 (non binding) Thanks, Steve Zhang > On Jul 10, 2024, at 1:10 AM, Jean-Baptiste Onofré wrote: > > +1 (non binding)

Re: Making the NDV property required for theta sketch blobs in Puffin

+1 for making the NDV property required in blob metadata Thanks, Steve Zhang > On Jun 21, 2024, at 2:54 PM, Amogh Jahagirdar <2am...@gmail.com> wrote: > > make the property required

Re: [Early Feedback] Variant and Subcolumnarization Support

Great ideas! Looking forward to the community focused proposal in details and how it can benefit iceberg! Thanks, Steve Zhang > On May 10, 2024, at 10:06 PM, Tyler Akidau > wrote: > > Subcolumnarization of variant columns allows query engines to efficiently > prune datasets

Re: New committer: Renjie Liu

Congrats Renjie! Thanks, Steve Zhang > On Mar 11, 2024, at 12:18 PM, Szehon Ho wrote: > > Congratulations! > > On Mon, Mar 11, 2024 at 12:43 PM Jack Ye <mailto:yezhao...@gmail.com>> wrote: >> Congratulations Renjie! >> >> Best, >> Jack Y

Re: New committer: Bryan Keller

Congrats Bryan, well deserved! Thanks, Steve Zhang > On Mar 5, 2024, at 9:44 AM, Szehon Ho wrote: > > Congratulations Bryan, well deserved, great work on Iceberg ! > > On Tue, Mar 5, 2024 at 8:14 AM Jack Ye <mailto:yezhao...@gmail.com>> wrote: >> Congrats Bry

Re: [VOTE] Release Apache PyIceberg 0.6.0rc1

of 0.6.0! Thanks, Steve Zhang > On Jan 31, 2024, at 8:33 AM, Pucheng Yang wrote: > > nvm, I was under the wrong impression it was released already. Thanks. > > On Wed, Jan 31, 2024 at 8:31 AM Pucheng Yang <mailto:py...@pinterest.com>> wrote: >> 0.6.0 has been re

Re: [DISCUSS] PyIceberg 0.6.0 release

I am really excited to see the both append and overwrite support are finally checked and in favor of seeing it in 0.6.0 release. It’s a big milestone worth celebrating! I am happy to help with partitioned write and sort order. Thanks, Steve Zhang > On Jan 26, 2024, at 5:22 AM, Fo

Re: [DISCUSS] Iceberg community summit

I am also happy to contribute here! Thanks, Steve Zhang > On Jan 16, 2024, at 4:17 PM, Bill Zhang wrote: > > Same here. We'd like to volunteer and help out with this summit. > > On Mon, Jan 15, 2024 at 4:46 AM Eduard Tudenhoefner <mailto:edu...@tabular.io>> w

JDBC namespace existence check #8340

in https://github.com/apache/iceberg/issues/8321 and https://github.com/apache/iceberg/issues/8832. Thanks, Steve Zhang

Re: [VOTE] Release Apache Iceberg 1.4.1 RC0

+1 (non-binding) - validated checksum and signature - checked license docs & ran RAT checks - ran build and tests using JDK17 (problem with TestS3RestSigner and ADLSFileIOTest related but I think it’s setup related) Thanks, Steve Zhang > On Oct 19, 2023, at 4:23 AM, Ajantha Bhat

Re: Welcome new committers and PMC!

Congrats everyone! Well deserved and great job! Thanks, Steve Zhang > On May 3, 2023, at 5:52 PM, Prashant Singh wrote: > > Congratulations, Amogh, Eduard, Szehon Well deserved ! > > On Wed, May 3, 2023 at 3:07 PM Steven Wu <mailto:stevenz...@gmail.com>>

Re: Support create table like for Iceberg table?

https://iceberg.apache.org/docs/latest/spark-ddl/#create-table <https://iceberg.apache.org/docs/latest/spark-ddl/#create-table> Thanks, Steve Zhang > On Apr 25, 2023, at 1:46 PM, Pucheng Yang wrote: > > Hi all, > > I wonder how folks in the community deal with the cases where y

Re: [DISCUSS] Dropping Spark 2.4 support

+1 for dropping Spark 2.4 support and we can clean up doc as well such as https://iceberg.apache.org/docs/latest/spark-queries/#spark-24 Thanks, Steve Zhang > On Apr 13, 2023, at 12:53 PM, Jack Ye wrote: > > +1 for dropping 2.4 support >

Re: Welcome new PMC members!

Congratulations everyone! Thanks, Steve Zhang > On Apr 11, 2023, at 9:46 PM, Eduard Tudenhoefner wrote: > > Congrats to everyone! > > On Wed, Apr 12, 2023 at 6:14 AM Ajantha Bhat <mailto:ajanthab...@gmail.com>> wrote: > Congratulations to all. > > On Wed

Re: [DISCUSS] Removing python_legacy from the repo

Thank you Fokko and Ryan for your great work to reach feature parity. pyiceberg is the way to go! Thanks, Steve Zhang > On Feb 17, 2023, at 8:29 AM, Ryan Blue wrote: > > +1 for removing it. And it's great to see the new one reaching feature parity! > > On Fri, Feb

Re: [VOTE] Release Apache PyIceberg 0.2.0

t; But I cannot seem to figure out what’s wrong here. Thanks, Steve Zhang > On Dec 6, 2022, at 3:36 PM, Ryan Blue wrote: > > Russell, we normally test with `make test`, which runs everything but the S3 > mock stuff since that runs in CI. That said, it would be great if we could

Re: [VOTE] Release Apache PyIceberg 0.1.0 RC2

Thank you Fokko, also forgot to update my vote to +1 given package version is clarified. Thank you for the great work! Steve Zhang > On Sep 30, 2022, at 8:02 AM, Driesprong, Fokko wrote: > > Hey Everyone, > > Thanks all for checking the release, and we can conclude the vot

Re: [VOTE] Release Apache PyIceberg 0.1.0 RC2

in local they are fine) Issues: - same version issue as Ryan pointed out Thanks, Steve Zhang > On Sep 25, 2022, at 10:37 AM, Ryan Blue wrote: > > +0 > > Looks great, except that the version isn’t correct: pyiceberg.__version__ > returns 0.1.0rc2 > > Passin

Re: Welcome Fokko Driesprong as a committer!

Congrats Fokko! Thanks, Steve Zhang > On Aug 22, 2022, at 2:05 PM, Szehon Ho wrote: > > Congratulations! > Szehon > > On Mon, Aug 22, 2022 at 12:25 PM Péter Váry <mailto:peter.vary.apa...@gmail.com>> wrote: > Congratulations Fokko! > > On Mon, A

Re: Data retention and expire the last snapshot

snapshot to be expired. I think it works for me. Appreciate your pointers Thanks, Steve Zhang > On Jun 29, 2022, at 4:32 PM, Russell Spitzer > wrote: > > Is "truncate" not an option? This would do a table wide delete which would > create a new snapshot which you can

Data retention and expire the last snapshot

iginal state right after table creation, before any data is written. Thanks, Steve Zhang

Re: Welcome Szehon Ho as a committer!

Congratulations Szehon, Well done! Thanks, Steve Zhang > On Mar 11, 2022, at 3:51 PM, Jack Ye wrote: > > Congratulations Szehon!! > > -Jack > > On Fri, Mar 11, 2022 at 3:45 PM Wing Yew Poon > wrote: > Congratulations Szehon! > > > On Fri, Mar 11,