Re: Welcome new committers and PMC!

2023-05-04 Thread Junjie Chen
Congrats, Amogh, Eduard and Szehon! On Thu, May 4, 2023 at 11:30 PM Dmitri Bourlatchkov wrote: > Congrats, Eduard , Amogh, and Szehon! > > On Wed, May 3, 2023 at 3:07 PM Ryan Blue wrote: > >> Hi everyone, >> >> I want to congratulate Amogh and Eduard, who were just added as Ierberg >> committer

Re: Welcome new PMC members!

2023-04-11 Thread Junjie Chen
Congratulations to all of you! On Wed, Apr 12, 2023 at 10:07 AM Reo Lei wrote: > Congratulations!!! > > yuxia 于2023年4月12日周三 09:19写道: > >> Congratulations to all! >> >> Best regards, >> Yuxia >> >> -- >> *发件人: *"Russell Spitzer" >> *收件人: *"dev" >> *发送时间: *星期三, 2023年

Re: [VOTE] Adopt Puffin format as a file format for statistics and indexes

2022-06-09 Thread Junjie Chen
+1, really nice! Indexes are coming! On Fri, Jun 10, 2022 at 8:04 AM Szehon Ho wrote: > +1, it's an exciting step for Iceberg, look forward to all the new > statistics and secondary indices it will allow. > > Had a few questions of what the reference to Puffin file(s) will be in the > Iceberg sp

Re: Welcome new PMC members!

2021-11-17 Thread Junjie Chen
Congratulations! Thanks for your great contribution! On Thu, Nov 18, 2021 at 10:10 AM wulingqi wrote: > Congratulations to both Jack and Russell! > > > 2021年11月18日 上午8:12,Ryan Blue 写道: > > > > Hi everyone, I want to welcome Jack Ye and Russell Spitzer to the > Iceberg PMC. They've both been ama

Re: Compaction Sync - Monday

2021-04-15 Thread Junjie Chen
I will try to attend this. Thanks for ping me. On Thu, Apr 15, 2021 at 10:32 AM Anton Okolnychyi wrote: > +1 for a meeting to discuss the compaction work. > > It would be great if Zheng and Junjie could make it. We can adjust the > time if needed. > > Thanks, > Anton > > On 14 Apr 2021, at 17:01

Re: Welcoming Russell Spitzer as a new committer

2021-03-29 Thread Junjie Chen
Congratulations, Russell! Nice work! On Tue, Mar 30, 2021 at 5:02 AM Daniel Weeks wrote: > Congrats, Russell! > > On Mon, Mar 29, 2021 at 1:59 PM Ryan Blue > wrote: > >> Congratulations, Russell! >> >> -- Forwarded message - >> From: Gautam Kowshik >> Date: Mon, Mar 29, 2021

Re: Welcoming Ryan Murray as a new committer!

2021-03-29 Thread Junjie Chen
Congratulations. Ryan! On Tue, Mar 30, 2021 at 5:02 AM Daniel Weeks wrote: > Congrats, Ryan and thanks for all the great work! > > On Mon, Mar 29, 2021 at 1:59 PM Ryan Blue > wrote: > >> Congratulations, Ryan! >> >> On Mon, Mar 29, 2021 at 1:49 PM Thirumalesh Reddy >> wrote: >> >>> Congratulat

Re: Welcoming Peter Vary as a new committer!

2021-01-25 Thread Junjie Chen
Congratulations! On Tue, Jan 26, 2021 at 8:26 AM Jun H. wrote: > Congratulations > > On Mon, Jan 25, 2021 at 4:18 PM Yan Yan wrote: > > > > Congratulations! > > > > On Mon, Jan 25, 2021 at 3:03 PM Jun Zhang wrote: > >> > >> Congratulations > >> On 01/26/2021 04:25, Driesprong, Fokko wrote: > >

Re: [VOTE] Release Apache Iceberg 0.10.0 RC2

2020-11-01 Thread Junjie Chen
+ 1 (non-binding) I ran step 1-7 on my cloud virtual machine (centos 7, java 1.8.0_171), all passed. On Mon, Nov 2, 2020 at 10:36 AM OpenInx wrote: > +1 for 0.10.0 RC2 > > 1. Download the source tarball, signature (.asc), and checksum (.sha512): > OK > 2. Import gpg keys: download KEYS and

Re: Flaky tests

2020-10-14 Thread Junjie Chen
I built the master and encounterred following exception but disappearred later: org.apache.iceberg.mr.hive.TestHiveIcebergStorageHandlerWithCustomCatalog > classMethod FAILED java.lang.RuntimeException: Cannot start TestHiveMetastore Caused by: java.sql.SQLTimeoutExcept

Re: Welcoming Jingsong Lee as a new committer

2020-10-09 Thread Junjie Chen
Congratulations! Thanks for your great contribution in Flink sink and source! On Sat, Oct 10, 2020 at 9:10 AM 张军 wrote: > > Congratulations > > JunZhang > zhangjunem...@126.com > >

Re: Welcoming Zheng Hu as a new committer

2020-10-09 Thread Junjie Chen
Congratulations! Thanks for your great contribution in Flink sink and source! On Sat, Oct 10, 2020 at 9:09 AM 张军 wrote: > > Congratulations > > JunZhang > zhangjunem...@126.com > >

Re: Subscribe to the iceberg dev mail list

2020-09-23 Thread Junjie Chen
Hi Kun I think you want to send mail to dev-subscr...@iceberg.apache.org. On Thu, Sep 24, 2020 at 11:25 AM Kun Liu wrote: > Hi, > > subscribe to the dev mail list. > > Best, > Kun Liu > -- Best Regards

Re: [DISCUSS] Rename iceberg-hive module?

2020-08-20 Thread Junjie Chen
+1 for `iceberg-hive-metastore`, also +1 to have a new module to contain the `iceberg-mr`. On Thu, Aug 20, 2020 at 8:13 PM Saisai Shao wrote: > +1 for the changes. > > Mass Dosage 于2020年8月20日周四 下午5:46写道: > >> +1 for `iceberg-hive-metastore` as I found this confusing when I first >> started work

Re: [VOTE] Release Apache Iceberg 0.9.0 RC5

2020-07-13 Thread Junjie Chen
I ran the following steps: - downloaded and verified signature and checksum. - ran ./gradlew build, it took 8m23s on an 8core16g cloud virtual machine. - rebuilt our app with iceberg-spark-runtime-0.9.0.jar and verified on a spark cluster. It works well. +1 (non-binding) On Mon, Jul 13,

Re: Iceberg community sync this week

2020-06-16 Thread Junjie Chen
Hi I 'd like to add one topic about row-level delete planning. We have several large changes recently while the supporting for metadata column in the Spark side has no update. For discussion, how about adding slack channel link to the README and Iceberg website? The slack channel could make good

Re: pull request build is failing

2020-05-19 Thread Junjie Chen
Hi I think you need this fix: https://github.com/apache/incubator-iceberg/pull/1049. On Wed, May 20, 2020 at 10:25 AM Sud wrote: > I am trying to prepare pull request for review but looks like python build > is failing because of unrelated error. > I have seen some other build fail with this er

Re: [VOTE] Graduate to a top-level project

2020-05-12 Thread Junjie Chen
+1 On Wed, May 13, 2020 at 8:07 AM RD wrote: > +1 for graduation! > > On Tue, May 12, 2020 at 3:50 PM John Zhuge wrote: > >> +1 >> >> On Tue, May 12, 2020 at 3:33 PM parth brahmbhatt < >> brahmbhatt.pa...@gmail.com> wrote: >> >>> +1 >>> >>> On Tue, May 12, 2020 at 3:31 PM Anton Okolnychyi >>>

Re: [DISCUSS] Changes for row-level deletes

2020-05-06 Thread Junjie Chen
Hi Ryan Besides the reading and merging of delete files, can we talk a bit about write side of delete files? For example, generate delete files in a spark action, the metadata column support, the service to transfer equality delete files to position delete files etc.. On Wed, May 6, 2020 at 1:34

Re: [VOTE] Release Apache Iceberg 0.8.0-incubating RC1

2020-04-29 Thread Junjie Chen
Ran 1-7 steps found a warning: gpg: assuming signed data in 'apache-iceberg-0.8.0-incubating.tar.gz' gpg: Signature made Wed Apr 29 04:07:57 2020 CST gpg:using RSA key D21CFB9BDBC379681261C7A086781D4FA4B2E9B5 gpg: Good signature from "Ryan Blue (CODE SIGNING KEY) " [unknown] gpg:

Re: Open a new branch for row-delete feature ?

2020-03-30 Thread Junjie Chen
.8.0 release; > 2. flink connector ; > 3. iceberg row-level delete; > 4. Map-Reduce Formats and Hive support. > > We'll release version 0.8.0 around April 15, the following 0.9.0 > will be > released in the next few month. On the other han

Re: What have I learned from doing Merge-On-Read PoC

2020-03-22 Thread Junjie Chen
Great job and nice document @OpenInx! Thanks for sharing the progress! I also did the PoC a couple of weeks ago, you can take a look the code here . My approach is to use the additional meta columns (SRI) and it is based o

Re: Shall we start a regular community sync up?

2020-03-19 Thread Junjie Chen
The same time works for me as well. On Fri, Mar 20, 2020 at 9:43 AM Gautam wrote: > 5 / 5:30pm any day of next week works for me. > > On Thu, Mar 19, 2020 at 6:07 PM 李响 wrote: > >> 5 or 5:30 PM (UTC-7, is it PDT now) in any day works for me. >> Looking forward to it 8-) >> >> On Fri, Mar 20, 20

Iceberg articles for you

2020-03-12 Thread Junjie Chen
Hi devs We recently posted some articles in WeChat public platform to promote Iceberg against China developers community, Here are links: 1. Why I choose Apache Iceberg

Re: upsert base on copy on write mode

2020-03-02 Thread Junjie Chen
NTO in Spark > now, using the validation that Anton added in #351 > <https://github.com/apache/incubator-iceberg/pull/351>. I think he can > provide some more context. > > On Wed, Feb 26, 2020 at 7:42 AM Junjie Chen > wrote: > >> Hi devs >> >> We are

upsert base on copy on write mode

2020-02-26 Thread Junjie Chen
Hi devs We are working on row level delete milestone for upsert feature in merge on read mode. In the meantime, I think it may be useful to have a copy on write implementation. For example, we can implement upsert with spark, so that we can finalize the common APIs that upsert may need and also we

Re: Welcome new committer and PPMC member Ratandeep Ratti

2020-02-16 Thread Junjie Chen
Congratulations! On Mon, Feb 17, 2020 at 5:48 AM Ryan Blue wrote: > Hi everyone, > > I'd like to congratulate Ratandeep Ratti, who was just invited to join the > Iceberg committers adn PPMC! > > Thanks for your contributions and reviews, Ratandeep! > > rb > > -- > Ryan Blue > -- Best Regards

How to add Datafiles from an existing iceberg table?

2019-12-23 Thread Junjie Chen
Hi community I tried to add data files from an existing iceberg table to a target iceberg table with following code (unit test): Iterator datafiles = sourceTable.currentSnapshot().addedFiles().iterator(); while (datafiles.hasNext()) { targetTable.newAppend().appendFile(datafiles.ne