Re: New PPMC Member : Bhavani Sudha

2020-04-08 Thread Bhavani Sudha
Thank you all :) I am excited to be part of Hudi PPMC. -Sudha On Wed, Apr 8, 2020 at 12:48 PM Shiyan Xu wrote: > Congrats Sudha! Well deserved! > > On Tue, Apr 7, 2020 at 8:46 PM vino yang wrote: > > > Congrats sudha, well deserved! > > > > Best, > > Vino > > > > leesf 于2020年4月8日周三 上午9:31写道:

Re: Pyspark with hudi scripts

2020-04-08 Thread Vinoth Govindarajan
Sorry, I mixed up the names in my last comment and missed to provide the jars info. Hi Yaswanth, You need to include the following three jar file using the --jars option to either spark-submit or pyspark command before using the "org.apach.hudi" format in your code to create hudi datasets. -

Apache Hudi Confluence

2020-04-08 Thread 邱晨
Hi, I want to contribute to Apache Hudi. Would you please give me the contributor permission? My CONFLUENCE ID is qiuchen100. Best Regards, Charles Qiu

applications for contribute to Apache Hudi

2020-04-08 Thread 邱晨
Hi, I want to contribute to Apache Hudi. Would you please give me the contributor permission? My JIRA ID is qiuchen100. Best Regards, Charles Qiu

Re: Pyspark with hudi scripts

2020-04-08 Thread Vinoth Govindarajan
Hi Udit, You can use the scripts provided by Yaswanth for reading/writing the hudi dataset using pyspark. I need to understand your requirements little bit more to add formal support. Are you looking for a python command-line tool similar to deltastreamer

Re: Pyspark with hudi scripts

2020-04-08 Thread Vinoth Chandar
Thanks Udit! I also believe there will be a PR soon for pySpark and we should have formal support next release. On Wed, Apr 8, 2020 at 4:49 PM Mehrotra, Udit wrote: > Hi Yaswanth, > > PFA an example I prepared sometime back which can help you get started. > > Thanks, > Udit > > On 4/8/20,

Re: Pyspark with hudi scripts

2020-04-08 Thread Mehrotra, Udit
Hi Yaswanth, PFA an example I prepared sometime back which can help you get started. Thanks, Udit On 4/8/20, 3:21 PM, "Atluri Yaswanth" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and

Re: Apache Hudi Example - Python

2020-04-08 Thread Mehrotra, Udit
Hi Priya, PFA an example I prepared sometime back which can help you get started. Thanks, Udit On 4/8/20, 3:44 PM, "Priyadarshini Shivram" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender

Apache Hudi Example - Python

2020-04-08 Thread Priyadarshini Shivram
Hi, We are currently looking to implement hudi for one of our projects that would need record level inserts and updates and we are specifically looking for examples in python. I did check in the project mentioned in this mailing group

Pyspark with hudi scripts

2020-04-08 Thread Atluri Yaswanth
Hi Team, I would like to know are there any scripts in PySpark to upsert the data in hudi dataset. I am working with Scala now, but i want to use Pyspark as my data is not in good format(i need to use various libraries inside). Thanks in advance yaswanth

Re: [DISCUSS] Upgrade unit test: Junit 5 & AssertJ

2020-04-08 Thread Shiyan Xu
Thank you all for the feedback. > This increases the scope to a overhaul of tests across the project.. Wonder if we can do a RFC for this? Indeed it is overhaul type of change. IMO RFC is needed specifically for the test utility re-design part. Guess it can be created when it's good to start?

Re: New Committer: lamber-ken

2020-04-08 Thread Shiyan Xu
Congrats Lamber-ken! Well deserved! On Wed, Apr 8, 2020 at 4:52 AM Sivabalan wrote: > Congrats Lamber! Well deserved. > > On Wed, Apr 8, 2020 at 5:21 AM Pratyaksh Sharma > wrote: > > > Congratulations lamberken! > > > > On Wed, Apr 8, 2020 at 11:10 AM Jiayi Liao > > wrote: > > > > >

Re: New PPMC Member : Bhavani Sudha

2020-04-08 Thread Shiyan Xu
Congrats Sudha! Well deserved! On Tue, Apr 7, 2020 at 8:46 PM vino yang wrote: > Congrats sudha, well deserved! > > Best, > Vino > > leesf 于2020年4月8日周三 上午9:31写道: > > > Congrats sudha, well deserved! > > > > Balaji Varadarajan 于2020年4月8日周三 上午6:55写道: > > > > > Congratulations Sudha :) Well

Re: New PPMC Member : Bhavani Sudha

2020-04-08 Thread Sivabalan
Congrats Sudha. Well deserved ! On Wed, Apr 8, 2020 at 5:21 AM Pratyaksh Sharma wrote: > Congratulations Sudha! > > On Wed, Apr 8, 2020 at 9:16 AM vino yang wrote: > > > Congrats sudha, well deserved! > > > > Best, > > Vino > > > > leesf 于2020年4月8日周三 上午9:31写道: > > > > > Congrats sudha, well

Re: New Committer: lamber-ken

2020-04-08 Thread Sivabalan
Congrats Lamber! Well deserved. On Wed, Apr 8, 2020 at 5:21 AM Pratyaksh Sharma wrote: > Congratulations lamberken! > > On Wed, Apr 8, 2020 at 11:10 AM Jiayi Liao > wrote: > > > Congratulations! > > > > Best, > > Jiayi Liao > > > > On Wed, Apr 8, 2020 at 12:15 PM tison wrote: > > > > >

Re: New Committer: lamber-ken

2020-04-08 Thread Pratyaksh Sharma
Congratulations lamberken! On Wed, Apr 8, 2020 at 11:10 AM Jiayi Liao wrote: > Congratulations! > > Best, > Jiayi Liao > > On Wed, Apr 8, 2020 at 12:15 PM tison wrote: > > > Congrats lamber! > > > > Best, > > tison. > > > > > > vino yang 于2020年4月8日周三 上午11:45写道: > > > > > Congrats lamber! Well

Re: New PPMC Member : Bhavani Sudha

2020-04-08 Thread Pratyaksh Sharma
Congratulations Sudha! On Wed, Apr 8, 2020 at 9:16 AM vino yang wrote: > Congrats sudha, well deserved! > > Best, > Vino > > leesf 于2020年4月8日周三 上午9:31写道: > > > Congrats sudha, well deserved! > > > > Balaji Varadarajan 于2020年4月8日周三 上午6:55写道: > > > > > Congratulations Sudha :) Well deserved.