Re: Structured Streaming and Hive

2017-09-30 Thread Jacek Laskowski
Hi, Guessing it's a timing issue. Once you started the query the batch 0 did not have rows to save or didn't start yet (it's a separate thread) and so spark.sql ran once and saved nothing. You should rather use foreach writer to save results to Hive. Jacek On 29 Sep 2017 11:36 am, "HanPan"

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Jacek Laskowski
Hi, Oh, yeah. Seen Tejas here and there in the commits. Well deserved. Jacek On 29 Sep 2017 9:58 pm, "Matei Zaharia" wrote: Hi all, The Spark PMC recently added Tejas Patil as a committer on the project. Tejas has been contributing across several areas of Spark for a

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Sameer Agarwal
Congratulations! On Sat, Sep 30, 2017 at 7:51 AM, Kazuaki Ishizaki wrote: > Congratulation Tejas! > > Kazuaki Ishizaki > > > > From:Matei Zaharia > To:"dev@spark.apache.org" > Date:2017/09/30 04:58 >

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Kazuaki Ishizaki
Congratulation Tejas! Kazuaki Ishizaki From: Matei Zaharia To: "dev@spark.apache.org" Date: 2017/09/30 04:58 Subject:Welcoming Tejas Patil as a Spark committer Hi all, The Spark PMC recently added Tejas Patil as a committer

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Nick Pentreath
Congratulations! >> >> Matei Zaharia wrote >> > Hi all, >> > >> > The Spark PMC recently added Tejas Patil as a committer on the >> > project. Tejas has been contributing across several areas of Spark for >> > a while, focusing especially on scalability issues and SQL. Please >> > join me in

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Weichen Xu
Congratulations Tejas ! On Sat, Sep 30, 2017 at 4:05 PM, Liang-Chi Hsieh wrote: > > Congrats! > > > Matei Zaharia wrote > > Hi all, > > > > The Spark PMC recently added Tejas Patil as a committer on the > > project. Tejas has been contributing across several areas of Spark for

Re: Welcoming Tejas Patil as a Spark committer

2017-09-30 Thread Liang-Chi Hsieh
Congrats! Matei Zaharia wrote > Hi all, > > The Spark PMC recently added Tejas Patil as a committer on the > project. Tejas has been contributing across several areas of Spark for > a while, focusing especially on scalability issues and SQL. Please > join me in welcoming Tejas! > > Matei > >