RE: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support

2019-05-12 Thread tcondie
+1 (non-binding)

 

Tyson Condie

 

From: Kazuaki Ishizaki  
Sent: Thursday, May 9, 2019 9:17 AM
To: Bryan Cutler 
Cc: Bobby Evans ; Spark dev list ;
Thomas graves 
Subject: Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar
Processing Support

 

+1 (non-binding)

Kazuaki Ishizaki



From:Bryan Cutler mailto:cutl...@gmail.com> >
To:Bobby Evans mailto:bo...@apache.org> >
Cc:Thomas graves mailto:tgra...@apache.org> >,
Spark dev list mailto:dev@spark.apache.org> >
Date:2019/05/09 03:20
Subject:Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended
Columnar Processing Support

  _  




+1 (non-binding)

On Tue, May 7, 2019 at 12:04 PM Bobby Evans < 
bo...@apache.org> wrote:
I am +!

On Tue, May 7, 2019 at 1:37 PM Thomas graves < 
tgra...@apache.org> wrote:
Hi everyone,

I'd like to call for another vote on SPARK-27396 - SPIP: Public APIs
for extended Columnar Processing Support.  The proposal is to extend
the support to allow for more columnar processing.  We had previous
vote and discussion threads and have updated the SPIP based on the
comments to clarify a few things and reduce the scope.

You can find the updated proposal in the jira at:
 
https://issues.apache.org/jira/browse/SPARK-27396.

Please vote as early as you can, I will leave the vote open until next
Monday (May 13th), 2pm CST to give people plenty of time.

[ ] +1: Accept the proposal as an official SPIP
[ ] +0
[ ] -1: I don't think this is a good idea because ...

Thanks!
Tom Graves

-
To unsubscribe e-mail:  
dev-unsubscr...@spark.apache.org





Need to clean up temporary files created post dataframe deletion.

2019-05-12 Thread Nasrulla Khan Haris
HI All,

I am new to apache spark core, I have custom datasource v2 connector for spark 
and I am looking for some suggestions deleting temp files created by the 
connector.

Any ideas would helpful.

Thanks for your help in advance.
Nasrulla


[SPARK-27457][SQL] modify bean encoder to support avro objects

2019-05-12 Thread Taoufik Dachraoui
Hi

Is someone looking at the PR https://github.com/apache/spark/pull/24367 ?

how much does it take to be fixed with this PR ?

PS: note that there is 2 other PRs related to avro encoding support (
https://github.com/apache/spark/pull/24299, and
https://github.com/apache/spark/pull/21348)

Kind regards



-- 
Taoufik Dachraoui