RE: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support

2019-05-12 Thread tcondie
+1 (non-binding) Tyson Condie From: Kazuaki Ishizaki Sent: Thursday, May 9, 2019 9:17 AM To: Bryan Cutler Cc: Bobby Evans ; Spark dev list ; Thomas graves Subject: Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support +1 (non-binding) Kazuaki Ishizaki

Need to clean up temporary files created post dataframe deletion.

2019-05-12 Thread Nasrulla Khan Haris
HI All, I am new to apache spark core, I have custom datasource v2 connector for spark and I am looking for some suggestions deleting temp files created by the connector. Any ideas would helpful. Thanks for your help in advance. Nasrulla

[SPARK-27457][SQL] modify bean encoder to support avro objects

2019-05-12 Thread Taoufik Dachraoui
Hi Is someone looking at the PR https://github.com/apache/spark/pull/24367 ? how much does it take to be fixed with this PR ? PS: note that there is 2 other PRs related to avro encoding support ( https://github.com/apache/spark/pull/24299, and https://github.com/apache/spark/pull/21348) Kind