Re: [VOTE] Spark 2.1.2 (RC2)

2017-09-28 Thread Luciano Resende
+1 (non-binding) Minor comments: The apache infra has a staging repository to add release candidates, and it might be better/simpler to use that instead of home.a.o. See https://dist.apache.org/repos/dist/dev/spark/. On Tue, Sep 26, 2017 at 9:47 PM, Holden Karau wrote:

Re: [discuss] Data Source V2 write path

2017-09-28 Thread Wenchen Fan
> When this CTAS logical node is turned into a physical plan, the relation gets turned into a `DataSourceV2` instance and then Spark gets a writer and configures it with the proposed API. The main point of this is to pass the logical relation (with all of the user's options) through to the data

[Streaming] Requesting more Committers for Spark-Kinesis integration

2017-09-28 Thread Yash Sharma
Hi Fellow Spark developers/ PMC Members, I am a new member of the community and have started my tiny contributions to Spark-Kinesis Integration. I am trying to fill in the gaps in making spark operate with Kinesis as nicely as Kafka. I am writing this mail to highlight an issue with the kinesis

Re: [VOTE][SPIP] SPARK-21866 Image support in Apache Spark

2017-09-28 Thread Tim Hunter
Thank you everyone for the comments and the votes. We will follow up shortly with a pull request. On Wed, Sep 27, 2017 at 6:32 PM, Joseph Bradley wrote: > This vote passes with 11 +1s (4 binding) and no +0s or -1s. > > +1: > Sean Owen (binding) > Holden Karau > Denny Lee

Re: Inclusion of Spark on SDKMAN

2017-09-28 Thread Sean Owen
I don't think Spark would ever distributed except through the ASF and mainstream channels like Maven Central, but you can redistribute the bits as-is as you like. This would be in line with the terms of the Apache license. On Thu, Sep 28, 2017 at 6:17 AM Marco Vermeulen