Re: Putting Kafka 0.8 behind an (opt-in) profile

+1 From: Cody Koeninger Sent: Tuesday, September 5, 2017 8:12:07 AM To: Sean Owen Cc: dev Subject: Re: Putting Kafka 0.8 behind an (opt-in) profile +1 to going ahead and giving a deprecation warning now On Tue, Sep 5, 2017 at 6:39 AM, Sean

Re: [VOTE][SPIP] SPARK-21190: Vectorized UDFs in Python

+1 on the design and proposed API. One detail I'd like to discuss is the 0-parameter UDF, how we can specify the size hint. This can be done in the PR review though. On Sat, Sep 2, 2017 at 2:07 AM, Felix Cheung wrote: > +1 on this and like the suggestion of type in

SPIP: SPARK-21866 Image support in Apache Spark

Hello community, I would like to start a discussion about adding support for images in Spark. We will follow up with a formal vote in two weeks. Please feel free to comment on the JIRA ticket too. JIRA ticket: https://issues.apache.org/jira/browse/SPARK-21866 PDF version:

Re: Putting Kafka 0.8 behind an (opt-in) profile

+1 to going ahead and giving a deprecation warning now On Tue, Sep 5, 2017 at 6:39 AM, Sean Owen wrote: > On the road to Scala 2.12, we'll need to make Kafka 0.8 support optional in > the build, because it is not available for Scala 2.12. > >

Re: Spark streaming Kafka 0.11 integration

Here's the jira for upgrading to a 0.10.x point release, which is effectively the discussion of upgrading to 0.11 now https://issues.apache.org/jira/browse/SPARK-18057 On Tue, Sep 5, 2017 at 1:27 AM, matus.cimerman wrote: > Hi guys, > > is there any plans to support

Putting Kafka 0.8 behind an (opt-in) profile

On the road to Scala 2.12, we'll need to make Kafka 0.8 support optional in the build, because it is not available for Scala 2.12. https://github.com/apache/spark/pull/19134 adds that profile. I mention it because this means that Kafka 0.8 becomes "opt-in" and has to be explicitly enabled, and

[Spark][Kinesis] Could I get some committer review on the pull request

Hi All, I've been working on a pull request [1] to allow Spark read from a specific timestamp from Kinesis. I have iterated the patch with the help of other contributors and we think that its in a good state now. This patch would save hours of crash recovery time for Spark while reading off

Spark streaming Kafka 0.11 integration

Hi guys, is there any plans to support Kafka 0.11 integration for Spark streaming applications? I see it doesn't support yet. If there is any way how can I help/contribute, I'll be happy if you point me right direction so that I can give a hand. Sincerely, Matus Cimerman -- Sent from: