Re: Spark Streaming - Direct Approach

2016-07-15 Thread Cody Koeninger
We've been running direct stream jobs in production for over a year, with uptimes in the range of months. I'm pretty slammed with work right now, but when I get time to submit a PR for the 0.10 docs i'll remove the experimental note from 0.8 On Mon, Jul 11, 2016 at 4:35 PM, Tathagata Das

Re: Spark Streaming - Direct Approach

2016-07-11 Thread Tathagata Das
Aah, the docs have not been updated. They are totally in production in many place. Others should chime in as well. On Mon, Jul 11, 2016 at 1:43 PM, Mail.com wrote: > Hi All, > > Can someone please confirm if streaming direct approach for reading Kafka > is still

Re: Spark Streaming - Direct Approach

2016-07-11 Thread Andy Davidson
. I think it has to do with writing to s3. Andy From: "Mail.com" <pradeep.mi...@mail.com> Date: Monday, July 11, 2016 at 1:43 PM To: "user @spark" <user@spark.apache.org> Subject: Spark Streaming - Direct Approach > Hi All, > > Can someone pl

Spark Streaming - Direct Approach

2016-07-11 Thread Mail.com
Hi All, Can someone please confirm if streaming direct approach for reading Kafka is still experimental or can it be used for production use. I see the documentation and talk from TD suggesting the advantages of the approach but docs state it is an "experimental" feature. Please suggest