Hi Pradeep I can not comment about experimental or production, how ever I recently started a POC using direct approach.
Its been running off and on for about 2 weeks. In general it seems to work really well. One thing that is not clear to me is how the cursor is manage. E.G. I have my topic set to delete after 1 hr. I have had some problem that caused huge delaying. I.E. They are running after the data is deleted. After lots of jobs fail it seems to recover. I.E. The cursor advance to valid position. I am running into problems how ever I do not think it has to do with the direct approach. I think it has to do with writing to s3. Andy From: "Mail.com" <pradeep.mi...@mail.com> Date: Monday, July 11, 2016 at 1:43 PM To: "user @spark" <user@spark.apache.org> Subject: Spark Streaming - Direct Approach > Hi All, > > Can someone please confirm if streaming direct approach for reading Kafka is > still experimental or can it be used for production use. > > I see the documentation and talk from TD suggesting the advantages of the > approach but docs state it is an "experimental" feature. > > Please suggest > > Thanks, > Pradeep > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
