Re: spark streaming web ui not showing the events - direct kafka api
There have been changes to visibility of info in ui between 1.4 and 1.5, I can't say off the top of my head at which point versions they took place. On Thu, Feb 4, 2016 at 12:07 AM, vimal dinakaranwrote: > No I am using DSE 4.8 which has spark 1.4. Is this a known issue ? > > On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeninger > wrote: > >> Have you tried spark 1.5? >> >> On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran >> wrote: >> >>> Hi , >>> I am using spark 1.4 with direct kafka api . In my streaming ui , I am >>> able to see the events listed in UI only if add stream.print() statements >>> or else event rate and input events remains in 0 eventhough the events gets >>> processed. >>> >>> Without print statements , I have the action saveToCassandra in the >>> dstream. >>> >>> Any reasons why is this not working ? >>> >>> Thanks >>> Vimal >>> >> >> >
Re: spark streaming web ui not showing the events - direct kafka api
No I am using DSE 4.8 which has spark 1.4. Is this a known issue ? On Wed, Jan 27, 2016 at 11:52 PM, Cody Koeningerwrote: > Have you tried spark 1.5? > > On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaran > wrote: > >> Hi , >> I am using spark 1.4 with direct kafka api . In my streaming ui , I am >> able to see the events listed in UI only if add stream.print() statements >> or else event rate and input events remains in 0 eventhough the events gets >> processed. >> >> Without print statements , I have the action saveToCassandra in the >> dstream. >> >> Any reasons why is this not working ? >> >> Thanks >> Vimal >> > >
Re: spark streaming web ui not showing the events - direct kafka api
Have you tried spark 1.5? On Wed, Jan 27, 2016 at 11:14 AM, vimal dinakaranwrote: > Hi , > I am using spark 1.4 with direct kafka api . In my streaming ui , I am > able to see the events listed in UI only if add stream.print() statements > or else event rate and input events remains in 0 eventhough the events gets > processed. > > Without print statements , I have the action saveToCassandra in the > dstream. > > Any reasons why is this not working ? > > Thanks > Vimal >
spark streaming web ui not showing the events - direct kafka api
Hi , I am using spark 1.4 with direct kafka api . In my streaming ui , I am able to see the events listed in UI only if add stream.print() statements or else event rate and input events remains in 0 eventhough the events gets processed. Without print statements , I have the action saveToCassandra in the dstream. Any reasons why is this not working ? Thanks Vimal