Unsubscribe

Unsubscribe

How to get the batch information from Streaming UI

Hi, Does anyone know how to get the batch information(like batch time, input size, processing time, status) from Streaming UI by using Scala/Java API ? Because I want to put the information in log files and the streaming jobs are managed by YARN. Thanks, Samuel

Re: Kafka stream message sampling

Do you have your code snippet? > > HTH > > > > > > Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>

Kafka stream message sampling

Hi, I was trying to use filter to sampling a Kafka direct stream, and the filter function just take 1 messages from 10 by using hashcode % 10 == 0, but the number of events of input for each batch didn't shrink to 10% of original traffic. So I want to ask if there are any way to shrink the batch