Hi Mehdi, Do you try a larger value of "spark.streaming.ui.retainedBatches"(default is 1000)?
Regards, - Terry On Fri, Jan 29, 2016 at 5:45 PM, Mehdi Ben Haj Abbes <mehdi.ab...@gmail.com> wrote: > Hi folks, > > I have a streaming job running for more than 24 hours. It seems that there > is a limit on the number of the batches displayed in the Streaming Statics > visualization screen. For example if I would launch a job Friday I will not > be able to have the statistics for what happened during Saturday. I will > have the batches that have run the previous 24 hours and today it was like > only the previous 3 hours. > > Any help will be very appreciated. > -- > Mehdi BEN HAJ ABBES > >
