spark.streaming.receiver.maxRate Not taking effect

2015-07-01 Thread Laeeq Ahmed
Hi, I have set spark.streaming.receiver.maxRate to 100. My batch interval is 4sec but still sometimes there are more than 400 records per batch. I am using spark 1.2.0. Regards,Laeeq

Re: spark.streaming.receiver.maxRate Not taking effect

2015-07-01 Thread Ted Yu
This might be related: SPARK-6985 Cheers On Wed, Jul 1, 2015 at 10:27 AM, Laeeq Ahmed laeeqsp...@yahoo.com.invalid wrote: Hi, I have set spark.streaming.receiver.maxRate to 100. My batch interval is 4sec but still sometimes there are more than 400 records per batch. I am using spark