Hi, I have two different topics and two Kafka receivers, one for each topic. Regards,Laeeq
On Monday, April 20, 2015 4:28 PM, Evo Eftimov <evo.efti...@isecc.com> wrote: #yiv4992037734 #yiv4992037734 -- _filtered #yiv4992037734 {panose-1:2 4 5 3 5 4 6 3 2 4;} _filtered #yiv4992037734 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2 4;} _filtered #yiv4992037734 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4 4 2 4;}#yiv4992037734 #yiv4992037734 p.yiv4992037734MsoNormal, #yiv4992037734 li.yiv4992037734MsoNormal, #yiv4992037734 div.yiv4992037734MsoNormal {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv4992037734 a:link, #yiv4992037734 span.yiv4992037734MsoHyperlink {color:blue;text-decoration:underline;}#yiv4992037734 a:visited, #yiv4992037734 span.yiv4992037734MsoHyperlinkFollowed {color:purple;text-decoration:underline;}#yiv4992037734 p.yiv4992037734MsoListParagraph, #yiv4992037734 li.yiv4992037734MsoListParagraph, #yiv4992037734 div.yiv4992037734MsoListParagraph {margin-top:0in;margin-right:0in;margin-bottom:0in;margin-left:.5in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv4992037734 span.yiv4992037734EmailStyle17 {color:#1F497D;}#yiv4992037734 .yiv4992037734MsoChpDefault {font-size:10.0pt;} _filtered #yiv4992037734 {margin:1.0in 1.0in 1.0in 1.0in;}#yiv4992037734 div.yiv4992037734WordSection1 {}#yiv4992037734 _filtered #yiv4992037734 {} _filtered #yiv4992037734 {}#yiv4992037734 ol {margin-bottom:0in;}#yiv4992037734 ul {margin-bottom:0in;}#yiv4992037734 What is meant by “streams” here: 1. Two different DSTream Receivers producing two different DSTreams consuming from two different kafka topics, each with different message rate 2. One kafka topic (hence only one message rate to consider) but with two different DStream receivers (ie running in parallel) giving a start of two different DSTreams From: Laeeq Ahmed [mailto:laeeqsp...@yahoo.com.INVALID] Sent: Monday, April 20, 2015 3:15 PM To: user@spark.apache.org Subject: Equal number of RDD Blocks Hi, I have two streams of data from kafka. How can I make approx. equal number of RDD blocks of on two executors.Please see the attachement, one worker has 1785 RDD blocks and the other has 26. Regards,Laeeq