I am calculating input rate using the following logic. And i think this foreachRDD is always running on driver (println are seen on driver)
1- Is there any other way to do that in less cost . 2- Will this give me the correct count for rate . //code - inputStream.foreachRDD(new Function<JavaRDD<String>, Void>() { @Override public Void call(JavaRDD<String> stringJavaRDD) throws Exception { System.out.println(System.currentTimeMillis()+",spoutstringJavaRDD," + stringJavaRDD.count() ); return null; } }); -- Thanks & Regards, Anshu Shukla