Re: How to integrate Spark with OpenCV?

2016-05-23 Thread Jishnu Prathap
Hi Purbanir Integrating Spark with OpenCV was pretty straightforward .Only 2 things to keep in mind ,OpenCV should be installed in each worker and Sytem.loadlibrary() should be written in the program such that it is invoked for each worker once. Thanks & Regards Jishnu Pra

Re: Parallel execution of JavaDStream/JavaPairDStream

2015-03-04 Thread Jishnu Prathap
14/06/19 15:03:36 WARN LoadSnappy: Snappy native library not loaded The problem is Snappy library is not loaded in the workers. This is because you would have written the system.loadlibrary outside map function which is not shipped to the workers. Regards Jishnu Prathap -- View

RE: Spark SQL Stackoverflow error

2015-03-01 Thread Jishnu Prathap
Hi The Issue was not fixed . I removed the between sql layer and directly created features from the file. Regards Jishnu Prathap From: lovelylavs [via Apache Spark User List] [mailto:ml-node+s1001560n21862...@n3.nabble.com] Sent: Sunday, March 01, 2015 4:44 AM To: Jishnu Menath Prathap (WT01

Re: OpenCV + Spark : Where to put System.loadLibrary ?

2015-01-13 Thread Jishnu Prathap
Hi Jaonary Rabarisoa, Where you able to fix this issue? Actually i am trying to integrate OpenCV with Spark.It would be very helpful if you could share your experience in integrating opencv with spark.It would really help me if you could share some code how to use Mat ,IplImage and spark rdd

How to integrate Spark with OpenCV?

2015-01-13 Thread Jishnu Prathap
Hi, Can somone suggest any Video+image processing library which works well with spark. Currently i am trying to integrate OpenCV with Spark. I am relatively new to both spark and OpenCV It would really help me if someone could share some sample code how to use Mat ,IplImage and spark

Stack overflow Error while executing spark SQL

2014-12-09 Thread Jishnu Prathap
HI I am getting Stack overflow Error Exception in main java.lang.stackoverflowerror scala.util.parsing.combinator.Parsers$$anon$3.apply(Parsers.scala:222) at scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1.apply(Parsers.scala:254) at

Re: Spark SQL Stackoverflow error

2014-12-09 Thread Jishnu Prathap
Hi, Unfortunately I am also getting the same error Anybody solved it??.. Exception in main java.lang.stackoverflowerror scala.util.parsing.combinator.Parsers$$anon$3.apply(Parsers.scala:222) at scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1.apply(Parsers.scala:254)