Not able to receive data in spark from rsyslog

I am getting am error that I am not able receive data in spark streaming application from spark.please help with any pointers. 9 - java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at

Using spark in cluster mode

Dear all I want to setup spark in cluster mode. The problem is that each worker node is looking for a file to process.in its local directory.is it possible to setup some thing hdfs so that each worker node take its part of a file from hdfsany good tutorials for this? Thanks

FP-growth on stream data

Is it possible to run FP-growth on stream data in its current versionor a way around? I mean is it possible to use/augment the old tree with the new incoming data and find the new set of frequent patterns? Thanks

Scala api end points

Hi everyone I am new to Scala. I have a written an application using scala in spark Now we want to interface it through rest api end points..what is the best choice with usplease share ur experiences Thanks

Spark Taking too long on K-means clustering

HI every one, I am trying to run KDD data set - basically chapter 5 of the Advanced Analytics with Spark book. The data set is of 789MB, but Spark is taking some 3 to 4 hours. Is it normal behaviour.or some tuning is required. The server RAM is 32 GB, but we can only give 4 GB RAM on 64 bit

Re: Not albe to run FP-growth Example

, masoom alam masoom.a...@wanclouds.net wrote: *Getting the following error:* [INFO] [INFO] [INFO] Building example 0.0.1 [INFO] Downloading

Re: Not albe to run FP-growth Example

These two imports are missing and thus FP-growth is not compiling... import org.apache.spark.*mllib.fpm.FPGrowth*; import org.apache.spark.*mllib.fpm.FPGrowthModel*; How to include the dependency in the POM file? On Sat, Jun 13, 2015 at 4:26 AM, masoom alam masoom.a...@wanclouds.net wrote

Re: Not albe to run FP-growth Example

This is not working: dependency !-- Spark dependency -- groupIdorg.apache.spark.mlib/groupId artifactIdspark-mlib/artifactId !--version1.3.0/version -- scopeprovided/scope /dependency On Sat, Jun 13, 2015 at 11:56 PM, masoom alam

Re: Not albe to run FP-growth Example

AM, masoom alam masoom.a...@wanclouds.net wrote: Thanks a lot. Will try in a while n update Thanks again On Jun 14, 2015 5:13 PM, Sonal Goyal sonalgoy...@gmail.com wrote: Try with spark-mllib_2.10 as the artifactid On Jun 14, 2015 12:02 AM, masoom alam masoom.a...@wanclouds.net wrote

Not albe to run FP-growth Example

Hi every one, I am trying to run the FP growth example. I have tried to compile the following POM file: project groupIdcom.oreilly.learningsparkexamples.mini/groupId artifactIdlearning-spark-mini-example/artifactId modelVersion4.0.0/modelVersion nameexample/name

Re: Not albe to run FP-growth Example

Thanks for the answer. Any example? On Jun 13, 2015 2:13 PM, Sonal Goyal sonalgoy...@gmail.com wrote: I think you need to add dependency to spark mllib too. On Jun 13, 2015 11:10 AM, masoom alam masoom.a...@wanclouds.net wrote: Hi every one, I am trying to run the FP growth example. I have