FP Growth saveAsTextFile

2015-05-20 Thread Eric Tanner
I am having trouble with saving an FP-Growth model as a text file. I can print out the results, but when I try to save the model I get a NullPointerException. model.freqItemsets.saveAsTextFile(c://fpGrowth/model) Thanks, Eric

Help understanding the FP-Growth algrithm

2015-04-14 Thread Eric Tanner
I am a total newbe to spark so be kind. I am looking for an example that implements the FP-Growth algorithm so I can better understand both the algorithm as well as spark. The one example I found (on spark .apache.org example) was incomplete. Thanks, Eric

Cluster getting a null pointer error

2014-12-09 Thread Eric Tanner
I have set up a cluster on AWS and am trying a really simple hello world program as a test. The cluster was built using the ec2 scripts that come with Spark. Anyway, I have output the error message (using --verbose) below. The source code is further below that. Any help would be greatly

Unresolved attributes

2014-12-02 Thread Eric Tanner
) at org.apache.spark.sql.catalyst.analysis.Analyzer$CheckResolution$$anonfun$apply$1.applyOrElse(Analyzer.scala:70) It looks like an internal join error or possibly something else. I need to get a work around if possible or a quick patch. Any help is appreciated. Eric -- *Eric Tanner

Scala Spark IDE help

2014-10-27 Thread Eric Tanner
is running locally (on my laptop) I would like to attach the debugger process to the spark program that is running locally to be able to step through the program. Any advice will be is helpful. Eric -- *Eric Tanner*Big Data Developer [image: JustEnough Logo] 15440 Laguna Canyon, Suite 100