Example of GBTClassifier

2017-10-02 Thread mckunkel
Greetings, I am trying to run the example in the example directory for the GBTClassifier. But when I view this code in eclipse, I get an error such that "The method setLabelCol(String) is undefined for the type GBTClassifier" For the line GBTClassifier gbt = new

Upgraded to spark 2.2 and get Guava error

2017-09-28 Thread mckunkel
Greetings, I am trying to upgrade from 2.1.1 to 2.2 When I run some of the basic examples given on the webpage, I get an error Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.()V from class org.apache.hadoop.mapred.FileInputFormat

Re: Testing another Dataset after ML training

2017-07-11 Thread mckunkel
Im not sure why I cannot subscribe, so that everyone can view the conversation. Help? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Testing-another-Dataset-after-ML-training-tp28845p28846.html Sent from the Apache Spark User List mailing list archive at

Testing another Dataset after ML training

2017-07-11 Thread mckunkel
Greetings, Following the example on the AS page for Naive Bayes using Dataset https://spark.apache.org/docs/latest/ml-classification-regression.html#naive-bayes I want to predict the outcome of another set of

Spark Encoder with mysql Enum and data truncated Error

2017-06-27 Thread mckunkel
I am using Spark via Java for a MYSQL/ML(machine learning) project. In the mysql database, I have a column "status_change_type" of type enum = {broke, fixed} in a table called "status_change" in a DB called "test". I have an object StatusChangeDB that constructs the needed structure for the

Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot resolve

2017-06-26 Thread mckunkel
First Spark project. I have a Java method that returns a Dataset. I want to convert this to a Dataset, where the Object is named StatusChangeDB. I have created a POJO StatusChangeDB.java and coded it with all the query objects found in the mySQL table. I then create a Encoder and convert the