That's the correct fix. I have this done along with a few other Java examples that still use the old MLlib Vectors in this PR thats waiting for review https://github.com/apache/spark/pull/14308
On Jul 28, 2016 5:14 AM, "Robert Goodman" <bsg...@gmail.com> wrote: > I changed import in the sample from > > import org.apache.spark.mllib.linalg.*; > > to > > import org.apache.spark.ml.linalg.*; > > and the sample now runs. > > Thanks > Bob > > > On Wed, Jul 27, 2016 at 1:33 PM, Robert Goodman <bsg...@gmail.com> wrote: > > I tried to run the JavaAFTSurvivalRegressionExample on Spark 2.0 and the > > example doesn't work. It looks like the problem is that the example is > using > > the MLLib Vector/VectorUDT to create the DataSet which needs to be > converted > > using MLUtils before using in the model. I haven't actually tried this > yet. > > > > When I run the example (/bin/run-example > > ml.JavaAFTSurvivalRegressionExample), I get the following stack trace > > > > Exception in thread "main" java.lang.IllegalArgumentException: > requirement > > failed: Column features must be of type > > org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually > > org.apache.spark.mllib.linalg.VectorUDT@f71b0bce. > > at scala.Predef$.require(Predef.scala:224) > > at > > > org.apache.spark.ml.util.SchemaUtils$.checkColumnType(SchemaUtils.scala:42) > > at > > > org.apache.spark.ml.regression.AFTSurvivalRegressionParams$class.validateAndTransformSchema(AFTSurvivalRegression.scala:106) > > at > > > org.apache.spark.ml.regression.AFTSurvivalRegression.validateAndTransformSchema(AFTSurvivalRegression.scala:126) > > at > > > org.apache.spark.ml.regression.AFTSurvivalRegression.fit(AFTSurvivalRegression.scala:199) > > at > > > org.apache.spark.examples.ml.JavaAFTSurvivalRegressionExample.main(JavaAFTSurvivalRegressionExample.java:67) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:729) > > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) > > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) > > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124) > > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > > > > > Are you suppose to be able use the ML version of VectorUDT? The Spark 2.0 > > API docs for Java, don't show the class but I was able to import the > class > > into a java program. > > > > Thanks > > Bob > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
