Re: HashingTFModel/IDFModel in Structured Streaming

2017-11-15 Thread Jorge Sánchez
Hi, after seeing that IDF needed refactoring to use ML vectors instead of MLLib ones, I have created a Jira ticket in https://issues.apache.org/jira/browse/SPARK-22531 and submitted a PR for it. If anyone can have a look and suggest any changes

Re: Some Spark MLLIB tests failing due to some classes not being registered with Kryo

2017-11-11 Thread Jorge Sánchez
t; directory. > If you want to run only the tests in mllib, you can specify the project > using the -pl argument of mvn. > > Thanks, > Marco > > > > 2017-11-11 13:37 GMT+01:00 Jorge Sánchez : > >> Hi Marco, >> >> Just mvn test from the mllib folder. &

Some Spark MLLIB tests failing due to some classes not being registered with Kryo

2017-11-11 Thread Jorge Sánchez
Hi Dev, I'm running the MLLIB tests in the current Master branch and the following Suites are failing due to some classes not being registered with Kryo: org.apache.spark.mllib.MatricesSuite org.apache.spark.mllib.VectorsSuite org.apache.spark.ml.InstanceSuite I can solve it by registering the f

Re: Crowdsourced triage Scapegoat compiler plugin warnings

2017-07-13 Thread Jorge Sánchez
It might be worth sharing this with the user list, there must be people willing to collaborate who are not on the dev list. 2017-07-13 10:00 GMT+01:00 Sean Owen : > I don't think everything needs to be triaged. There are a ton of useful > changes that have been identified. I think you could just