Re: Dependency on TestingUtils in a Spark package

2016-01-12 Thread Robert Dodier
nd it seems like it would be a good idea to have a uniform testing environment between the PR and the Spark package. best, Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional command

Dependency on TestingUtils in a Spark package

2016-01-12 Thread Robert Dodier
ject which was doing something similar. Thanks in advance for any light you can shed on this problem. Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org

Re: Problem in running MLlib SVM

2015-12-01 Thread Robert Dodier
very large range of outputs -- something like -6*10^6 to -400, with a mean of about -3. If you look into it, let us know what you find, I would be interested to hear about it. best, Robert Dodier -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Pr

slightly more informative error message in MLUtils.loadLibSVMFile

2015-10-23 Thread Robert Dodier
would want to print something else, all that matters is to give some context so that the user can find the problem more quickly. Hope this helps in some way. Robert Dodier PS. diff --git a/mllib/src/main/scala/org/apache/spark/mllib/util/MLUtils.scala b/mllib/src/main/scala/org/apache/spark/

Re: SPARK_MASTER_IP actually expects a DNS name, not IP address

2015-10-18 Thread Robert Dodier
Nicholas, FWIW the --ip option seems to have been deprecated in commit d90d2af1, but that was a pretty big commit, lots of other stuff changed, and there isn't any hint in the log message as to the reason for changing --ip. best, Robert D

Re: SPARK_MASTER_IP actually expects a DNS name, not IP address

2015-10-17 Thread Robert Dodier
ged to disallow --ip without propagating that backwards into any scripts that call it? Hope this helps in some way. Robert Dodier -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/SPARK-MASTER-IP-actually-expects-a-DNS-n

sbt test error -- "Could not reserve enough space"

2015-10-09 Thread Robert Dodier
ly simple) but it seems to do a lot more work than just running that one test, and I still get the out-of-memory errors. Aside from getting a machine with more memory (which is not out of the question), are there any stretegies for coping with out-of-memory errors in Maven and/or sbt? Thanks in adva

Re: ideas for MLlib development

2015-03-04 Thread Robert Dodier
a very high level, the API for this framework would specify methods to compute conditional distributions, marginalizing as necessary via MCMC. Other operations could include computing the expected value of a variable or function. All this is very reminiscent of BUGS, of course.

ideas for MLlib development

2015-03-03 Thread Robert Dodier
seful contribution. Thanks for your interest and I look forward to your comments. Robert Dodier - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org