Re: unsafe/compile error

2015-06-21 Thread Andrea Jemmett
Thank you, that worked! *Andrea Jemmett* 2015-06-21 21:10 GMT+02:00 Reynold Xin : > Put them in quotes, e.g. > > sbt/sbt "mllib/testOnly *NaiveBayesSuite" > > On Sun, Jun 21, 2015 at 11:15 AM, acidghost > wrote: > >> Something like mllib/testOnly NaiveBayesSuite is what I need! >> >> But it's n

Re: Approximate rank-based statistics (median, 95-th percentile, etc.) for Spark

2015-06-21 Thread Reynold Xin
One way for this to happen is to have the intermediate data for the aggregate function be a byte array operated using Unsafe -- that plays very nicely with the binary data processing we are doing (i.e. fast serialization, no gc). The downside is that we'd need to re-implement whatever algorithm is

Re: [jenkins] ERROR: Publisher 'Publish JUnit test result report' failed: No test report files were found. Configuration error?

2015-06-21 Thread Yu Ishikawa
Hi Josh, Thank you for your continuous support. I'm looking forward to the fix. Thanks, Yu - -- Yu Ishikawa -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/jenkins-ERROR-Publisher-Publish-JUnit-test-result-report-failed-No-test-report-files-wer

Re: [jenkins] ERROR: Publisher 'Publish JUnit test result report' failed: No test report files were found. Configuration error?

2015-06-21 Thread Josh Rosen
This is a side effect of the new pull request tester script interacting badly with a Jenkins plugin, not anything caused by your changes. I'm working on a fix but in the meantime I'd just trust what SparkQA says. Sent from my phone > On Jun 21, 2015, at 1:54 PM, Yu Ishikawa wrote: > > Hi all,

[jenkins] ERROR: Publisher 'Publish JUnit test result report' failed: No test report files were found. Configuration error?

2015-06-21 Thread Yu Ishikawa
Hi all, How do I deal with the error on the official Jenkins? https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35412/console ``` Archiving unit tests logs... > Send successful. Attempting to post to Github... > Post successful. Archiving artifacts WARN: No artifacts found that

Re: unsafe/compile error

2015-06-21 Thread Reynold Xin
Put them in quotes, e.g. sbt/sbt "mllib/testOnly *NaiveBayesSuite" On Sun, Jun 21, 2015 at 11:15 AM, acidghost wrote: > Something like mllib/testOnly NaiveBayesSuite is what I need! > > But it's not working, runs all mllib suites. > > > > -- > View this message in context: > http://apache-spark

Web UI and History Server are Inconsistent; Web UI sometimes cannot process logs

2015-06-21 Thread jcai
I am running a very simple program (WordCount) on Spark stand-alone mode. I find that when I examine the web UI, a couple bugs arise: 1. There is a discrepancy between the number denoting the duration of the application when I run the history server and the number given by the web UI (default addr

Re: unsafe/compile error

2015-06-21 Thread acidghost
Something like mllib/testOnly NaiveBayesSuite is what I need! But it's not working, runs all mllib suites. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/unsafe-compile-error-tp12815p12820.html Sent from the Apache Spark Developers List mailing list

Re: unsafe/compile error

2015-06-21 Thread Burak Yavuz
In addition, if you want to run a single suite, you may use: mllib/testOnly $SUITE_NAME with sbt. On Jun 21, 2015 10:32 AM, "Burak Yavuz" wrote: > You need to build an assembly jar for the cluster tests to pass. You may > use 'sbt assembly/assembly'. > > Best, > Burak > On Jun 21, 2015 3:43 AM, "

Re: unsafe/compile error

2015-06-21 Thread Burak Yavuz
You need to build an assembly jar for the cluster tests to pass. You may use 'sbt assembly/assembly'. Best, Burak On Jun 21, 2015 3:43 AM, "acidghost" wrote: > After an sbt update the tests run. But all the "cluster" ones fail on "task > size should be small in both training and prediction" > >

JIRA 2344 status (Fuzzy C-Means)

2015-06-21 Thread salexln
Hi guys, Does anyone know what is the status of this issue? (https://issues.apache.org/jira/browse/SPARK-2344) Beniamino was supposed to add an implementation but it seems that his code was removed from Github (https://github.com/bdelpizzo/mllib-extension/blob/master/clustering/FCM.scala) and h

Re: unsafe/compile error

2015-06-21 Thread acidghost
After an sbt update the tests run. But all the "cluster" ones fail on "task size should be small in both training and prediction" -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/unsafe-compile-error-tp12815p12816.html Sent from the Apache Spark Develop

unsafe/compile error

2015-06-21 Thread acidghost
Hello there!I'm getting a compilation error when trying to run sbt mllib/test.Here're the errors: [info] Compiling 15 Java sources to /media/SB-1TB/workarea/apache-spark/unsafe/target/scala-2.10/classes...[error] /media/SB-1TB/workarea/apache-spark/unsafe/src/main/java/org/apache/spark/unsafe/memor