Re: [mllib] Add multiplying large scale matrices

2014-09-06 Thread Yu Ishikawa
Hi Jeremy, Great work! I'm interested in your work. If there is your code on github, could you let me know? -- Yu Ishikawa -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/mllib-Add-multiplying-large-scale-matrices-tp8291p8309.html Sent from the

Re: [mllib] Add multiplying large scale matrices

2014-09-06 Thread Yu Ishikawa
Hi Rong, Great job! Thank you for let me know your work. I will read the source code of saury later. Although AMPLab is working to implement them, would you like to merge it into Spark? Best, -- Yu Ishikawa -- View this message in context:

Your Weekly GPGold Offer Is Waiting Inside

2014-09-06 Thread Aaron Babcock
http://maxigas.rrzconsulting.com/ssnfxezj/fpxihvkqhbkjlwgz.upbuevikyiirz

trimming unnecessary test output

2014-09-06 Thread Nicholas Chammas
Continuing the discussion started here https://github.com/apache/spark/pull/2279, I’m wondering if people already know that certain test output is unnecessary and should be trimmed. For example https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/19917/consoleFull, I see a bunch of

PSA: SI-8835 (Iterator 'drop' method has a complexity bug causing quadratic behavior)

2014-09-06 Thread Erik Erlandson
I tripped over this recently while preparing a solution for SPARK-3250 (efficient sampling): Iterator 'drop' method has a complexity bug causing quadratic behavior https://issues.scala-lang.org/browse/SI-8835 It's something of a corner case, as the impact is serious only if one is repeatedly

Scala's Jenkins setup looks neat

2014-09-06 Thread Nicholas Chammas
After reading Erik's email, I found this Scala PR https://github.com/scala/scala/pull/3963 and immediately noticed a few cool things: - Jenkins is hooked directly into GitHub somehow, so you get the All is well message in the merge status window, presumably based on the last test status

Re: Scala's Jenkins setup looks neat

2014-09-06 Thread Reynold Xin
that would require github hooks permission and unfortunately asf infra wouldn't allow that. Maybe they will change their mind one day, but so far we asked about this and the answer has been no for security reasons. On Saturday, September 6, 2014, Nicholas Chammas nicholas.cham...@gmail.com

Re: Scala's Jenkins setup looks neat

2014-09-06 Thread Nicholas Chammas
Aww, that's a bummer... On Sat, Sep 6, 2014 at 1:10 PM, Reynold Xin r...@databricks.com wrote: that would require github hooks permission and unfortunately asf infra wouldn't allow that. Maybe they will change their mind one day, but so far we asked about this and the answer has been no

Re: amplab jenkins is down

2014-09-06 Thread Josh Rosen
It looks like Jenkins is up and running, but there seems to be a delay in responding to requests to re-test patches.  It seems like Jenkins is promptly testing new PRs, or new commits as they’re added to existing PRs, but taking a very long time to respond to requests to re-test PRs. I’m going

Re: [VOTE] Release Apache Spark 1.1.0 (RC4)

2014-09-06 Thread Tathagata Das
+1 Tested streaming integration with flume on a local test bed. On Thu, Sep 4, 2014 at 6:08 PM, Kan Zhang kzh...@apache.org wrote: +1 Compiled, ran newly-introduced PySpark Hadoop input/output examples. On Thu, Sep 4, 2014 at 1:10 PM, Egor Pahomov pahomov.e...@gmail.com wrote: +1

Re: trimming unnecessary test output

2014-09-06 Thread Sean Owen
This is just a line logging that one test succeeded right? I don't find that noise. Recently I wanted to search test run logs for a test case success and it was important that the individual test case was logged. On Sep 6, 2014 4:13 PM, Nicholas Chammas nicholas.cham...@gmail.com wrote:

Re: [VOTE] Release Apache Spark 1.1.0 (RC4)

2014-09-06 Thread Reza Zadeh
+1 Tested recently merged mllib matrix multiplication bugfix https://github.com/apache/spark/pull/2224 On Sat, Sep 6, 2014 at 2:35 PM, Tathagata Das tathagata.das1...@gmail.com wrote: +1 Tested streaming integration with flume on a local test bed. On Thu, Sep 4, 2014 at 6:08 PM, Kan Zhang