Github user aarondav commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11797052
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spark
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-4023
Since we donât separate user partitioner and product partitioner. With
little chance a user can set a different partitioner that works magically
better than the default,
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40888761
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40888753
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have thi
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40888757
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11796793
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spa
Github user andrewor14 commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11796787
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spa
Github user CodingCat commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11796568
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spar
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885762
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14266/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885761
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885663
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885664
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14265/
---
If your project is set up for it, you can r
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/451
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885285
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40885282
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user aarondav commented on the pull request:
https://github.com/apache/spark/pull/451#issuecomment-40884557
LGTM, thanks Michael.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user aarondav commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11796306
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spark
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40884437
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40884436
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40884375
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40884379
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14262/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40884380
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14263/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40884377
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40884378
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14264/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40884376
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40883719
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40883723
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user tmyklebu commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40883661
Handled most of your comments. I didn't change the assert in the "negative
ids" test and I left the partitioner null handling as is. I don't see a nicer
way to handle t
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40883634
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/407#issuecomment-40883632
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40882724
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user CodingCat commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40882735
Hi, @aarondav , thanks, my bad, just address them, attached the screenshot
here
![image](https://cloud.githubusercontent.com/assets/678008/2749648/ba50534e-c814-11e3
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40882725
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/442
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/452
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/447
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabl
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40882224
Cool, thanks for porting this over! A few notes:
- I looked at msgpack in the past and one problem with it was that users
need to install it separately through "pip" to
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/442#issuecomment-40882048
Merged into master and branch 1.0, thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project d
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40882025
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14261/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40882024
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/447#issuecomment-40882012
Merged, thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40881999
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40881994
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/452#issuecomment-40881961
Merged, thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
e
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40881907
Jenkins, this is ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have th
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/456#issuecomment-40881706
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your proj
GitHub user esoroush opened a pull request:
https://github.com/apache/spark/pull/456
Coding Task
The goal is to improve the performance of the HiveTableScan Operator:
As a quick benchmark run the following code in the scala interpreter:
scala> :paste
hql("C
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/300#issuecomment-40881112
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14260/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/300#issuecomment-4088
Build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this f
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/300#issuecomment-40881085
Build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/300#issuecomment-40881088
Build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this fe
Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/448#issuecomment-40880763
I agree with leaving union out and adding repartition, coalesce and the
other version of distinct. Also these should definitely be added to Java and
Python too.
---
If yo
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/442#issuecomment-40879990
I doubt Hotspot can remove this allocation, but am not sure. It would have
to do a couple things -- inline the call to 2 other constructors, realize
there's no threading is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40879592
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14257/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40879591
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user tmyklebu commented on the pull request:
https://github.com/apache/spark/pull/442#issuecomment-40879543
@srowen: Does Hotspot actually generate code for the allocation and the
dead store with the bad ctor? I haven't picked through it yet.
---
If your project is set up for
Github user mengxr commented on the pull request:
https://github.com/apache/spark/pull/442#issuecomment-40879445
LGTM. Thanks for fixing it! @matei Could you help merge this into both
master and branch-1.0?
---
If your project is set up for it, you can reply to this email and have yo
Github user tmyklebu commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795406
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCo
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795397
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795373
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795354
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795349
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user tmyklebu commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795347
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala ---
@@ -114,6 +116,14 @@ class ALS private (
this
}
+
Github user tmyklebu commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795344
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCo
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795338
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795333
--- Diff:
mllib/src/test/scala/org/apache/spark/mllib/recommendation/ALSSuite.scala ---
@@ -128,6 +128,34 @@ class ALSSuite extends FunSuite with LocalSparkCont
Github user tmyklebu commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795330
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala ---
@@ -114,6 +116,14 @@ class ALS private (
this
}
+
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795323
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala ---
@@ -167,11 +177,23 @@ class ALS private (
this.numBlocks
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40879001
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14259/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40879000
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878965
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795311
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala ---
@@ -114,6 +116,14 @@ class ALS private (
this
}
+
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878970
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user mengxr commented on a diff in the pull request:
https://github.com/apache/spark/pull/407#discussion_r11795309
--- Diff:
mllib/src/main/scala/org/apache/spark/mllib/recommendation/ALS.scala ---
@@ -114,6 +116,14 @@ class ALS private (
this
}
+
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878606
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14258/
---
If your project is set up for it, you can r
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878604
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878576
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
GitHub user MLnick opened a pull request:
https://github.com/apache/spark/pull/455
[WIP] SPARK-1416: PySpark support for SequenceFile and Hadoop InputFormats
So I finally resurrected this PR. It seems the old one against the
incubator mirror is no longer available, so I cannot refer
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/455#issuecomment-40878570
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40877384
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/454#issuecomment-40877379
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
GitHub user mengxr opened a pull request:
https://github.com/apache/spark/pull/454
SPARK-1539: RDDPage.scala contains RddPage class
SPARK-1386 changed RDDPage to RddPage but didn't change the filename. I
tried sbt/sbt publish-local. Inside the spark-core jar, the unit name is
RDDPa
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/360#issuecomment-40874845
Merged build finished.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/360#issuecomment-40874847
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14256/
---
If your project is set up for it, you can r
Github user aarondav commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11794573
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -124,17 +125,16 @@ private[ui] class StageTable(
case 0 => ""
Github user epahomov commented on the pull request:
https://github.com/apache/spark/pull/81#issuecomment-40873951
Yep. In our organization to connect 2 machines in network you need to
specify target ip and host(security issues). If host constantly changing you
can not run spark.
---
Github user aarondav commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11794357
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spark
Github user aarondav commented on a diff in the pull request:
https://github.com/apache/spark/pull/421#discussion_r11794343
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StageTable.scala ---
@@ -27,34 +27,36 @@ import org.apache.spark.ui.UIUtils
import org.apache.spark
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/360#issuecomment-40872477
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not ha
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/360#issuecomment-40872482
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/299#discussion_r11793588
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -108,6 +110,21 @@ object SparkSubmit {
val sysProps = new HashMap[Stri
Github user CodingCat commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40867809
Hi, @kayousterhout , thanks for the comments, fixed
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If yo
Github user witgo commented on the pull request:
https://github.com/apache/spark/pull/332#issuecomment-40863767
@marmbrus
You are right ,macros is faster than the inline method. There's a short gap.
the [test
code](https://github.com/witgo/spark/blob/logger/core/src/test/
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40862859
All automated tests passed.
Refer to this link for build results:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14255/
---
If your project
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/421#issuecomment-40862858
Merged build finished. All automated tests passed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
95 matches
Mail list logo
