Github user ericl commented on the pull request:
https://github.com/apache/spark/pull/12425#issuecomment-210741272
I slightly prefer to have `dataSize` in the following stage so all the
relevant metrics are together, but having it in Exchange seems ok too.
---
If your project is set
Github user ericl commented on a diff in the pull request:
https://github.com/apache/spark/pull/12425#discussion_r59963085
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala
---
@@ -78,8 +82,15 @@ case class ShuffleExchange(
*
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210740750
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210740751
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210740663
**[Test build #55990 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55990/consoleFull)**
for PR 12259 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12412#issuecomment-210738816
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12412#issuecomment-210738814
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12412#issuecomment-210738808
**[Test build #55992 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55992/consoleFull)**
for PR 12412 at commit
Github user davies commented on the pull request:
https://github.com/apache/spark/pull/12425#issuecomment-210736839
@ericl Exchange has `dataSize`, should that be enough?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12412#issuecomment-210736620
**[Test build #55992 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55992/consoleFull)**
for PR 12412 at commit
Github user davies commented on a diff in the pull request:
https://github.com/apache/spark/pull/12427#discussion_r59962714
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecution.scala ---
@@ -52,8 +52,14 @@ private[sql] object SQLExecution {
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12412#issuecomment-210734125
**[Test build #55991 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55991/consoleFull)**
for PR 12412 at commit
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/12340#issuecomment-210729011
Yea I'd say we just support boolean type here for now. If people run into
issue with this we can add other things in the future. I'd much rather have a
simpler
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210727168
**[Test build #55990 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55990/consoleFull)**
for PR 12259 at commit
Github user rxin commented on a diff in the pull request:
https://github.com/apache/spark/pull/12340#discussion_r59961811
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/misc.scala
---
@@ -487,6 +487,43 @@ case class PrintToStderr(child:
Github user yhuai commented on a diff in the pull request:
https://github.com/apache/spark/pull/12405#discussion_r59961810
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSharedState.scala ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software
Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210726962
retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210726369
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210726370
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/12353#issuecomment-210726342
@dongjoon-hyun what's your idea on how to update this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210726294
**[Test build #55988 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55988/consoleFull)**
for PR 12259 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210726302
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210726301
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210726128
**[Test build #55989 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55989/consoleFull)**
for PR 12409 at commit
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/12434
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210725929
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210725927
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210725881
**[Test build #55987 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55987/consoleFull)**
for PR 12413 at commit
Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210725817
LGTM. Merging to master!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12437#issuecomment-210725720
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12437#issuecomment-210725718
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12437#issuecomment-210725635
**[Test build #55986 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55986/consoleFull)**
for PR 12437 at commit
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210725264
Hmm, this is unfortunate. It looks like there are a bunch more assertions
like the one in the `FutureAction` test suite which match on the class / name
of the
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210722539
cc @yhuai
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12438#issuecomment-210722477
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
GitHub user sbcd90 opened a pull request:
https://github.com/apache/spark/pull/12438
SPARK-14632 randomSplit method fails on dataframes with maps in schema
## What changes were proposed in this pull request?
The patch fixes the issue with the randomSplit method which is not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210721724
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210721722
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210721684
**[Test build #55985 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55985/consoleFull)**
for PR 12433 at commit
Github user cenyuhai closed the pull request at:
https://github.com/apache/spark/pull/11605
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210720027
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210720023
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210719503
**[Test build #55984 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55984/consoleFull)**
for PR 12434 at commit
Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/12385#issuecomment-210715151
Thank you! The work requires more and more code changes. Let me split the
work into two parts. One is for handling partitioning-related PR; another is
for handling
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210715004
**[Test build #55989 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55989/consoleFull)**
for PR 12409 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210714759
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210714755
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210714466
@marmbrus Updated with tests and more docs.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210714382
**[Test build #55983 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55983/consoleFull)**
for PR 12259 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210710017
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210710018
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210709916
**[Test build #55982 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55982/consoleFull)**
for PR 12405 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210709842
**[Test build #55988 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55988/consoleFull)**
for PR 12259 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210709838
**[Test build #55987 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55987/consoleFull)**
for PR 12413 at commit
Github user viirya commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210709655
retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210709624
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210709586
Am I doing someyhing wrong?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12437#issuecomment-210704904
**[Test build #55986 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55986/consoleFull)**
for PR 12437 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210704288
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210704293
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
GitHub user rdblue opened a pull request:
https://github.com/apache/spark/pull/12437
SPARK-14679: Fix UI DAG visualization OOM.
## What changes were proposed in this pull request?
The DAG visualization can cause an OOM when generating the DOT file.
This happens because
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12413#issuecomment-210704082
**[Test build #55978 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55978/consoleFull)**
for PR 12413 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12431#issuecomment-210703329
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12431#issuecomment-210703335
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12431#issuecomment-210703057
**[Test build #55980 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55980/consoleFull)**
for PR 12431 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/11746#issuecomment-210702183
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/11746#issuecomment-210702185
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/11746#issuecomment-210702083
**[Test build #55974 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55974/consoleFull)**
for PR 11746 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12434#issuecomment-210701964
**[Test build #55984 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55984/consoleFull)**
for PR 12434 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210701963
**[Test build #55985 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55985/consoleFull)**
for PR 12433 at commit
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210701761
I've decided to just leave the occurrence in `FutureAction` untouched for
now.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210701177
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210701176
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12409#issuecomment-210700821
**[Test build #55979 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55979/consoleFull)**
for PR 12409 at commit
Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210700398
Hmm, those are legitimate test failures. The problem was that wrapping
something in `Exception` changed the exception matched by some test asserts.
---
If your
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/12424
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/12424#issuecomment-210699216
Merging in master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user rxin commented on the pull request:
https://github.com/apache/spark/pull/12424#issuecomment-210699209
This conflicts with mine - but I can redo mine
https://github.com/apache/spark/pull/12434
---
If your project is set up for it, you can reply to this email and have your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210699178
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210699179
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12433#issuecomment-210699113
**[Test build #55972 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55972/consoleFull)**
for PR 12433 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12435#issuecomment-210699054
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12435#issuecomment-210699053
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12435#issuecomment-210698965
**[Test build #55977 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55977/consoleFull)**
for PR 12435 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12246#issuecomment-210697628
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12425#issuecomment-210697630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12425#issuecomment-210697626
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12246#issuecomment-210697627
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210697547
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12425#issuecomment-210697510
**[Test build #55970 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55970/consoleFull)**
for PR 12425 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12246#issuecomment-210697523
**[Test build #55976 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55976/consoleFull)**
for PR 12246 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210697549
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210697414
**[Test build #55973 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55973/consoleFull)**
for PR 12405 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12259#issuecomment-210697123
**[Test build #55983 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55983/consoleFull)**
for PR 12259 at commit
Github user keypointt commented on a diff in the pull request:
https://github.com/apache/spark/pull/12432#discussion_r59957731
--- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala
---
@@ -264,6 +264,9 @@ class KMeans @Since("1.5.0") (
override def
Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/12405#issuecomment-210696867
looks like a legitimate failure?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12429#issuecomment-210696519
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user markgrover commented on the pull request:
https://github.com/apache/spark/pull/11863#issuecomment-210696664
Thanks for this, @koeninger! This is looking really good. I have made some
comments inline.
I noticed that there wasn't a new example, a new KafkaUtils,
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/12429#issuecomment-210696516
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/12429#issuecomment-210696504
**[Test build #55981 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/55981/consoleFull)**
for PR 12429 at commit
1 - 100 of 720 matches
Mail list logo
