Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22524
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22524
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22613
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22612
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22318
For a query similar to the one in the PR description:
`a.join(b, a("id") === b("id"), "inner").join(c, a("id") === b("id"),
"inner"`
It is interpreted as a cartesian products now.
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22613
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22612
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22613
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22612
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rezasafi commented on the issue:
https://github.com/apache/spark/pull/22612
Previously I opened a WIP PR
[here](https://github.com/apache/spark/pull/21916) and
[here](https://github.com/rezasafi/spark/pull/1). I have applied all the
comments that I received there to this
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/22613
cc @dongjoon-hyun
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user shahidki31 opened a pull request:
https://github.com/apache/spark/pull/22613
[SPARK-25583][DOC][BRANCH-2.3]Add history-server related configuration in
the documentation.
## What changes were proposed in this pull request?
This is a follow up PR for the PR,
GitHub user rezasafi opened a pull request:
https://github.com/apache/spark/pull/22612
[SPARK-24958] Add executors' process tree total memory information to
heartbeat signals.
Spark executors' process tree total memory information can be really
useful. Currently such information
Github user rezasafi commented on the issue:
https://github.com/apache/spark/pull/21916
I will close this and open the actual Pr shortly. Thank you everyone for
the great reviews.
---
-
To unsubscribe, e-mail:
Github user rezasafi closed the pull request at:
https://github.com/apache/spark/pull/21916
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22601
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22601
`spark.history.fs.endEventReparseChunkSize` and
`spark.history.fs.inProgressOptimization.enabled` exist since `branch-2.4`. So,
this PR lands at master/2.4. If you want to fix some in
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/22601
Thanks a lot @dongjoon-hyun
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22601
Thank you, @shahidki31 .
Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22603
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22603
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96856/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22603
**[Test build #96856 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96856/testReport)**
for PR 22603 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22605
Thanks, @HyukjinKwon !
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user bsikander commented on the issue:
https://github.com/apache/spark/pull/21816
>> So is there no behavior change if your master specifies only one master?
If user specifies only 1 master then there is no behavioral change.
---
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/10989#discussion_r221972056
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala
---
@@ -117,6 +120,87 @@ case class BroadcastHashJoin(
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/10989#discussion_r221966919
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala
---
@@ -117,6 +120,87 @@ case class BroadcastHashJoin(
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22602
LGTM, pending jenkins
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22602
**[Test build #96859 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96859/testReport)**
for PR 22602 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/10989#discussion_r221961271
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala
---
@@ -117,6 +120,87 @@ case class BroadcastHashJoin(
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22602#discussion_r221960064
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ *
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22606
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22606
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96847/
Test PASSed.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22602#discussion_r221955172
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ *
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22606
**[Test build #96847 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96847/testReport)**
for PR 22606 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22524
Thanks @mgaido91. Resetting a flag in blocking operators is feasible
solution I think for now to solve this issue that limit operator consumes all
inputs. For current blocking operators, we should
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22609
Hi @mridulm ,
it seems that the changes will affect the metrics in `SparkStatusTracker`,
e.g. number of active tasks in `getExecutorInfos` or `getStageInfo` .
Maybe we
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22596
**[Test build #96858 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96858/testReport)**
for PR 22596 at commit
Github user samdvr commented on the issue:
https://github.com/apache/spark/pull/22596
@dongjoon-hyun merged, thank you, did not know how to skip lint rule there.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22602
**[Test build #96857 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96857/testReport)**
for PR 22602 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user peter-toth commented on the issue:
https://github.com/apache/spark/pull/22318
@cloud-fan could you please help me with this PR and take it one step
forward?
---
-
To unsubscribe, e-mail:
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22602#discussion_r221934230
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ *
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96852/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22602
**[Test build #96852 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96852/testReport)**
for PR 22602 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22607
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22607
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96844/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22607
**[Test build #96844 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96844/testReport)**
for PR 22607 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22609
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22609
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96846/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22609
**[Test build #96846 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96846/testReport)**
for PR 22609 at commit
Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/22609
This is a regression introduced in 2.3; unfortunately we did not notice it
until now.
On Tue, Oct 2, 2018 at 4:56 AM Shahid wrote:
> Hi @mridulm
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22605
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96848/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22605
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22605
**[Test build #96848 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96848/testReport)**
for PR 22605 at commit
Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/22609
Hi @mridulm , Can't we limit the task information by setting
'spark.ui.retainedTasks' lesser, to avoid OOM? correct me if I am wrong.
---
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22602#discussion_r221913801
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ *
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22602#discussion_r221913364
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/UnsafeWriterSuite.scala
---
@@ -0,0 +1,43 @@
+/*
+ *
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22603
**[Test build #96856 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96856/testReport)**
for PR 22603 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22603
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22599
Thanks @gengliangwang I agree with you. Itâs a good change.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22599
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22599
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22608
Kubernetes integration test status failure
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3627/
---
Github user gengliangwang commented on the issue:
https://github.com/apache/spark/pull/22599
Discuss with @cloud-fan offline. Rename method `benchmark` as
`runBenchmarkSuite`. Also add comment to guide developers to use
`runBenchmark` for each scenario in implementations.
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22599
**[Test build #96855 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96855/testReport)**
for PR 22599 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22608
Kubernetes integration test starting
URL:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/3627/
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96854/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22608
**[Test build #96854 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96854/testReport)**
for PR 22608 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22608
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22608
**[Test build #96854 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96854/testReport)**
for PR 22608 at commit
Github user peter-toth commented on a diff in the pull request:
https://github.com/apache/spark/pull/22603#discussion_r221898450
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala
---
@@ -315,7 +315,12 @@ object InMemoryFileIndex
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22603#discussion_r221895032
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala
---
@@ -315,7 +315,12 @@ object InMemoryFileIndex
Github user peter-toth commented on a diff in the pull request:
https://github.com/apache/spark/pull/22603#discussion_r221890344
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala
---
@@ -315,7 +315,12 @@ object InMemoryFileIndex
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22610
The idea sounds good to me from a cursory look for now.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22610
Yea, I will do this week. Sorry I missed the cc in the JIRA.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22610
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96853/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22610
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22610
**[Test build #96853 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96853/testReport)**
for PR 22610 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22603#discussion_r221876275
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala
---
@@ -315,7 +315,12 @@ object InMemoryFileIndex
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22610
cc @HyukjinKwon Can you take a look at this when you have time? Thanks.
---
-
To unsubscribe, e-mail:
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22527#discussion_r221857463
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala ---
@@ -1100,13 +1101,23 @@ object SQLContext {
attrs:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96851/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22611
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22611
**[Test build #96851 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96851/testReport)**
for PR 22611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22610
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22610
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22610
**[Test build #96853 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96853/testReport)**
for PR 22610 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/96850/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22611
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22611
**[Test build #96850 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96850/testReport)**
for PR 22611 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22602
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22611
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22602
**[Test build #96852 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96852/testReport)**
for PR 22602 at commit
301 - 400 of 475 matches
Mail list logo