Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21954
**[Test build #94019 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94019/testReport)**
for PR 21954 at commit
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21898#discussion_r207350823
--- Diff: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ---
@@ -0,0 +1,239 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21977
**[Test build #94054 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94054/testReport)**
for PR 21977 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94054/
Test FAILed.
---
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21977
cc @ueshin
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user kiszk commented on a diff in the pull request:
https://github.com/apache/spark/pull/21898#discussion_r207348484
--- Diff: core/src/main/scala/org/apache/spark/BarrierCoordinator.scala ---
@@ -0,0 +1,239 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21977
**[Test build #94054 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94054/testReport)**
for PR 21977 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21977
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/21977
@holdenk, can you help review this since it is related to PySpark?
---
-
To unsubscribe, e-mail:
GitHub user rdblue opened a pull request:
https://github.com/apache/spark/pull/21977
SPARK-25004: Add spark.executor.pyspark.memory limit.
## What changes were proposed in this pull request?
This adds `spark.executor.pyspark.memory` to configure Python's address
space
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94053 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94053/testReport)**
for PR 21941 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21941
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21911
> Which test suite is a good place to add such end-to-end case?
org.apache.spark.sql.SQLQuerySuite might be the best place.
> Do we plan to support such call as df.hint("COALESCE",
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21935
**[Test build #94052 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94052/testReport)**
for PR 21935 at commit
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21935
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21955
**[Test build #94051 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94051/testReport)**
for PR 21955 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21923#discussion_r207341747
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -130,6 +130,12 @@ private[spark] class Executor(
private val
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94046/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94046 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94046/testReport)**
for PR 21941 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94048/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21953
**[Test build #94050 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94050/testReport)**
for PR 21953 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21955
**[Test build #94048 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94048/testReport)**
for PR 21955 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21953
looks like random test timeout error.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21953
Jenkins, test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user jzhuge commented on the issue:
https://github.com/apache/spark/pull/21911
The new commit should have taken care of all review comments except the
following:
> Add an end-to-end test case.
Which test suite is a good place to add such end-to-end case?
>
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/19449
I think we have a problem in the kafka tests right now that will cause this
to fail. Seems to be the cause several times now
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21935
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94020/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21935
**[Test build #94020 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94020/testReport)**
for PR 21935 at commit
Github user skambha commented on the issue:
https://github.com/apache/spark/pull/17185
Thanks @cloud-fan for the review.
I am working on implementing an idea to get optimized lookup with 3part
name.
---
-
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21950
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94017/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21950
**[Test build #94017 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94017/testReport)**
for PR 21950 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21953
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21953
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94016/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21955
**[Test build #94048 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94048/testReport)**
for PR 21955 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19449
**[Test build #94049 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94049/testReport)**
for PR 19449 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21953
**[Test build #94016 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94016/testReport)**
for PR 21953 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19449
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21955
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19449
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/19449
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21911
**[Test build #94047 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94047/testReport)**
for PR 21911 at commit
Github user jzhuge commented on a diff in the pull request:
https://github.com/apache/spark/pull/21911#discussion_r207334996
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveHints.scala
---
@@ -102,6 +104,39 @@ object ResolveHints {
}
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94046 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94046/testReport)**
for PR 21941 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21963
**[Test build #94045 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94045/testReport)**
for PR 21963 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21963
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21963
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dilipbiswal commented on the issue:
https://github.com/apache/spark/pull/21941
@gatorsmile rebasing in a hope that the test result changes :-)
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21970
**[Test build #94044 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94044/testReport)**
for PR 21970 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21885
**[Test build #4230 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4230/testReport)**
for PR 21885 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21970
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21632
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94015/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21632
**[Test build #94015 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94015/testReport)**
for PR 21632 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21608
**[Test build #94043 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94043/testReport)**
for PR 21608 at commit
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/21952
@dbtsai I was thinking the same thing. I will do the test later after I
come back to my laptop.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/13440
**[Test build #94042 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94042/testReport)**
for PR 13440 at commit
Github user sujith71955 commented on the issue:
https://github.com/apache/spark/pull/20611
I will reiterate again, actually this PR was intended for fixing the issue
related to wildcard character issue in the hdfs file system scenarios , with
the current solution we are also able to
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21809#discussion_r207324028
--- Diff: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala
---
@@ -112,10 +112,13 @@ private[spark] class AppStatusStore(
}
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21809#discussion_r207324015
--- Diff: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala
---
@@ -112,10 +112,13 @@ private[spark] class AppStatusStore(
}
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21809#discussion_r207327804
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ---
@@ -105,15 +105,29 @@ private[ui] class StagePage(parent: StagesTab, store:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21941
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94028/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21941
**[Test build #94028 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94028/testReport)**
for PR 21941 at commit
Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21919
`numOutputRows` makes sense for all sinks, but I agree the counting should
be done at the framework and not by individual sinks. For metrics that does not
apply to all sinks, they could
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/21973
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21952
@viirya since you don't see the performance regression between 2.4 +
builtin reader and 2.4 + databricks reader, do you think the regression is
somewhere else in Spark?
Can you try 2.3
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/21966
LGTM except some comments
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/21973
Thanks! merging to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94025/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21970
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21970
**[Test build #94025 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94025/testReport)**
for PR 21970 at commit
Github user sujith71955 commented on the issue:
https://github.com/apache/spark/pull/20611
i think support wildcard is confusing term :)
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user sujith71955 commented on the issue:
https://github.com/apache/spark/pull/20611
No other changes in the load command behavior
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/21923#discussion_r207323114
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -130,6 +130,12 @@ private[spark] class Executor(
private val
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/20611
> Yes there is a change in the behavior, As i mentioned above in
descriptions now we will be able to support wildcard even in the folder level
for local file systems. Previous versions will
Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21919
If the individual connectors aren't doing the counting, I don't see a good
reason to put the data inside WriterCommitMessage instead of just leaving
StreamWriterCommitProgress as its own
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/21754
Thanks! Merged to master.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21923
**[Test build #94041 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94041/testReport)**
for PR 21923 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21973
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94033/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21973
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21973
**[Test build #94033 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94033/testReport)**
for PR 21973 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21923
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21923
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
401 - 500 of 1238 matches
Mail list logo
