Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95931/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22385
**[Test build #95928 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95928/testReport)**
for PR 22385 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22391
**[Test build #95936 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95936/testReport)**
for PR 22391 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22357
**[Test build #95931 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95931/testReport)**
for PR 22357 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22358
I'm okay but I would close this if no committer agree with (approves) this
for some long time.
---
-
To unsubscribe,
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22358#discussion_r216657064
--- Diff: docs/sql-programming-guide.md ---
@@ -965,6 +965,7 @@ Configuration of Parquet can be done using the
`setConf` method on `SparkSession
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22234
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22367
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22389
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95940 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95940/testReport)**
for PR 21596 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22389
Merged to master and branch-2.4.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95929/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95929 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95929/testReport)**
for PR 21596 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22374
**[Test build #95939 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95939/testReport)**
for PR 22374 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22337
**[Test build #95938 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95938/testReport)**
for PR 22337 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user kiszk commented on the issue:
https://github.com/apache/spark/pull/22337
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user LantaoJin commented on the issue:
https://github.com/apache/spark/pull/22353
Thank you @cloud-fan for your reminding. Weâve handled the drop message
case. Agree, I will update a commit tomorrow.
---
-
Github user sujith71955 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20611#discussion_r216638992
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -303,94 +303,44 @@ case class LoadDataCommand(
Github user sujith71955 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20611#discussion_r216638725
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala ---
@@ -303,94 +303,44 @@ case class LoadDataCommand(
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22380
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22380
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22326
IIUC, you are pulling out the join condition with python UDF and create a
filter above join. Then the join become a cross join, which usually runs very
slowly. I think we should keep the cross
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22341
**[Test build #95937 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95937/testReport)**
for PR 22341 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22341
retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95926/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22353
So you need a way to reliably report some extra information like file path
in the event logs, but don't want to show it in the UI as it maybe too long.
Basically we shouldn't put such
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22341
**[Test build #95926 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95926/testReport)**
for PR 22341 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22389
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95924/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22389
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22389
**[Test build #95924 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95924/testReport)**
for PR 22389 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22391
**[Test build #95936 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95936/testReport)**
for PR 22391 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22391
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22391
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22391
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22391
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95927/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22391
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22391
**[Test build #95927 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95927/testReport)**
for PR 22391 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22393
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22393
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dzanozin commented on the issue:
https://github.com/apache/spark/pull/21080
Please ignore the error report, it was a mess in the machine configuration
with some v2.3.0 leftovers. Works as expected after cleanup. Sorry!
---
Github user MichaelChirico commented on the issue:
https://github.com/apache/spark/pull/22370
@felixcheung thanks for the feedback, yes, I axed `registerTempTable` from
the `SparkDataFrame `@family`.
Sorry I botched an attempt to try and rename the branch of this PR
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22393
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user MichaelChirico opened a pull request:
https://github.com/apache/spark/pull/22393
Axe deprecated doc refs
Continuation of #22370. Summary of discussion there:
There is some inconsistency in the R manual w.r.t. supercedent functions
linking back to deprecated
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95935/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95935 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95935/testReport)**
for PR 21596 at commit
Github user MichaelChirico closed the pull request at:
https://github.com/apache/spark/pull/22370
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95935 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95935/testReport)**
for PR 21596 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22213
**[Test build #95934 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95934/testReport)**
for PR 22213 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22387
**[Test build #95933 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95933/testReport)**
for PR 22387 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22213
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user LantaoJin commented on the issue:
https://github.com/apache/spark/pull/22353
Spark driver log is always distributed on various client nodes and depends
on the log4j configs. In a big company, it's hard to collect them all and I
think it's better to used for debug not
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22387
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95932 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95932/testReport)**
for PR 21596 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95932/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95925/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95932 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95932/testReport)**
for PR 21596 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22387
**[Test build #95925 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95925/testReport)**
for PR 22387 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21791
@kiszk I feel it is hard to add UT, do you have any idea?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user LantaoJin commented on the issue:
https://github.com/apache/spark/pull/22353
> Although event log is in JSON format, it's mostly for internal usage, to
be load by history server and used to build the Spark UI.
AFAIK, there are more and more projects replay event log to
Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
Some of the code has been introduced here:
https://github.com/apache/spark/commit/9241e1e7e66574cfafa68791771959dfc39c9684
---
-
Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
Some of the JSON endpoints are invalid, for example:
```
{
"info": {
"id": "driver",
"hostPort": "localhost:61103",
"isActive": true,
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22326#discussion_r216606555
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala
---
@@ -1153,12 +1154,35 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22357
**[Test build #95931 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95931/testReport)**
for PR 22357 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22357#discussion_r216601125
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaPruning.scala
---
@@ -110,7 +110,17 @@ private[sql]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95930/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22358
**[Test build #95930 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95930/testReport)**
for PR 22358 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/19773#discussion_r216600156
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -350,16 +366,11 @@ case class AlterTableChangeColumnCommand(
Github user seancxmao commented on the issue:
https://github.com/apache/spark/pull/22343
Could we see this as a behavior change? We can add a legacy conf (e.g.
`spark.sql.hive.legacy.convertMetastoreParquet`, may be defined in HiveUtils)
to enable users to revert back to the previous
Github user Ngone51 commented on a diff in the pull request:
https://github.com/apache/spark/pull/18492#discussion_r216597619
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -373,8 +373,14 @@ private[spark] class ExecutorAllocationManager(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22358
**[Test build #95930 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95930/testReport)**
for PR 22358 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22374#discussion_r216593835
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVDataSource.scala
---
@@ -243,17 +243,21 @@ object
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/20999
cc @cloud-fan @dongjoon-hyun too, in case have time to take a look and
review this, thanks.
---
-
To unsubscribe, e-mail:
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20999#discussion_r216593044
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
---
@@ -293,6 +293,28 @@ class AstBuilder(conf: SQLConf)
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22326#discussion_r216592676
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala
---
@@ -1153,12 +1154,35 @@ class
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95929 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95929/testReport)**
for PR 21596 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21080
@dzanozin the code you reported clearly misses this patch. Since I do see
the commit on v2.3.1, I am a bit puzzled about the issue you reported. Please
provide a reproducer so we can check whether
Github user adrian-ionescu commented on a diff in the pull request:
https://github.com/apache/spark/pull/22390#discussion_r216587787
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala
---
@@ -263,10 +263,12 @@ object
Github user adrian-ionescu commented on a diff in the pull request:
https://github.com/apache/spark/pull/22390#discussion_r216587101
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala
---
@@ -263,10 +263,12 @@ object
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216588353
--- Diff: core/src/main/java/org/apache/hadoop/fs/SparkGlobber.java ---
@@ -0,0 +1,293 @@
+/**
+ * Licensed to the Apache Software Foundation
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22385
**[Test build #95928 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95928/testReport)**
for PR 22385 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22385
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22385
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22392
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22392
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
401 - 500 of 628 matches
Mail list logo
