Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95916/
Test FAILed.
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22234
@mmolimar, let's leave this closed since the newer one is open BTW. You
will be credited as a primary author of #22367 anyway.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20405
Hi, @jaceklaskowski . Could you close this PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22387
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/22389
[SPARK-17916][SPARK-25241][SQL][FOLLOW-UP] Fix empty string being parsed as
null when nullValue is set.
## What changes were proposed in this pull request?
In the PR, I propose new CSV
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/13893
Ping, @jiangxb1987 .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/22364#discussion_r216572034
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/AttributeSet.scala
---
@@ -39,10 +41,15 @@ object AttributeSet {
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22390
**[Test build #95923 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95923/testReport)**
for PR 22390 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22367
Usually we merge into master and backport to other branches when it's
needed.
https://spark.apache.org/contributing.html
> 5. Open a pull request against the master branch of
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/21618#discussion_r216588353
--- Diff: core/src/main/java/org/apache/hadoop/fs/SparkGlobber.java ---
@@ -0,0 +1,293 @@
+/**
+ * Licensed to the Apache Software Foundation
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22385
**[Test build #95928 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95928/testReport)**
for PR 22385 at commit
Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/20999#discussion_r216593044
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala
---
@@ -293,6 +293,28 @@ class AstBuilder(conf: SQLConf)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22358
**[Test build #95930 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95930/testReport)**
for PR 22358 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user seancxmao commented on the issue:
https://github.com/apache/spark/pull/22343
Could we see this as a behavior change? We can add a legacy conf (e.g.
`spark.sql.hive.legacy.convertMetastoreParquet`, may be defined in HiveUtils)
to enable users to revert back to the previous
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95932 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95932/testReport)**
for PR 21596 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95925/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/7
**[Test build #95918 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95918/testReport)**
for PR 7 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22337
**[Test build #95917 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95917/testReport)**
for PR 22337 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22337
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20414
Hi, @jiangxb1987 . Could you close this PR?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22375
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95911/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22213
**[Test build #95920 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95920/testReport)**
for PR 22213 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/7
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/7
**[Test build #95907 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95907/testReport)**
for PR 7 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22387
**[Test build #95921 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95921/testReport)**
for PR 22387 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/7
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95907/
Test FAILed.
---
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/20504
@wangyum . Unfortunatly, it looks too intrusive. Do you want to minimize
the change like
https://github.com/apache/spark/pull/20504#discussion_r166133771 or close this
PR?
---
Github user wangyum closed the pull request at:
https://github.com/apache/spark/pull/20504
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22343
To clarify: this is just a workaround when we hit a problematic(having
case-insensitive duplicated filed names in the parquet file) hive parquet
tables and we want to read it with the native
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22371
My opinion is, it's not worth to spend time on it. The lock is not likely
to be a bottleneck and it's better to keep it simple even it's sub-optimal.
---
GitHub user ssaavedra opened a pull request:
https://github.com/apache/spark/pull/22392
[SPARK-23200] Reset Kubernetes-specific config on Checkpoint restore
Several configuration parameters related to Kubernetes need to be
reset, as they are changed with each invokation of
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/19773#discussion_r216600156
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala ---
@@ -350,16 +366,11 @@ case class AlterTableChangeColumnCommand(
Github user Fokko commented on the issue:
https://github.com/apache/spark/pull/21596
Some of the JSON endpoints are invalid, for example:
```
{
"info": {
"id": "driver",
"hostPort": "localhost:61103",
"isActive": true,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22388
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95912/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22388
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22388
**[Test build #95912 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95912/testReport)**
for PR 22388 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22387
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22389
**[Test build #95922 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95922/testReport)**
for PR 22389 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22388
This seems to be the complete revert of SPARK-24882 (#22009 and the
followup #22245). Am I right?
---
-
To unsubscribe,
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22390
cc @cloud-fan @adrian-ionescu
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/7
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22376
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95913/
Test FAILed.
---
GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/22390
[SPARK-25402][SQL] Null handling in BooleanSimplification
## What changes were proposed in this pull request?
This PR is to fix the null handling in BooleanSimplification. In the rule
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22376
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22341
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22390
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95923/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22390
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22392
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ConeyLiu commented on the issue:
https://github.com/apache/spark/pull/22371
OK, thanks everyone for the help. Close it
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ConeyLiu closed the pull request at:
https://github.com/apache/spark/pull/22371
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22385
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22358
**[Test build #95930 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95930/testReport)**
for PR 22358 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22358
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95930/
Test PASSed.
---
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22357#discussion_r216601125
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaPruning.scala
---
@@ -110,7 +110,17 @@ private[sql]
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22357
**[Test build #95931 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95931/testReport)**
for PR 22357 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/21791
@kiszk I feel it is hard to add UT, do you have any idea?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user LantaoJin commented on the issue:
https://github.com/apache/spark/pull/22353
> Although event log is in JSON format, it's mostly for internal usage, to
be load by history server and used to build the Spark UI.
AFAIK, there are more and more projects replay event log to
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21654#discussion_r216554397
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -375,6 +375,9 @@ def _truncate(self):
return int(self.sql_ctx.getConf(
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22060
It seems that the testing is finished. :)
If you don't mind, shall we close this test PR, @maryannxue ?
---
-
To
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22337
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22387
**[Test build #95916 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95916/testReport)**
for PR 22387 at commit
Github user dbtsai commented on a diff in the pull request:
https://github.com/apache/spark/pull/22357#discussion_r216559045
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetSchemaPruning.scala
---
@@ -110,7 +110,17 @@ private[sql]
Github user MaxGekk commented on the issue:
https://github.com/apache/spark/pull/22367
> Oh, wait. why does this target branch-2.4?
Just to make sure, the changes don't have conflicts in `branch-2.4`.
@HyukjinKwon Is this PR not mergeable to `master`?
> You can open
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/22357
FYI, @mallman I'm working on having `ParquetFilter` to support
`IsNotNull(employer.id)` to be pushed into parquet reader.
---
-
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22389
**[Test build #95924 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95924/testReport)**
for PR 22389 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22390
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22389
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22390
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22390
**[Test build #95923 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95923/testReport)**
for PR 22390 at commit
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22390#discussion_r216575397
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala
---
@@ -263,10 +263,12 @@ object BooleanSimplification
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22390#discussion_r216575336
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BooleanSimplificationSuite.scala
---
@@ -48,6 +48,14 @@ class
Github user gengliangwang commented on a diff in the pull request:
https://github.com/apache/spark/pull/22390#discussion_r216574955
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BooleanSimplificationSuite.scala
---
@@ -48,6 +48,14 @@ class
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22343
Thank you for the pointer, @seancxmao . And thank you for clarification,
@cloud-fan .
It looks like we are re-creating correctness issue somewhat in this PR when
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22371
@ConeyLiu we may have an executor lost and then come back, and may have 2
same tasks running on the same executor.
---
-
To
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22391
cc @cloud-fan @dongjoon-hyun
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/22391
[SPARK-25371][SQL][BACKPORT-2.3] struct() should allow being called with 0
args
## What changes were proposed in this pull request?
SPARK-21281 introduced a check for the inputs of
Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22326#discussion_r216583509
--- Diff:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala
---
@@ -1153,12 +1154,35 @@ class
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/21080
@dzanozin the code you reported clearly misses this patch. Since I do see
the commit on v2.3.1, I am a bit puzzled about the issue you reported. Please
provide a reproducer so we can check whether
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22357
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user LantaoJin commented on the issue:
https://github.com/apache/spark/pull/22353
Spark driver log is always distributed on various client nodes and depends
on the log4j configs. In a big company, it's hard to collect them all and I
think it's better to used for debug not
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21596
**[Test build #95932 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/95932/testReport)**
for PR 21596 at commit
Github user wangyum commented on the issue:
https://github.com/apache/spark/pull/22387
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21596
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/95932/
Test FAILed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22295#discussion_r216553283
--- Diff: python/pyspark/sql/session.py ---
@@ -252,6 +253,22 @@ def newSession(self):
"""
return self.__class__(self._sc,
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22373
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22211
Hi, @henryr . Since this is merged, could you close this PR?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22392
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22385
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22385
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
1 - 100 of 628 matches
Mail list logo
