Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22878
**[Test build #98244 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98244/testReport)**
for PR 22878 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22878
**[Test build #98251 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98251/testReport)**
for PR 22878 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98244/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22755
**[Test build #98252 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98252/testReport)**
for PR 22755 at commit
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22845
Thank you for updating and rerunning the tests, @heary-cao .
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229190198
--- Diff: sql/core/benchmarks/CSVBenchmarks-results.txt ---
@@ -0,0 +1,27 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22881
**[Test build #98249 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98249/testReport)**
for PR 22881 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98253/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22881
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22878
**[Test build #98251 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98251/testReport)**
for PR 22878 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22755
**[Test build #98252 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98252/testReport)**
for PR 22755 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22755
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22886
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #98256 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98256/testReport)**
for PR 21860 at commit
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229199434
--- Diff: sql/core/benchmarks/CSVBenchmarks-results.txt ---
@@ -0,0 +1,27 @@
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229199547
--- Diff: sql/core/benchmarks/CSVBenchmarks-results.txt ---
@@ -0,0 +1,27 @@
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22888
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/22849#discussion_r229203395
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -240,7 +240,7 @@ class
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22888
I think you can just manually convert from Pandas DataFrame, no?
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229205020
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22885
retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22309
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22309
**[Test build #98248 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98248/testReport)**
for PR 22309 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22309
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98248/
Test PASSed.
---
Github user mallman commented on the issue:
https://github.com/apache/spark/pull/21320
> https://issues.apache.org/jira/browse/SPARK-25879
>
> If we select a nested field and a top level field, the schema pruning
will fail. Here is the reproducible test,
> ...
Hi
GitHub user gjhkael opened a pull request:
https://github.com/apache/spark/pull/22886
Hadoop config should overwrite by users conf
## What changes were proposed in this pull request?
Hadoop conf which is set by user which is use sparksql's set command should
not overwrite by
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22887
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gjhkael commented on the issue:
https://github.com/apache/spark/pull/22887
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22888
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22861
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22861
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98245/
Test PASSed.
---
Github user dbtsai commented on the issue:
https://github.com/apache/spark/pull/21320
cc @viirya
If we select a nested field and a top level field, the schema pruning will
fail. Here is the reproducible test,
```scala
testSchemaPruning("select a single complex
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22778
**[Test build #98246 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98246/testReport)**
for PR 22778 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22878
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98251/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98252/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22881
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98249/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98254/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98253 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98253/testReport)**
for PR 22844 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98254 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98254/testReport)**
for PR 22845 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22755
**[Test build #98255 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98255/testReport)**
for PR 22755 at commit
Github user gjhkael closed the pull request at:
https://github.com/apache/spark/pull/22886
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22886
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user gjhkael opened a pull request:
https://github.com/apache/spark/pull/22887
user set's hadoop conf should not overwrite by sparkcontext's conf
## What changes were proposed in this pull request?
Hadoop conf which is set by user which is use sparksql's set command
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22888
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229202285
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
GitHub user 351zyf opened a pull request:
https://github.com/apache/spark/pull/22888
SPARK-25881
add parametere coerce_float
https://issues.apache.org/jira/browse/SPARK-25881
## What changes were proposed in this pull request?
when using pyspark
Github user xuanyuanking commented on the issue:
https://github.com/apache/spark/pull/22878
Thanks @gengliangwang and @HyukjinKwon. Done in this commit.
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22861
**[Test build #98247 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98247/testReport)**
for PR 22861 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22861
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22861
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98247/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22861
**[Test build #98245 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98245/testReport)**
for PR 22861 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98253 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98253/testReport)**
for PR 22844 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22778
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22778
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98246/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98254 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98254/testReport)**
for PR 22845 at commit
Github user yucai commented on the issue:
https://github.com/apache/spark/pull/22861
@dongjoon-hyun Tests have been passed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22755
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user heary-cao commented on the issue:
https://github.com/apache/spark/pull/22845
@dongjoon-hyun, Well, my office machine.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user zuotingbing commented on a diff in the pull request:
https://github.com/apache/spark/pull/22849#discussion_r229198651
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
---
@@ -240,7 +240,7 @@ class
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22887
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229201094
--- Diff: sql/core/benchmarks/CSVBenchmarks-results.txt ---
@@ -0,0 +1,27 @@
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22887
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22755
**[Test build #98255 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98255/testReport)**
for PR 22755 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98255/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/22892
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22892
**[Test build #98265 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98265/testReport)**
for PR 22892 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #98256 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98256/testReport)**
for PR 21860 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229243855
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/22892
[SPARK-25884][SQL] Add TBLPROPERTIES and COMMENT, and use LOCATION when
SHOW CREATE TABLE.
## What changes were proposed in this pull request?
When `SHOW CREATE TABLE` for Datasource
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98256/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22755
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22885
**[Test build #98260 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98260/testReport)**
for PR 22885 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22894
Practically, though, it generates a whole copy of the map at every update,
so for 10 items, the implementation in the PR generates 9 copies of 1, 2, 3,
... elements, while the current one
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/16429
Install Spark I mentioned above.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22784
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22852
I think these are good changes. In a separate PR for the versions-specific
docs, we could add a similar note to
https://spark.apache.org/docs/latest/spark-standalone.html as much of the
security
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22844
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22885
Looks fine. Maybe some Maven cache somewhere has to be deleted as it's
corrupt?
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98263/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22894
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22894
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user Koraseg commented on the issue:
https://github.com/apache/spark/pull/22894
Regarding the third one, the proposed implementation is, conceptually, the
same as current one. Under the hood, hugeBlockSizesArray.toMap just updates an
internal immutable map reference by tuples
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22852
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229332500
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala
---
@@ -1617,6 +1617,58 @@ case class
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229323278
--- Diff:
external/avro/src/main/scala/org/apache/spark/sql/avro/AvroEncoder.scala ---
@@ -0,0 +1,534 @@
+/*
+ * Licensed to the Apache Software
Github user bdrillard commented on a diff in the pull request:
https://github.com/apache/spark/pull/22878#discussion_r229329920
--- Diff:
external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ---
@@ -1374,4 +1377,182 @@ class AvroSuite extends QueryTest with
1 - 100 of 486 matches
Mail list logo
