Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22885
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user Koraseg commented on the issue:
https://github.com/apache/spark/pull/22894
Regarding the third one, the proposed implementation is, conceptually, the
same as current one. Under the hood, hugeBlockSizesArray.toMap just updates an
internal immutable map reference by tuples
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22885
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user edwinalu commented on the issue:
https://github.com/apache/spark/pull/22884
Thanks, lgtm.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22885
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98260/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22885
**[Test build #98260 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98260/testReport)**
for PR 22885 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22849
Yes, that is the comment I have been referring to. So it seems you can't
filter, right? it's not scheduling work here. @jiangxb1987 do you know this
part of the code?
---
Github user parente commented on the issue:
https://github.com/apache/spark/pull/18339
@holdenk I rebased the PR and I think it's good to go if you'd like to give
it another look.
---
-
To unsubscribe, e-mail:
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22894
@Koraseg please check the contribution guide and update this PR accordingly:
- first, please fill the PR description properly;
- second, provide a demonstration of the improved performance
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22894
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98263/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22894
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22894
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98263 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98263/testReport)**
for PR 22844 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98265/
Test FAILed.
---
GitHub user Koraseg opened a pull request:
https://github.com/apache/spark/pull/22894
[SPARK-25885] HighlyCompressedMapStatus deserialization/construction
optimization
## What changes were proposed in this pull request?
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22892
**[Test build #98265 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98265/testReport)**
for PR 22892 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98262/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22844
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98262 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98262/testReport)**
for PR 22844 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22885
Looks fine. Maybe some Maven cache somewhere has to be deleted as it's
corrupt?
---
-
To unsubscribe, e-mail:
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21860#discussion_r229283365
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala
---
@@ -854,33 +862,50 @@ case class
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/22755
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98261/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98261 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98261/testReport)**
for PR 22845 at commit
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22755
thanks, merging to master!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22892#discussion_r229278709
--- Diff: sql/core/src/test/resources/sample.json ---
@@ -0,0 +1,2 @@
+{"a" : "2" ,"b" : "blah", "c_!@(3)":1}
--- End diff --
It is needed
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22892#discussion_r229274492
--- Diff: sql/core/src/test/resources/sample.json ---
@@ -0,0 +1,2 @@
+{"a" : "2" ,"b" : "blah", "c_!@(3)":1}
--- End diff --
why add
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98259/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98259 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98259/testReport)**
for PR 22845 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22893
How much performance does it gain in end-to-end test, and how does it
provide better performance?
---
-
To unsubscribe,
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22893
Also please fill the PR description. How much performance does it gain?
---
-
To unsubscribe, e-mail:
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22893
Please fix the PR title as described in
https://spark.apache.org/contributing.html and read it.
---
-
To unsubscribe,
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user jamal119 commented on the issue:
https://github.com/apache/spark/pull/16429
How did you end up solving that problemï¼reinstall the spark ï¼ Which
version did you installï¼Can you offer a final solutionï¼thanks
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22845
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98258/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98258 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98258/testReport)**
for PR 22845 at commit
Github user mgaido91 commented on the issue:
https://github.com/apache/spark/pull/22713
anymore comments on this @cloud-fan @maryannxue @viirya ?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22893
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22893
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22893
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user KyleLi1985 opened a pull request:
https://github.com/apache/spark/pull/22893
One part of Spark MLlib Kmean Logic Performance problem
[SPARK-25868][MLlib] One part of Spark MLlib Kmean Logic Performance problem
## What changes were proposed in this pull request?
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22892
**[Test build #98266 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98266/testReport)**
for PR 22892 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98256/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/21860
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21860
**[Test build #98256 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98256/testReport)**
for PR 21860 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22892
**[Test build #98265 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98265/testReport)**
for PR 22892 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22892
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/22892
[SPARK-25884][SQL] Add TBLPROPERTIES and COMMENT, and use LOCATION when
SHOW CREATE TABLE.
## What changes were proposed in this pull request?
When `SHOW CREATE TABLE` for Datasource
Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/22892
cc @cloud-fan
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98255/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22755
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22755
**[Test build #98255 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98255/testReport)**
for PR 22755 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229243855
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22890
**[Test build #98264 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98264/testReport)**
for PR 22890 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22890
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/98264/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22890
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22891
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22891
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22891
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user soenkeliebau commented on a diff in the pull request:
https://github.com/apache/spark/pull/22598#discussion_r229237022
--- Diff:
core/src/main/scala/org/apache/spark/deploy/security/KafkaDelegationTokenProvider.scala
---
@@ -0,0 +1,65 @@
+/*
+ * Licensed to
GitHub user 351zyf opened a pull request:
https://github.com/apache/spark/pull/22891
SPARK-25881
## What changes were proposed in this pull request?
https://github.com/apache/spark/pull/22888
decimal type should consider as a number but not object (string)
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22890
**[Test build #98264 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98264/testReport)**
for PR 22890 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22890
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22890
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/22890
[SPARK-25883][SQL][Minor] Override method `prettyName` in
`from_avro`/`to_avro`
## What changes were proposed in this pull request?
Previously in from_avro/to_avro, we override
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98263 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98263/testReport)**
for PR 22844 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22844
**[Test build #98262 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98262/testReport)**
for PR 22844 at commit
Github user 351zyf closed the pull request at:
https://github.com/apache/spark/pull/22888
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user linhong-intel commented on the issue:
https://github.com/apache/spark/pull/18745
@caneGuy Thanks for you fixing. I'm facing this problem as well and your
fix works very well.
But the streaming sub-module still generate test jar twice same as your PR
description. How
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22889
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22889
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22889
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22845
**[Test build #98261 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98261/testReport)**
for PR 22845 at commit
GitHub user arman1371 opened a pull request:
https://github.com/apache/spark/pull/22889
[SPARK-25882][SQL] Added a function to join two datasets using one column
with join type parameter
## What changes were proposed in this pull request?
Added a function to join two datasets
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22885
**[Test build #98260 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/98260/testReport)**
for PR 22885 at commit
Github user ScrapCodes commented on the issue:
https://github.com/apache/spark/pull/22639
@mccheah and @skonto Do you have suggestion how to go forward from here? I
wanted to write more tests, like how to recover from checkpoints etc...
---
Github user 351zyf commented on the issue:
https://github.com/apache/spark/pull/22888
OK
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22885
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22885
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22885
Retest this please.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user ScrapCodes commented on a diff in the pull request:
https://github.com/apache/spark/pull/22639#discussion_r229218791
--- Diff:
resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest/StreamingCompatibilitySuite.scala
---
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22888
I would close this, @351zyf.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22885
The failure seems to be the same.
```
Using `mvn` from path:
/home/jenkins/workspace/SparkPullRequestBuilder/build/apache-maven-3.5.4/bin/mvn
[ERROR] Failed to execute goal
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229217228
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/csv/CSVBenchmarks.scala
---
@@ -16,30 +16,31 @@
*/
package
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22845#discussion_r229216166
--- Diff: sql/core/benchmarks/CSVBenchmarks-results.txt ---
@@ -0,0 +1,27 @@
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/22888
You're introducing a flag to convert. I think it's virtually same enabling
the flag vs calling a function to convert.
---
-
Github user 351zyf commented on the issue:
https://github.com/apache/spark/pull/22888
> Then, you can convert the type into double or floats in Spark DataFrame.
This is super easily able to work around at Pandas DataFrame or Spark's
DataFrame. I don't think we should add this flag.
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229214337
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229213742
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229213583
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22844#discussion_r229212923
--- Diff: sql/core/benchmarks/JSONBenchmarks-results.txt ---
@@ -0,0 +1,33 @@
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22880#discussion_r229212944
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetReadSupport.scala
---
@@ -93,13 +141,14 @@ private[parquet]
301 - 400 of 486 matches
Mail list logo
