Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
Please go to #20087
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
I'd finished to write the test case with the table containing mixed
compression codec. But maybe I'd made a mistake, the original branch was
deleted mistakenly, I will closed this PR and create
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
@fjh100456 Yeah. Please also add the test cases with the table containing
mixed compression codec. Thanks!
I have some comments about your fix. See my commit:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85340/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85340 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85340/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85340 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85340/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85335/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85335 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85335/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85334/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85334 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85334/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85335 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85335/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85334 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85334/testReport)**
for PR 19218 at commit
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
I mean sevral files with different compressioncodcs under the same table
directory, like below:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
What are multiple expressions?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile
I'd test manully. When table-level compression not configured, it always
take the session level compression, and ignore the existing file compression.
Seems like a bug, however,
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
Could you also add another test scenario? For the existing Hive tables
(created by Hive), does our Spark respect it? Do we use the existing
compression configuration?
---
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile Could you help to review it? Thanks very much!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85173/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85173 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85173/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85173 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85173/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/85154/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85154 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85154/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #85154 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/85154/testReport)**
for PR 19218 at commit
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile @maropu Does it look better now? About statistic issue, is
there any suggestion?
@SparkQA Please start test, thanks.
---
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
I will change the code with the suggestion of @gatorsmile ,it's a little
busy this days.I will do it tomorrow.
---
-
To
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/19218
In the case xiao suggested above, users usally re-run `ANALYZE TABLE`?
---
-
To unsubscribe, e-mail:
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
@fjh100456 My concern is the size change could causes the statistics
changes. However, this is a bug fix. We should fix it. Thanks!
---
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/19218
@fjh100456 Any progress?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile
Thank you very much.I'll fix all the problem later.For moreï¼I'm not very
clear what you mean by 'workload', I changed the test to a benchmark in this
two days, and the code
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/19218
@fjh100456 What is the workload you ran?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile
I'd tested the performance of 'uncompressed', 'snappy', 'gzip' compression
algorithm for parquet, the input data volume is 22MB, 220MB, 1100MB,
respectively run 10 times, finally
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Can one of the admins verify this patch?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
cc @gatorsmile @dongjoon-hyun
Is it ok now?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82800/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82800 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82800/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82800 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82800/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82785/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82785 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82785/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82785 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82785/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82784/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82784 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82784/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82784 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82784/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82772/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82772 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82772/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82772 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82772/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82660/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82660 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82660/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82660 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82660/testReport)**
for PR 19218 at commit
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
cc @gatorsmile @dongjoon-hyun
Is it ok now?
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82580/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82580 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82580/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82579/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82579 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82579/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82580 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82580/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82579 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82579/testReport)**
for PR 19218 at commit
Github user discipleforteen commented on the issue:
https://github.com/apache/spark/pull/19218
LGTM
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@dongjoon-hyun @gatorsmile
I'd fix them. Could you help me to review it again? Thanks.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82261/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82261 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82261/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82261 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82261/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82260/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82260 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82260/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82260 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82260/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82244/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82244 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82244/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82244 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82244/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82240/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82240 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82240/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82240 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82240/testReport)**
for PR 19218 at commit
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@dongjoon-hyun
Thank you very much, I'll fix them as soon as possible.
---
-
To unsubscribe, e-mail:
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/19218
Hi, @fjh100456 . I left a few comments.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user fjh100456 commented on the issue:
https://github.com/apache/spark/pull/19218
@gatorsmile @dongjoon-hyun
I'd fix it. Could you helpe me to review it again? Thanks.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/82001/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82001 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82001/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #82001 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/82001/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81995/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #81995 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81995/testReport)**
for PR 19218 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #81995 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81995/testReport)**
for PR 19218 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/19218
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81994/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/19218
**[Test build #81994 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81994/testReport)**
for PR 19218 at commit
1 - 100 of 160 matches
Mail list logo
