[GitHub] AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450311325 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450311320 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450311320 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450311325 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
SparkQA commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450311246 **[Test build #100491 has

[GitHub] gengliangwang commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
gengliangwang commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#discussion_r244277294 ## File path:

[GitHub] gengliangwang commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
gengliangwang commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450310859 @dongjoon-hyun Thanks for the test suite. I have merge and updated the test case. Please review

[GitHub] tejasapatil commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
tejasapatil commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450307774 I am currently on a vacation. Will get back to you on this in 2 weeks. Thanks, Tejas On Thu, Dec 27, 2018 at 11:19

[GitHub] AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450307209 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450307206 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450307209 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450307206 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450307071 **[Test build #100490 has

[GitHub] HyukjinKwon commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
HyukjinKwon commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450306657 retest this please This is an

[GitHub] gatorsmile commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
gatorsmile commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450305815 Let us cc @sameeragarwal @tejasapatil Do you have any opinion about this new feature?

[GitHub] gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2018-12-27 Thread GitBox
gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#discussion_r244273423 ## File path:

[GitHub] gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2018-12-27 Thread GitBox
gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#discussion_r244273331 ## File path:

[GitHub] gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2018-12-27 Thread GitBox
gatorsmile commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#discussion_r244273067 ## File path:

[GitHub] gatorsmile commented on issue #23369: [SPARK-26429][SS]add jdbc sink for Structured Streaming.

2018-12-27 Thread GitBox
gatorsmile commented on issue #23369: [SPARK-26429][SS]add jdbc sink for Structured Streaming. URL: https://github.com/apache/spark/pull/23369#issuecomment-450302743 Please follow the recent discussion of data source API V2. In the current stage, you can use foreachBatch(), which was

[GitHub] HyukjinKwon commented on issue #21732: [SPARK-24762][SQL] Enable Option of Product encoders

2018-12-27 Thread GitBox
HyukjinKwon commented on issue #21732: [SPARK-24762][SQL] Enable Option of Product encoders URL: https://github.com/apache/spark/pull/21732#issuecomment-450302234 Ah, but you're saying `Product` at top-level is an exception and the other cases are all coherent? hmm ... okie.

[GitHub] HyukjinKwon commented on issue #21732: [SPARK-24762][SQL] Enable Option of Product encoders

2018-12-27 Thread GitBox
HyukjinKwon commented on issue #21732: [SPARK-24762][SQL] Enable Option of Product encoders URL: https://github.com/apache/spark/pull/21732#issuecomment-450301915 I didn't mean that we should revert .. was just checking the PRs in my queue and was just curious. I mean, I understood

[GitHub] AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450301218 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450301216 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450301216 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450301218 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
SparkQA commented on issue #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#issuecomment-450300680 **[Test build #100489 has

[GitHub] AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450298164 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450298163 Merged build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450298164 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450298163 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
SparkQA removed a comment on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450277413 **[Test build #100484 has

[GitHub] SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450297969 **[Test build #100484 has

[GitHub] Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244268180 ## File path:

[GitHub] Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244267981 ## File path:

[GitHub] Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244267939 ## File path:

[GitHub] Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
Ngone51 commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244267939 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450296644 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450296641 Merged build finished. Test FAILed. This is an

[GitHub] AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450296641 Merged build finished. Test FAILed. This is an automated

[GitHub] AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450296644 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
SparkQA removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287186 **[Test build #100486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100486/testReport)**

[GitHub] SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450296551 **[Test build #100486 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100486/testReport)** for PR

[GitHub] gatorsmile commented on a change in pull request #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
gatorsmile commented on a change in pull request #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#discussion_r244266792 ## File path:

[GitHub] seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing

2018-12-27 Thread GitBox
seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing URL: https://github.com/apache/spark/pull/23258#discussion_r244265732 ## File path:

[GitHub] seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing

2018-12-27 Thread GitBox
seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing URL: https://github.com/apache/spark/pull/23258#discussion_r244266394 ## File path:

[GitHub] SparkQA commented on issue #21791: [SPARK-24925][SQL] input bytesRead metrics fluctuate from time to time

2018-12-27 Thread GitBox
SparkQA commented on issue #21791: [SPARK-24925][SQL] input bytesRead metrics fluctuate from time to time URL: https://github.com/apache/spark/pull/21791#issuecomment-450294742 **[Test build #100488 has

[GitHub] dongjoon-hyun commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#discussion_r244266177 ## File path:

[GitHub] dongjoon-hyun commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#discussion_r244266136 ## File path:

[GitHub] dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#discussion_r244266033 ## File path:

[GitHub] dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#discussion_r244266033 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450293646 Can one of the admins verify this patch? This is an

[GitHub] dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#discussion_r244265930 ## File path:

[GitHub] weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
weixiuli commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450294159 cc @dongjoon-hyun @gatorsmile Kindly review This is an automated

[GitHub] AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450294017 Can one of the admins verify this patch? This is an

[GitHub] weixiuli closed pull request #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
weixiuli closed pull request #23243: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23243 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450294017 Can one of the admins verify this patch? This is an automated

[GitHub] maropu commented on a change in pull request #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
maropu commented on a change in pull request #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#discussion_r244265825 ## File path:

[GitHub] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450294063 Can one of the admins verify this patch? This is an automated

[GitHub] seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing

2018-12-27 Thread GitBox
seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing URL: https://github.com/apache/spark/pull/23258#discussion_r244265732 ## File path:

[GitHub] AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393#issuecomment-450293646 Can one of the admins verify this patch? This is an automated

[GitHub] gengliangwang commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns

2018-12-27 Thread GitBox
gengliangwang commented on a change in pull request #23387: [SPARK-26447][SQL]Allow OrcColumnarBatchReader to return less partition columns URL: https://github.com/apache/spark/pull/23387#discussion_r244265485 ## File path:

[GitHub] weixiuli opened a new pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB

2018-12-27 Thread GitBox
weixiuli opened a new pull request #23393: [SPARK-26288][CORE]add initRegisteredExecutorsDB URL: https://github.com/apache/spark/pull/23393 ## What changes were proposed in this pull request? As we all know that spark on Yarn uses DB to record RegisteredExecutors information which

[GitHub] dongjoon-hyun commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
dongjoon-hyun commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450293548 Could you adjust the PR title and description by mentioning `UpdateAttributeNullability` because `FixNullability` is completely

[GitHub] seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing

2018-12-27 Thread GitBox
seancxmao commented on a change in pull request #23258: [SPARK-23375][SQL][FOLLOWUP][TEST] Test Sort metrics while Sort is missing URL: https://github.com/apache/spark/pull/23258#discussion_r244265049 ## File path:

[GitHub] dongjoon-hyun commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244264949 ## File path:

[GitHub] dongjoon-hyun commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
dongjoon-hyun commented on a change in pull request #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#discussion_r244264949 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450291446 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450291440 Merged build finished. Test FAILed. This is an

[GitHub] SparkQA removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
SparkQA removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279381 **[Test build #100485 has

[GitHub] AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450291440 Merged build finished. Test FAILed. This

[GitHub] AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450291446 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
SparkQA commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450291378 **[Test build #100485 has

[GitHub] KeiichiHirobe edited a comment on issue #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore

2018-12-27 Thread GitBox
KeiichiHirobe edited a comment on issue #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore URL: https://github.com/apache/spark/pull/23288#issuecomment-450286704 Thank you for your reply. Let me make sure what you mean, I don't know

[GitHub] AmplabJenkins removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450290151 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450290151 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450290148 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450290148 Merged build finished. Test PASSed.

[GitHub] SparkQA removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
SparkQA removed a comment on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450260840 **[Test build #100482 has

[GitHub] SparkQA commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager

2018-12-27 Thread GitBox
SparkQA commented on issue #23386: [SPARK-26446][CORE] Add cachedExecutorIdleTimeout docs at ExecutorAllocationManager URL: https://github.com/apache/spark/pull/23386#issuecomment-450289949 **[Test build #100482 has

[GitHub] maropu commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
maropu commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450289376 LGTM This is an automated message from the Apache Git Service. To

[GitHub] AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287723 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287724 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287724 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287723 Merged build finished. Test PASSed. This is an automated

[GitHub] SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287669 **[Test build #100487 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100487/testReport)** for PR

[GitHub] SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule

2018-12-27 Thread GitBox
SparkQA commented on issue #23390: [SPARK-26459][SQL] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#issuecomment-450287186 **[Test build #100486 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/100486/testReport)** for PR

[GitHub] KeiichiHirobe commented on issue #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore

2018-12-27 Thread GitBox
KeiichiHirobe commented on issue #23288: [SPARK-26339][SQL]Throws better exception when reading files that start with underscore URL: https://github.com/apache/spark/pull/23288#issuecomment-450286704 Thank you for your reply. Let me make sure what you mean, I don't know for

[GitHub] maropu commented on a change in pull request #23390: [SPARK-21351][SQL][followup] reuse the FixNullability rule

2018-12-27 Thread GitBox
maropu commented on a change in pull request #23390: [SPARK-21351][SQL][followup] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#discussion_r244258236 ## File path:

[GitHub] maropu commented on a change in pull request #23390: [SPARK-21351][SQL][followup] reuse the FixNullability rule

2018-12-27 Thread GitBox
maropu commented on a change in pull request #23390: [SPARK-21351][SQL][followup] reuse the FixNullability rule URL: https://github.com/apache/spark/pull/23390#discussion_r244256851 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala

[GitHub] wangyum commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation

2018-12-27 Thread GitBox
wangyum commented on a change in pull request #22903: [SPARK-24196][SQL] Implement Spark's own GetSchemasOperation URL: https://github.com/apache/spark/pull/22903#discussion_r244256608 ## File path:

[GitHub] beliefer commented on issue #23379: [SPARK-26440][WEBUI] Show total CPU time across all tasks on stage pages

2018-12-27 Thread GitBox
beliefer commented on issue #23379: [SPARK-26440][WEBUI] Show total CPU time across all tasks on stage pages URL: https://github.com/apache/spark/pull/23379#issuecomment-450280616 This change is so clearly. This is an

[GitHub] AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279312 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins removed a comment on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279310 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279312 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
SparkQA commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279381 **[Test build #100485 has

[GitHub] AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0

2018-12-27 Thread GitBox
AmplabJenkins commented on issue #23388: [SPARK-26448][SQL] retain the difference between 0.0 and -0.0 URL: https://github.com/apache/spark/pull/23388#issuecomment-450279310 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
SparkQA commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450277413 **[Test build #100484 has

[GitHub] bersprockets commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
bersprockets commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450277333 retest this please This is an

[GitHub] bersprockets commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

2018-12-27 Thread GitBox
bersprockets commented on issue #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection URL: https://github.com/apache/spark/pull/23392#issuecomment-450277305 Getting java.lang.NoClassDefFoundError: javax/jdo/JDOException trying to instantiate

[GitHub] zhengruifeng commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML

2018-12-27 Thread GitBox
zhengruifeng commented on issue #23144: [SPARK-26172][ML][WIP] Unify String Params' case-insensitivity in ML URL: https://github.com/apache/spark/pull/23144#issuecomment-450274833 @srowen I updated this PR according to your comments, and modify LoR. If OK, I will update other algs then.

  1   2   3   4   >