[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190169 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] ueshin commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
ueshin commented on a change in pull request #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#discussion_r288847266 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql

[GitHub] [spark] SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190451 **[Test build #105942 has started](https://amplab.

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190475 **[Test build #105943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105943/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190717 Test FAILed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190712 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
SparkQA commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190703 **[Test build #105942 has finished](https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190712 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190451 **[Test build #105942 has started](https:/

[GitHub] [spark] gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
gengliangwang commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497190819 There are some test suites need to finish later after this PR is merged: SQLMetricsSuite, FileStreamSinkSuite, StreamSui

[GitHub] [spark] gengliangwang edited a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
gengliangwang edited a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497190819 There are some test suites need to update later after this PR is merged: SQLMetricsSuite, FileStreamSinkSuite, St

[GitHub] [spark] AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497190717 Test FAILed. Refer to this link fo

[GitHub] [spark] turboFei commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
turboFei commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497191007 I will check it and resolve the unit test. Thanks.

[GitHub] [spark] cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE] Stage retry causes totalRunningTasks calculation to be negative

2019-05-29 Thread GitBox
cxzl25 commented on a change in pull request #24497: [SPARK-27630][CORE] Stage retry causes totalRunningTasks calculation to be negative URL: https://github.com/apache/spark/pull/24497#discussion_r288847965 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager

[GitHub] [spark] SparkQA removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497172744 **[Test build #105938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191624 **[Test build #105938 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10593

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191778 Merged build finished. Test FAILed. T

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191782 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191778 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497191782 Test FAILed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192231 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192231 Merged build finished. Test FAILed. This is an auto

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192216 **[Test build #105943 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105943/testReport)*

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192238 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497190475 **[Test build #105943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105943/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192238 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] dongjoon-hyun commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
dongjoon-hyun commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192724 Retest this please This is an automated message fro

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192893 **[Test build #105944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105944/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193766 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497193766 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#discussion_r288850842 ## File path: common/unsafe/src/main/java/org/apache/spark/unsafe/types/CalendarInterval.j

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
dongjoon-hyun commented on a change in pull request #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#discussion_r288850939 ## File path: common/unsafe/src/main/java/org/apache/spark/unsafe/types/CalendarInterval.j

[GitHub] [spark] viirya commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
viirya commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497196750 retest this please This is an automated mess

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197164 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197158 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197158 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197164 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-05-29 Thread GitBox
SparkQA commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-497197434 **[Test build #105945 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105945

[GitHub] [spark] jzhuge commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation

2019-05-29 Thread GitBox
jzhuge commented on a change in pull request #24686: [SPARK-27813][SQL] DataSourceV2: Add DropTable logical operation URL: https://github.com/apache/spark/pull/24686#discussion_r288854088 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ##

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199060 **[Test build #105936 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497160400 **[Test build #105936 has started](https://amplab.cs.berkeley.edu/jenkins/job/S

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199389 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199393 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199389 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-497199393 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] SparkQA commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
SparkQA commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497199962 **[Test build #105939 has finished](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] SparkQA removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497174193 **[Test build #105939 has started](https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200236 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200239 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200236 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24671: [SPARK-27811][Core][Docs]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-497200239 Test PASSed. Refer to this link for build results (access ri

[GitHub] [spark] felixcheung commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-05-29 Thread GitBox
felixcheung commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-497202240 if this is performance, is there benchmarking result before/after?

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497202172 **[Test build #105946 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] felixcheung commented on issue #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses

2019-05-29 Thread GitBox
felixcheung commented on issue #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses URL: https://github.com/apache/spark/pull/24730#issuecomment-497203564 LGTM This is an automated message from

[GitHub] [spark] felixcheung commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses

2019-05-29 Thread GitBox
felixcheung commented on a change in pull request #24730: [SPARK-27835][Core] Resource Scheduling: change driver config from addresses URL: https://github.com/apache/spark/pull/24730#discussion_r288858863 ## File path: core/src/main/scala/org/apache/spark/ResourceDiscoverer.scala #

[GitHub] [spark] felixcheung commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block

2019-05-29 Thread GitBox
felixcheung commented on issue #24740: [SPARK-27876][SPARK-27876][CORE] Split large shuffle partition to multi-segments to enable transfer oversize shuffle partition block URL: https://github.com/apache/spark/pull/24740#issuecomment-497203881 @squito ?

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497204145 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-pr

[GitHub] [spark] AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205781 Test FAILed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
SparkQA commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205721 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-

[GitHub] [spark] AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205775 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205775 Merged build finished. Test FAILed. ---

[GitHub] [spark] SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
SparkQA commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206041 **[Test build #105940 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105940/testReport)** f

[GitHub] [spark] AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24739: [SPARK-27875][CORE][SQL][ML][K8S] Wrap all PrintWriter with Utils.tryWithResource URL: https://github.com/apache/spark/pull/24739#issuecomment-497205781 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497184193 **[Test build #105940 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105940/testRepor

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206204 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206196 Merged build finished. Test FAILed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206196 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-497206204 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208441 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208295 **[Test build #105944 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105944/testReport)*

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208438 Merged build finished. Test FAILed. This is an auto

[GitHub] [spark] SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497192893 **[Test build #105944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105944/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208438 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497208441 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] dongjoon-hyun commented on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources

2019-05-29 Thread GitBox
dongjoon-hyun commented on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources URL: https://github.com/apache/spark/pull/24731#issuecomment-497209414 @felixcheung . We can make `src/main/sh`(?), but it's more natural to consider this as a resource or con

[GitHub] [spark] jzhuge opened a new pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
jzhuge opened a new pull request #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741 ## What changes were proposed in this pull request? Support multi-catalog in the following SELECT code paths: - SELECT * FROM

[GitHub] [spark] dongjoon-hyun closed pull request #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources

2019-05-29 Thread GitBox
dongjoon-hyun closed pull request #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources URL: https://github.com/apache/spark/pull/24731 This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210112 **[Test build #105947 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105947/testReport)*

[GitHub] [spark] jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210795 This PR depends on #24686. It'd easier to review commit c504b2f only.

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210973 Can one of the admins verify this patch? This is a

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211197 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211192 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211197 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497211192 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210973 Can one of the admins verify this patch? T

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212241 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212238 Merged build finished. Test FAILed. This is an aut

[GitHub] [spark] SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
SparkQA removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497210112 **[Test build #105947 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105947/test

[GitHub] [spark] SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
SparkQA commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212225 **[Test build #105947 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105947/testReport)

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212238 Merged build finished. Test FAILed. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212241 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] jzhuge edited a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
jzhuge edited a comment on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212984 There are 2 major design points in this PR: 1. Create TableIdentifierLike interface to ease the migration fro

[GitHub] [spark] jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs

2019-05-29 Thread GitBox
jzhuge commented on issue #24741: [SPARK-27322][SQL] DataSourceV2: Select from multiple catalogs URL: https://github.com/apache/spark/pull/24741#issuecomment-497212984 There are 2 major design points in this PR: 1. Create TableIdentifierLike interface to ease the migration from legac

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497214197 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497214192 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
SparkQA commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497214643 **[Test build #105948 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105948/testReport)**

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources

2019-05-29 Thread GitBox
dongjoon-hyun edited a comment on issue #24731: [SPARK-27725][EXAMPLES] Add an example discovery Script for GPU resources URL: https://github.com/apache/spark/pull/24731#issuecomment-497209414 @felixcheung . We can make `src/main/sh`(`scripts`?), but it's more natural to consider this as a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-05-29 Thread GitBox
AmplabJenkins removed a comment on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-497214197 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

<    4   5   6   7   8   9   10   >