[GitHub] AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465897885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465897885 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465897877 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465897877 Merged build finished. Test PASSed. This

[GitHub] SparkQA removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465849284 **[Test build #102574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] SparkQA commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
SparkQA commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465897402 **[Test build #102574 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102574/te

[GitHub] AmplabJenkins commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465896882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] AmplabJenkins removed a comment on issue #23852: [R] update package description

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852#issuecomment-465896403 Merged build finished. Test PASSed. This is an automated message from the A

[GitHub] AmplabJenkins removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465896877 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465896882 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] SparkQA commented on issue #23852: [R] update package description

2019-02-20 Thread GitBox
SparkQA commented on issue #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852#issuecomment-465896912 **[Test build #102577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102577/testReport)** for PR 23852 at commit [`8d84

[GitHub] AmplabJenkins commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465896877 Merged build finished. Test PASSed. This is an automate

[GitHub] AmplabJenkins removed a comment on issue #23852: [R] update package description

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852#issuecomment-465896407 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/te

[GitHub] AmplabJenkins removed a comment on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465896422 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465896422 Merged build finished. Test PASSed. -

[GitHub] AmplabJenkins commented on issue #23852: [R] update package description

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852#issuecomment-465896403 Merged build finished. Test PASSed. This is an automated message from the Apache Gi

[GitHub] AmplabJenkins removed a comment on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465896427 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] SparkQA commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
SparkQA commented on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465896335 **[Test build #102572 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102572/testReport)** f

[GitHub] AmplabJenkins commented on issue #23852: [R] update package description

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852#issuecomment-465896407 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8

[GitHub] AmplabJenkins commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465896427 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] SparkQA removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #22874: [SPARK-25865][CORE] Add GC information to ExecutorMetrics URL: https://github.com/apache/spark/pull/22874#issuecomment-465840723 **[Test build #102572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102572/testRepor

[GitHub] felixcheung opened a new pull request #23852: [R] update package description

2019-02-20 Thread GitBox
felixcheung opened a new pull request #23852: [R] update package description URL: https://github.com/apache/spark/pull/23852 ## What changes were proposed in this pull request? update package description This is an auto

[GitHub] dilipbiswal commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
dilipbiswal commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258809987 ## File path: sql/core/src/test/resources/sql-tests/inputs/subquery/in-subquery/any-subquery.sql ##

[GitHub] akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults.

2019-02-20 Thread GitBox
akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults. URL: https://github.com/apache/spark/pull/22071#issuecomment-465826399 Hi @squito, if I may, I have a few comments to share regarding this change and probably you can help me to

[GitHub] SparkQA commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
SparkQA commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465894712 **[Test build #102576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] dongjoon-hyun commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
dongjoon-hyun commented on issue #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851#issuecomment-465894703 cc @dbtsai , @cloud-fan , @gatorsmile , @HyukjinKwon ---

[GitHub] dongjoon-hyun opened a new pull request #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

2019-02-20 Thread GitBox
dongjoon-hyun opened a new pull request #23851: [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values URL: https://github.com/apache/spark/pull/23851 ## What changes were proposed in this pull request? Apache Spark uses the predefined `Float

[GitHub] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258807816 ## File path: sql/core/src/test/resources/sql-tests/inputs/subquery/in-subquery/any-subquery.sql ##

[GitHub] stczwd commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-02-20 Thread GitBox
stczwd commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#discussion_r258807436 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ##

[GitHub] eatoncys edited a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-02-20 Thread GitBox
eatoncys edited a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-465891736 @cloud-fan @maropu I have add an analyzer rule like below, and it works correct

[GitHub] eatoncys commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-02-20 Thread GitBox
eatoncys commented on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-465891736 @cloud-fan @maropu I have add an analyzer rule like below, and it works correctly for

[GitHub] eatoncys edited a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types

2019-02-20 Thread GitBox
eatoncys edited a comment on issue #23010: [SPARK-26012][SQL]Null and '' values should not cause dynamic partition failure of string types URL: https://github.com/apache/spark/pull/23010#issuecomment-465891736 @cloud-fan @maropu I have add an analyzer rule like below, and it works correct

[GitHub] felixcheung commented on a change in pull request #23846: [SPARK-26729][K8S] Make image names under test configurable

2019-02-20 Thread GitBox
felixcheung commented on a change in pull request #23846: [SPARK-26729][K8S] Make image names under test configurable URL: https://github.com/apache/spark/pull/23846#discussion_r258805030 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/d

[GitHub] venkata91 commented on a change in pull request #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats

2019-02-20 Thread GitBox
venkata91 commented on a change in pull request #23803: [SPARK-26894][SQL] Handle Alias as well in AggregateEstimation to propagate child stats URL: https://github.com/apache/spark/pull/23803#discussion_r258804201 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catal

[GitHub] beliefer commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-02-20 Thread GitBox
beliefer commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#discussion_r258799693 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] beliefer commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-02-20 Thread GitBox
beliefer commented on a change in pull request #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#discussion_r258798561 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] beliefer removed a comment on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-02-20 Thread GitBox
beliefer removed a comment on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#issuecomment-465881426 What is ugis? This is an automated message

[GitHub] AmplabJenkins removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465881458 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] beliefer commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log

2019-02-20 Thread GitBox
beliefer commented on issue #23827: [SPARK-26912][CORE][HISTORY] Allow setting permission for event_log URL: https://github.com/apache/spark/pull/23827#issuecomment-465881426 What is ugis? This is an automated message from th

[GitHub] AmplabJenkins commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465881458 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] AmplabJenkins removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465881455 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465881455 Merged build finished. Test PASSed. This is an a

[GitHub] MrDLontheway commented on issue #23834: [SPARK-26919][Build] change maven default compile java home

2019-02-20 Thread GitBox
MrDLontheway commented on issue #23834: [SPARK-26919][Build] change maven default compile java home URL: https://github.com/apache/spark/pull/23834#issuecomment-465881041 OMG, Because I used zsh, my custom environment variables are missing and I need to re-source each time. It has now b

[GitHub] SparkQA removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465838451 **[Test build #102570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102570/te

[GitHub] SparkQA commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers

2019-02-20 Thread GitBox
SparkQA commented on issue #23740: [SPARK-26837][SQL] Pruning nested fields from object serializers URL: https://github.com/apache/spark/pull/23740#issuecomment-465881029 **[Test build #102570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102570/testRepor

[GitHub] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258796169 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ##

[GitHub] HeartSaVioR commented on issue #23764: [SPARK-26825][SS] Fix temp checkpoint creation in cluster mode when default filesystem is not local.

2019-02-20 Thread GitBox
HeartSaVioR commented on issue #23764: [SPARK-26825][SS] Fix temp checkpoint creation in cluster mode when default filesystem is not local. URL: https://github.com/apache/spark/pull/23764#issuecomment-465880100 Could you rebase with current master? The code change itself looks good. --

[GitHub] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258795163 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -1

[GitHub] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258793973 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ##

[GitHub] maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
maropu commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258792490 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -1

[GitHub] HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer

2019-02-20 Thread GitBox
HeartSaVioR commented on issue #22138: [SPARK-25151][SS] Apply Apache Commons Pool to KafkaDataConsumer URL: https://github.com/apache/spark/pull/22138#issuecomment-465872605 cc. @ScrapCodes since @ScrapCodes worked on cached Kafka producer and @ScrapCodes may be able to review regarding c

[GitHub] HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-02-20 Thread GitBox
HeartSaVioR commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-465871675 @dongjinleekr @zsxwing I've finally found socket source has been providing the option `includeTimestamp`

[GitHub] SparkQA removed a comment on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties.

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties. URL: https://github.com/apache/spark/pull/23574#issuecomment-465846359 **[Test build #4562 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4562/testR

[GitHub] SparkQA commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties.

2019-02-20 Thread GitBox
SparkQA commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties. URL: https://github.com/apache/spark/pull/23574#issuecomment-465871442 **[Test build #4562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4562/testReport)*

[GitHub] HeartSaVioR commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
HeartSaVioR commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465861957 While I think it is safest way to only let CompactibleFileStreamLog to maintain logs, we

[GitHub] AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465860792 Can one of the admins verify this patch? --

[GitHub] SparkQA commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
SparkQA commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465861329 **[Test build #102575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465860721 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465860721 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-465860792 Can one of the admins verify this patch? --

[GitHub] AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465859895 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465859892 Merged build finished. Test FAILed. This is a

[GitHub] AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465859895 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] HeartSaVioR opened a new pull request #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-02-20 Thread GitBox
HeartSaVioR opened a new pull request #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850 ## What changes were proposed in this pull request? This patch proposes making `purge` in `Compacti

[GitHub] SparkQA removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465843245 **[Test build #102573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102573

[GitHub] AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465859892 Merged build finished. Test FAILed. T

[GitHub] SparkQA commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable

2019-02-20 Thread GitBox
SparkQA commented on issue #23670: [SPARK-26601][SQL] Make broadcast-exchange thread pool configurable URL: https://github.com/apache/spark/pull/23670#issuecomment-465859799 **[Test build #102573 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102573/testRe

[GitHub] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465856524 Test PASSed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465856524 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults.

2019-02-20 Thread GitBox
akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults. URL: https://github.com/apache/spark/pull/22071#issuecomment-465826399 Hi @squito, if I may, I have a few comments to share regarding this change and probably you can help me to

[GitHub] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465856519 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465856519 Merged build finished. Test PASSed. --

[GitHub] akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults.

2019-02-20 Thread GitBox
akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults. URL: https://github.com/apache/spark/pull/22071#issuecomment-465826399 Hi @squito, if I may, I have a few comments to share regarding this change and probably you can help me to

[GitHub] SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465811324 **[Test build #102567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBu

[GitHub] SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-02-20 Thread GitBox
SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-465856219 **[Test build #102567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults.

2019-02-20 Thread GitBox
akirillov edited a comment on issue #22071: [SPARK-25088][CORE][MESOS][DOCS] Update Rest Server docs & defaults. URL: https://github.com/apache/spark/pull/22071#issuecomment-465826399 Hi @squito, if I may, I have a few comments to share regarding this change and probably you can help me to

[GitHub] AmplabJenkins commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465854311 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] SparkQA commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
SparkQA commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465853999 **[Test build #102563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102563/testReport)** for P

[GitHub] AmplabJenkins removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465854310 Merged build finished. Test PASSed. This is an auto

[GitHub] AmplabJenkins removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465854311 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] AmplabJenkins commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465854310 Merged build finished. Test PASSed. This is an automated me

[GitHub] SparkQA removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService.

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23839: [SPARK-26788][yarn] Remove SchedulerExtensionService. URL: https://github.com/apache/spark/pull/23839#issuecomment-465794727 **[Test build #102563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102563/testReport)**

[GitHub] AmplabJenkins removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465852355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] AmplabJenkins commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465852355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berke

[GitHub] AmplabJenkins removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465852352 Merged build finished. Test PASSed. This is

[GitHub] AmplabJenkins commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465852352 Merged build finished. Test PASSed. This is an auto

[GitHub] SparkQA removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
SparkQA removed a comment on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465799121 **[Test build #102564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102564/testR

[GitHub] SparkQA commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode

2019-02-20 Thread GitBox
SparkQA commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-465852027 **[Test build #102564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102564/testReport)*

[GitHub] SparkQA commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
SparkQA commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465849284 **[Test build #102574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/102574/tes

[GitHub] AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465848934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465848931 Merged build finished. Test PASSed. --

[GitHub] AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465848934 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception

2019-02-20 Thread GitBox
AmplabJenkins commented on issue #23835: [SPARK-24783][SQL]spark.sql.shuffle.partitions=0 should throw exception URL: https://github.com/apache/spark/pull/23835#issuecomment-465848931 Merged build finished. Test PASSed. This

[GitHub] imatiach-msft edited a comment on issue #22087: [SPARK-25097][ML] Support prediction on single instance in KMeans/BiKMeans/GMM

2019-02-20 Thread GitBox
imatiach-msft edited a comment on issue #22087: [SPARK-25097][ML] Support prediction on single instance in KMeans/BiKMeans/GMM URL: https://github.com/apache/spark/pull/22087#issuecomment-465847633 @erikerlandson I think this PR is good as is, we should decouple what it is fixing and th

[GitHub] francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery

2019-02-20 Thread GitBox
francis0407 commented on a change in pull request #23783: [SPARK-26854][SQL] Support ANY/SOME subquery URL: https://github.com/apache/spark/pull/23783#discussion_r258768032 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ##

[GitHub] imatiach-msft commented on issue #22087: [SPARK-25097][ML] Support prediction on single instance in KMeans/BiKMeans/GMM

2019-02-20 Thread GitBox
imatiach-msft commented on issue #22087: [SPARK-25097][ML] Support prediction on single instance in KMeans/BiKMeans/GMM URL: https://github.com/apache/spark/pull/22087#issuecomment-465847633 @erikerlandson I think this PR is good as is, we should decouple what it is fixing and the requ

[GitHub] beliefer commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties.

2019-02-20 Thread GitBox
beliefer commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties. URL: https://github.com/apache/spark/pull/23574#issuecomment-465847373 @srowen Thanks for your help! I used to think that 'may' is the same as 'can'.

[GitHub] AmplabJenkins removed a comment on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties.

2019-02-20 Thread GitBox
AmplabJenkins removed a comment on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties. URL: https://github.com/apache/spark/pull/23574#issuecomment-455130305 Can one of the admins verify this patch? T

[GitHub] SparkQA commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties.

2019-02-20 Thread GitBox
SparkQA commented on issue #23574: [MINOR][SQL] Fix typo in exception about set table properties. URL: https://github.com/apache/spark/pull/23574#issuecomment-465846359 **[Test build #4562 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4562/testReport)**

[GitHub] srowen commented on a change in pull request #3497: SPARK-4170 [CORE] Closure problems when running Scala app that "extends App"

2019-02-20 Thread GitBox
srowen commented on a change in pull request #3497: SPARK-4170 [CORE] Closure problems when running Scala app that "extends App" URL: https://github.com/apache/spark/pull/3497#discussion_r258766567 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

  1   2   3   4   5   6   7   8   >