[GitHub] [spark] AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543035339 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543035346 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] SparkQA commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
SparkQA commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543034914 **[Test build #112204 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543034485 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/17192/

[GitHub] [spark] viirya commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
viirya commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#discussion_r335835182 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/exe

[GitHub] [spark] cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#discussion_r335835188 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/

[GitHub] [spark] AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543032990 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543032996 Test PASSed. Refer to this link for build results (access rights to CI server needed

[GitHub] [spark] AmplabJenkins removed a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543032996 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins removed a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543032990 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
SparkQA commented on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-543032570 **[Test build #112203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReque

[GitHub] [spark] cloud-fan closed pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
cloud-fan closed pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] cloud-fan closed pull request #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

2019-10-16 Thread GitBox
cloud-fan closed pull request #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] cloud-fan commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()`

2019-10-16 Thread GitBox
cloud-fan commented on issue #25981: [SPARK-28420][SQL] Support the `INTERVAL` type in `date_part()` URL: https://github.com/apache/spark/pull/25981#issuecomment-543030589 There is one question not addressed: https://github.com/apache/spark/pull/25981/files#r332578044 What's the mot

[GitHub] [spark] yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335829451 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- tes

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543026217 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
SparkQA removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543022709 **[Test build #112202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112202/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543026225 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543026225 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543026114 **[Test build #112202 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112202/testReport)** for PR 2574

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543026217 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-543025403 Test PASSed. Refer to this link for build results (access rights to CI server need

[GitHub] [spark] AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-543025396 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-543025396 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-543025403 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
SparkQA removed a comment on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-542972445 **[Test build #112195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq

[GitHub] [spark] SparkQA commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column

2019-10-16 Thread GitBox
SparkQA commented on issue #25214: [SPARK-28461][SQL] Pad Decimal numbers with trailing zeros to the scale of the column URL: https://github.com/apache/spark/pull/25214#issuecomment-543024896 **[Test build #112195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] cloud-fan commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
cloud-fan commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543024514 I'm merging it. We can have a followup PR to address the last code style comment. Thanks for the work @yucai and

[GitHub] [spark] planga82 commented on issue #26082: [SPARK-29431][WebUI] Improve Web UI / Sql tab visualization with cached dataframes.

2019-10-16 Thread GitBox
planga82 commented on issue #26082: [SPARK-29431][WebUI] Improve Web UI / Sql tab visualization with cached dataframes. URL: https://github.com/apache/spark/pull/26082#issuecomment-543024425 @joshrosen-stripe I see your emoji! Do you think it is and interesting feature for you too? --

[GitHub] [spark] cloud-fan commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership

2019-10-16 Thread GitBox
cloud-fan commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership URL: https://github.com/apache/spark/pull/26068#issuecomment-543023655 can we add a test in `VersionsSuite`? ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec' URL: https://github.com/apache/spark/pull/26137#issuecomment-543023159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec' URL: https://github.com/apache/spark/pull/26137#issuecomment-543023159 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543023128 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec' URL: https://github.com/apache/spark/pull/26137#issuecomment-543023151 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543023121 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec' URL: https://github.com/apache/spark/pull/26137#issuecomment-543023151 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543023128 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543023121 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543022709 **[Test build #112202 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112202/testReport)** for PR 25748

[GitHub] [spark] SparkQA commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec'

2019-10-16 Thread GitBox
SparkQA commented on issue #26137: [SPARK-29490][SQL]Reset 'WritableColumnVector' in 'RowToColumnarExec' URL: https://github.com/apache/spark/pull/26137#issuecomment-543022675 **[Test build #112200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112200/testR

[GitHub] [spark] SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543022687 **[Test build #112201 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112201/testR

[GitHub] [spark] cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335825318 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- te

[GitHub] [spark] holdenk commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite

2019-10-16 Thread GitBox
holdenk commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-543021619 Jenkins retest this please This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020982 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] SparkQA removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
SparkQA removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020491 **[Test build #112199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1121

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020977 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020972 **[Test build #112199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112199/test

[GitHub] [spark] holdenk commented on issue #26093: [SPARK-27812][K8S] Bump K8S client version to 4.6.0

2019-10-16 Thread GitBox
holdenk commented on issue #26093: [SPARK-27812][K8S] Bump K8S client version to 4.6.0 URL: https://github.com/apache/spark/pull/26093#issuecomment-543021064 Actually if were going to update to 4.6.1 (and it looks like might as well) @ifilonenko would you have the cycles to manually verify

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020982 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020977 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
SparkQA commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543020491 **[Test build #112199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112199/testR

[GitHub] [spark] cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#discussion_r335823554 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/

[GitHub] [spark] holdenk commented on issue #26093: [SPARK-27812][K8S] Bump K8S client version to 4.6.0

2019-10-16 Thread GitBox
holdenk commented on issue #26093: [SPARK-27812][K8S] Bump K8S client version to 4.6.0 URL: https://github.com/apache/spark/pull/26093#issuecomment-543020218 I'm +1 on backporting even though it's a version change I think we need this in 2.4.X -

[GitHub] [spark] holdenk commented on issue #25229: [SPARK-27900][K8s] Add jvm oom flag

2019-10-16 Thread GitBox
holdenk commented on issue #25229: [SPARK-27900][K8s] Add jvm oom flag URL: https://github.com/apache/spark/pull/25229#issuecomment-543019484 Cool, excited to see the progress. This is an automated message from the Apache Git

[GitHub] [spark] holdenk commented on a change in pull request #25870: [SPARK-27936][K8S] support python deps

2019-10-16 Thread GitBox
holdenk commented on a change in pull request #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r335822303 ## File path: resource-managers/kubernetes/integration-tests/src/test/scala/org/apache/spark/deploy/k8s/integrationtest

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543018754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543018750 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543018754 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#issuecomment-543018750 Merged build finished. Test PASSed.

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
AngersZh commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#discussion_r335822035 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSui

[GitHub] [spark] holdenk commented on a change in pull request #25870: [SPARK-27936][K8S] support python deps

2019-10-16 Thread GitBox
holdenk commented on a change in pull request #25870: [SPARK-27936][K8S] support python deps URL: https://github.com/apache/spark/pull/25870#discussion_r335821757 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/KubernetesUtils.scala #

[GitHub] [spark] AmplabJenkins commented on issue #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#issuecomment-543016447 Merged build finished. Test PASSed. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on issue #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#issuecomment-543016447 Merged build finished. Test PASSed. This is an automated message from the Apa

[GitHub] [spark] AmplabJenkins removed a comment on issue #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#issuecomment-543016454 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/Spar

[GitHub] [spark] AmplabJenkins commented on issue #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#issuecomment-543016454 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullReq

[GitHub] [spark] SparkQA commented on issue #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
SparkQA commented on issue #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#issuecomment-543016041 **[Test build #112198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112198/testReport)** for PR 26140 at commit [`1e5e93

[GitHub] [spark] plusplusjiajia commented on a change in pull request #26140: [MINOR][DOCS] Fix some typos

2019-10-16 Thread GitBox
plusplusjiajia commented on a change in pull request #26140: [MINOR][DOCS] Fix some typos URL: https://github.com/apache/spark/pull/26140#discussion_r335820104 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLAppStatusStore.scala ## @@ -133,7 +13

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543014504 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543014504 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
AmplabJenkins commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543014515 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
AmplabJenkins removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543014515 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335819124 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- tes

[GitHub] [spark] SparkQA removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
SparkQA removed a comment on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-542982785 **[Test build #112197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1121

[GitHub] [spark] SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
SparkQA commented on issue #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#issuecomment-543014003 **[Test build #112197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/112197/test

[GitHub] [spark] yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
yaooqinn commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335818447 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- tes

[GitHub] [spark] yaooqinn commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership

2019-10-16 Thread GitBox
yaooqinn commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership URL: https://github.com/apache/spark/pull/26068#issuecomment-543012654 @cloud-fan https://github.com/apache/spark/blob/a45739d97ed83dfbf8200e01b23cd875735e3a74/sql/h

[GitHub] [spark] cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335817273 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQL

[GitHub] [spark] stczwd commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
stczwd commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#discussion_r335817237 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catal

[GitHub] [spark] stczwd commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
stczwd commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#discussion_r335817336 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/inter

[GitHub] [spark] cloud-fan commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#discussion_r335815600 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/ca

[GitHub] [spark] cloud-fan commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#discussion_r335815264 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/in

[GitHub] [spark] dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335811628 ## File path: sql/core/src/test/scala/org/apache/spark/sql/S

[GitHub] [spark] cloud-fan commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#discussion_r335811775 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite

[GitHub] [spark] cloud-fan commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case'

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26053: [SPARK-29379][SQL]SHOW FUNCTIONS show '!=', '<>' , 'between', 'case' URL: https://github.com/apache/spark/pull/26053#discussion_r335811752 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.

[GitHub] [spark] dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335811628 ## File path: sql/core/src/test/scala/org/apache/spark/sql/S

[GitHub] [spark] cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335811037 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- te

[GitHub] [spark] igozali commented on a change in pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-10-16 Thread GitBox
igozali commented on a change in pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910#discussion_r335811062 ## File path: core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.s

[GitHub] [spark] cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26139: [SPARK-29491][SQL] Add bit_count function support URL: https://github.com/apache/spark/pull/26139#discussion_r335811148 ## File path: sql/core/src/test/resources/sql-tests/inputs/bitwise.sql ## @@ -0,0 +1,44 @@ +-- te

[GitHub] [spark] igozali commented on a change in pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-10-16 Thread GitBox
igozali commented on a change in pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910#discussion_r335811054 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala

[GitHub] [spark] cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335810085 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQL

[GitHub] [spark] cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335809449 ## File path: sql/core/src/test/scala/org/apache/spark/sql/SQL

[GitHub] [spark] dilipbiswal commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
dilipbiswal commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#issuecomment-542999782 @stczwd Thanks.. sorry .. i missed the newly added option. -

[GitHub] [spark] stczwd commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
stczwd commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#issuecomment-542996956 @dilipbiswal Yes, but case is not right. If you want to preserve null values, you must write l

[GitHub] [spark] cloud-fan commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership

2019-10-16 Thread GitBox
cloud-fan commented on issue #26068: [SPARK-29405][SQL] Alter table / Insert statements should not change a table's ownership URL: https://github.com/apache/spark/pull/26068#issuecomment-542996524 how is INSERT TABLE fixed in this PR? ---

[GitHub] [spark] cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs

2019-10-16 Thread GitBox
cloud-fan commented on a change in pull request #26040: [SPARK-9853][Core] Optimize shuffle fetch of continuous partition IDs URL: https://github.com/apache/spark/pull/26040#discussion_r335805668 ## File path: core/src/main/scala/org/apache/spark/shuffle/BlockStoreShuffleReader.sca

[GitHub] [spark] HeartSaVioR commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries

2019-10-16 Thread GitBox
HeartSaVioR commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-542994970 1) StreamingQueryListener doesn't work with continuous mode. Please refer #24537 which proposes to support Streaming

[GitHub] [spark] dilipbiswal commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
dilipbiswal commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#issuecomment-542994652 @stczwd I have a question. After this change when we write to the json file, we will be a

[GitHub] [spark] stczwd commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values

2019-10-16 Thread GitBox
stczwd commented on issue #26098: [SPARK-29444] Add configuration to support JacksonGenrator to keep fields with null values URL: https://github.com/apache/spark/pull/26098#issuecomment-542993816 @cloud-fan @dongjoon-hyun Any other questions about it? --

[GitHub] [spark] dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335796477 ## File path: sql/core/src/test/scala/org/apache/spark/sql/S

[GitHub] [spark] dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED

2019-10-16 Thread GitBox
dilipbiswal commented on a change in pull request #26042: [SPARK-29092][SQL] Report additional information about DataSourceScanExec in EXPLAIN FORMATTED URL: https://github.com/apache/spark/pull/26042#discussion_r335796477 ## File path: sql/core/src/test/scala/org/apache/spark/sql/S

  1   2   3   4   5   6   7   8   9   10   >