[GitHub] [spark] cloud-fan commented on a change in pull request #26763: [SPARK-30125][SQL] Remove PostgreSQL dialect

2019-12-05 Thread GitBox
cloud-fan commented on a change in pull request #26763: [SPARK-30125][SQL] Remove PostgreSQL dialect URL: https://github.com/apache/spark/pull/26763#discussion_r354297985 ## File path: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ## @@ -52,

[GitHub] [spark] cloud-fan commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables.

2019-12-05 Thread GitBox
cloud-fan commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables. URL: https://github.com/apache/spark/pull/26684#issuecomment-562118359 LGTM except https://github.com/apache/spark/pull/26684/files#r354117018 -

[GitHub] [spark] aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources

2019-12-05 Thread GitBox
aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources URL: https://github.com/apache/spark/pull/26751#discussion_r354287169 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/parq

[GitHub] [spark] aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources

2019-12-05 Thread GitBox
aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources URL: https://github.com/apache/spark/pull/26751#discussion_r354286601 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/parq

[GitHub] [spark] AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562109750 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562109597 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562109742 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562109592 Merged build finished. Test FAILed. T

[GitHub] [spark] SparkQA removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098036 **[Test build #114900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114900

[GitHub] [spark] AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562109742 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562109750 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] SparkQA commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
SparkQA commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562109516 **[Test build #114900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114900/testRe

[GitHub] [spark] AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562109592 Merged build finished. Test FAILed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562109597 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs

[GitHub] [spark] SparkQA removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562027185 **[Test build #114898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114898/testReport)** fo

[GitHub] [spark] SparkQA commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
SparkQA commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562109222 **[Test build #114898 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114898/testReport)** for PR 25

[GitHub] [spark] aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources

2019-12-05 Thread GitBox
aokolnychyi commented on a change in pull request #26751: [SPARK-30107][SQL] Expose nested schema pruning to all V2 sources URL: https://github.com/apache/spark/pull/26751#discussion_r354285161 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/Push

[GitHub] [spark] AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated de

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562107598 Test FAILed. R

[GitHub] [spark] SparkQA removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecat

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562100729 **[Test build #114902 h

[GitHub] [spark] AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated de

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562107587 Merged build fini

[GitHub] [spark] SparkQA commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warn

2019-12-05 Thread GitBox
SparkQA commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562107556 **[Test build #114902 has fini

[GitHub] [spark] AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecatio

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562107587 Merged build finished. Te

[GitHub] [spark] AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecatio

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562107598 Test FAILed. Refer to

[GitHub] [spark] hagerf commented on issue #26762: [SPARK-30131] add array_median function

2019-12-05 Thread GitBox
hagerf commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-562107475 @srowen Ok, I see. If it's really that restrictive then users can use other functions for this, even though I think it could be a popular additio

[GitHub] [spark] AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562106176 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562106166 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562106166 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562106176 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562105644 **[Test build #114897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] SparkQA removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562021793 **[Test build #114897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562103931 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562103926 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562103926 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562103931 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562103454 **[Test build #114903 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114903/te

[GitHub] [spark] amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#discussion_r354274300 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Fun

[GitHub] [spark] amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#discussion_r354274300 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Fun

[GitHub] [spark] AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562101300 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecatio

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562101263 Merged build finished. Te

[GitHub] [spark] AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecatio

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562101270 Test PASSed. Refer to

[GitHub] [spark] AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562101290 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated de

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562101270 Test PASSed. R

[GitHub] [spark] AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562101300 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated de

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562101263 Merged build fini

[GitHub] [spark] AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562101290 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562100700 **[Test build #114896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/11

[GitHub] [spark] SparkQA removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-562019209 **[Test build #114896 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] SparkQA commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warn

2019-12-05 Thread GitBox
SparkQA commented on issue #26765: [SPARK-29392][CORE][SQL][FOLLOWUP] Avoid deprecated (in 2.13) Symbol syntax 'foo in favor of simpler expression, where it generated deprecation warnings URL: https://github.com/apache/spark/pull/26765#issuecomment-562100729 **[Test build #114902 has star

[GitHub] [spark] srowen commented on issue #26762: [SPARK-30131] add array_median function

2019-12-05 Thread GitBox
srowen commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-562098756 Yes, those are pretty different use cases; `approx_median` would also not compute a median over a whole column, and indeed, would be prohibitive

[GitHub] [spark] AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment-56209855

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment

[GitHub] [spark] AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098595 Merged build finished. Test PASSed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment-56209854

[GitHub] [spark] AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098595 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
SparkQA commented on issue #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767#issuecomment-562098036 **[Test build #114900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114900/testRep

[GitHub] [spark] SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to d

2019-12-05 Thread GitBox
SparkQA commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL: https://github.com/apache/spark/pull/25863#issuecomment-562098039

[GitHub] [spark] hagerf commented on issue #26762: [SPARK-30131] add array_median function

2019-12-05 Thread GitBox
hagerf commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-562097725 Yes, of course. But we have the prefix `approx` because calculating exact median over a whole dataset is difficult to do efficiently. So users wh

[GitHub] [spark] zhengruifeng opened a new pull request #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array

2019-12-05 Thread GitBox
zhengruifeng opened a new pull request #26767: [SPARK-29914][ML][FOLLOWUP] CountVectorizer del big attribute array URL: https://github.com/apache/spark/pull/26767 ### What changes were proposed in this pull request? CountVectorizer del big attribute array ### Why are the c

[GitHub] [spark] srowen commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script

2019-12-05 Thread GitBox
srowen commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script URL: https://github.com/apache/spark/pull/26757#discussion_r354258794 ## File path: build/sbt ## @@ -66,7 +66,7 @@ Usage: $script_name [options] -sbt-dir p

[GitHub] [spark] srowen commented on issue #26762: [SPARK-30131] add array_median function

2019-12-05 Thread GitBox
srowen commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-562091119 That's a pretty different function: it computes a quantile over the whole data set. This is a function of a single array value.

[GitHub] [spark] yaooqinn commented on issue #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal

2019-12-05 Thread GitBox
yaooqinn commented on issue #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal URL: https://github.com/apache/spark/pull/26537#issuecomment-562086114 thanks, @HyukjinKwon for your suggestion. I have drafted a proposal here. http://apache-spark-d

[GitHub] [spark] cloud-fan commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
cloud-fan commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#discussion_r354248459 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Fu

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562074456 Test FAILed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562074440 Merged build finished. Test FAILed. -

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562074440 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562074422 **[Test build #114899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114899/t

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562074456 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] SparkQA removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562072806 **[Test build #114899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
SparkQA commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562072806 **[Test build #114899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114899/te

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562070140 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562070135 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562070135 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#issuecomment-562070140 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] amanomer commented on issue #26734: [SPARK-30099][SQL] Improve Analyzed Logical Plan

2019-12-05 Thread GitBox
amanomer commented on issue #26734: [SPARK-30099][SQL] Improve Analyzed Logical Plan URL: https://github.com/apache/spark/pull/26734#issuecomment-562067688 https://github.com/apache/spark/blob/332e252a1448a27cfcfc1d1d794f7979e6cd331a/sql/core/src/main/scala/org/apache/spark/sql/execution/Q

[GitHub] [spark] AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562065772 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562065786 Test PASSed. Refer to this link for build results (access rights to CI s

[GitHub] [spark] AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562065786 Test PASSed. Refer to this link for build results (access rights to CI server ne

[GitHub] [spark] AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562065772 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
SparkQA removed a comment on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562016839 **[Test build #114895 has started](https://amplab.cs.berkeley.edu/jenkins/job/Sp

[GitHub] [spark] SparkQA commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system

2019-12-05 Thread GitBox
SparkQA commented on issue #24132: [SPARK-27189][CORE] Add Executor metrics and memory usage instrumentation to the metrics system URL: https://github.com/apache/spark/pull/24132#issuecomment-562065001 **[Test build #114895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPull

[GitHub] [spark] hagerf commented on issue #26762: [SPARK-30131] add array_median function

2019-12-05 Thread GitBox
hagerf commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-562059403 @HyukjinKwon I added some links, I think they should be relevant. We already have `approxQuantile` but then this would be an exact function,

[GitHub] [spark] amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias

2019-12-05 Thread GitBox
amanomer commented on a change in pull request #26712: [SPARK-29883][SQL] Improve error messages when function name is an alias URL: https://github.com/apache/spark/pull/26712#discussion_r354207829 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Fun

[GitHub] [spark] HyukjinKwon commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal

2019-12-05 Thread GitBox
HyukjinKwon commented on a change in pull request #26537: [SPARK-29587][SQL] Support SQL Standard type real as float(4) numeric as decimal URL: https://github.com/apache/spark/pull/26537#discussion_r354188577 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/p

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-05 Thread GitBox
HyukjinKwon commented on a change in pull request #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#discussion_r354183693 ## File path: docs/sql-data-sources-avro.md ## @@ -240,6 +240,14 @

[GitHub] [spark] HyukjinKwon commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas

2019-12-05 Thread GitBox
HyukjinKwon commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#issuecomment-562039688 @giamo, sorry it took long. very close to go. Can you address the comments? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer URL: https://github.com/apache/spark/pull/26766#issuecomment-562035708 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer URL: https://github.com/apache/spark/pull/26766#issuecomment-562036142 Can one of the admins verify this patch? ---

[GitHub] [spark] AmplabJenkins commented on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer URL: https://github.com/apache/spark/pull/26766#issuecomment-562035708 Can one of the admins verify this patch? ---

[GitHub] [spark] yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script

2019-12-05 Thread GitBox
yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script URL: https://github.com/apache/spark/pull/26757#discussion_r354177570 ## File path: build/sbt ## @@ -66,7 +66,7 @@ Usage: $script_name [options] -sbt-dir

[GitHub] [spark] yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script

2019-12-05 Thread GitBox
yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script URL: https://github.com/apache/spark/pull/26757#discussion_r354177915 ## File path: build/sbt ## @@ -66,7 +66,7 @@ Usage: $script_name [options] -sbt-dir

[GitHub] [spark] yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script

2019-12-05 Thread GitBox
yaooqinn commented on a change in pull request #26757: [SPARK-30121][Build] Fix memory usage in sbt build script URL: https://github.com/apache/spark/pull/26757#discussion_r354177570 ## File path: build/sbt ## @@ -66,7 +66,7 @@ Usage: $script_name [options] -sbt-dir

[GitHub] [spark] fuwhu opened a new pull request #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer

2019-12-05 Thread GitBox
fuwhu opened a new pull request #26766: [SPARK-30138][SQL]Separate configuration key of max iterations for analyzer and optimizer URL: https://github.com/apache/spark/pull/26766 ### What changes were proposed in this pull request? separate the configuration keys "spark.sql.optimizer.maxI

[GitHub] [spark] yaooqinn commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-05 Thread GitBox
yaooqinn commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#discussion_r354170836 ## File path: sql/core/src/test/resources/sql-tests/results/datetime.sql.out #

[GitHub] [spark] SparkQA commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
SparkQA commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562027185 **[Test build #114898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114898/testReport)** for PR 250

[GitHub] [spark] AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562024945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins removed a comment on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562024934 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax

2019-12-05 Thread GitBox
AmplabJenkins commented on issue #25001: [SPARK-28083][SQL] Support LIKE ... ESCAPE syntax URL: https://github.com/apache/spark/pull/25001#issuecomment-562024945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

<    1   2   3   4   5   6   7   >