[GitHub] [spark] AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583816182 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583816180 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583816182 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583816180 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
SparkQA removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806187 **[Test build #118087 has

[GitHub] [spark] SparkQA commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
SparkQA commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583816014 **[Test build #118087 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop URL: https://github.com/apache/spark/pull/27506#issuecomment-583814867 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop URL: https://github.com/apache/spark/pull/27506#issuecomment-583814967 Can one of the admins verify this patch? This is

[GitHub] [spark] AmplabJenkins commented on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop URL: https://github.com/apache/spark/pull/27506#issuecomment-583814867 Can one of the admins verify this patch? This is

[GitHub] [spark] DJeyCodeX opened a new pull request #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop

2020-02-08 Thread GitBox
DJeyCodeX opened a new pull request #27506: Demo Pipeline of Migrating OnPremise Database to Spark & Hadoop URL: https://github.com/apache/spark/pull/27506 ### What changes were proposed in this pull request? This PR consist the following: 1. Many of the organisations are facing

[GitHub] [spark] AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583814380 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583814383 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583814383 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583814380 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
SparkQA removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800616 **[Test build #118084 has

[GitHub] [spark] SparkQA commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
SparkQA commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583814266 **[Test build #118084 has

[GitHub] [spark] mridulm commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-08 Thread GitBox
mridulm commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#discussion_r376760897 ## File path:

[GitHub] [spark] mridulm commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

2020-02-08 Thread GitBox
mridulm commented on a change in pull request #27313: [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes URL: https://github.com/apache/spark/pull/27313#discussion_r376760827 ## File path:

[GitHub] [spark] viirya commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression

2020-02-08 Thread GitBox
viirya commented on issue #27499: [SPARK-30590][SQL] Untyped select API cannot take typed column expression URL: https://github.com/apache/spark/pull/27499#issuecomment-583811423 cc @cloud-fan @dongjoon-hyun @HyukjinKwon

[GitHub] [spark] AmplabJenkins removed a comment on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-58388 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-58386 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-58388 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
wangyum commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-583811173 This method will have `NoSuchMethodError` exception: ```java Error in query:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-58386 Merged build finished. Test PASSed.

[GitHub] [spark] beliefer commented on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static

2020-02-08 Thread GitBox
beliefer commented on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static URL: https://github.com/apache/spark/pull/26875#issuecomment-583811170 @HyukjinKwon You can revert this PR first. If I'm ready, I will pick this PR.

[GitHub] [spark] SparkQA commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3

2020-02-08 Thread GitBox
SparkQA commented on issue #27492: [SPARK-30755][SQL][test-hive1.2] Support Hive 1.2.1's Serde after making built-in Hive to 2.3 URL: https://github.com/apache/spark/pull/27492#issuecomment-583811013 **[Test build #118090 has

[GitHub] [spark] maropu commented on a change in pull request #27489: [SPARK-30703][SQL][DOCS] Add a document for the ANSI mode

2020-02-08 Thread GitBox
maropu commented on a change in pull request #27489: [SPARK-30703][SQL][DOCS] Add a document for the ANSI mode URL: https://github.com/apache/spark/pull/27489#discussion_r376759528 ## File path: docs/sql-ref-ansi-compliance.md ## @@ -19,6 +19,87 @@ license: |

[GitHub] [spark] MaxGekk commented on a change in pull request #27502: [SPARK-30759][SQL] Initialize cache for foldable patterns in StringRegexExpression

2020-02-08 Thread GitBox
MaxGekk commented on a change in pull request #27502: [SPARK-30759][SQL] Initialize cache for foldable patterns in StringRegexExpression URL: https://github.com/apache/spark/pull/27502#discussion_r376758701 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583809027 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583809028 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583809028 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583809027 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] SparkQA removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
SparkQA removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805385 **[Test build #118086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118086/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
SparkQA commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583808970 **[Test build #118086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118086/testReport)** for PR 27461 at

[GitHub] [spark] gatorsmile commented on a change in pull request #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#discussion_r376757923 ## File path:

[GitHub] [spark] gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-02-08 Thread GitBox
gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#issuecomment-583808422 https://github.com/apache/spark/pull/27267/files#r370089158 is the major

[GitHub] [spark] gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-02-08 Thread GitBox
gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#issuecomment-583808307 @xuanyuanking Could you submit a PR to address the comments?

[GitHub] [spark] gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

2020-02-08 Thread GitBox
gatorsmile commented on issue #27267: [SPARK-30556][SQL] Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext URL: https://github.com/apache/spark/pull/27267#issuecomment-583808121 @ajithme Can you submit a PR to address the comments?

[GitHub] [spark] AmplabJenkins removed a comment on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807872 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807869 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807869 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807872 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
SparkQA commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807798 **[Test build #118089 has

[GitHub] [spark] viirya commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
viirya commented on issue #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505#issuecomment-583807577 cc @gatorsmile This is an automated

[GitHub] [spark] viirya opened a new pull request #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE

2020-02-08 Thread GitBox
viirya opened a new pull request #27505: [SPARK-27946][SQL][FOLLOW-UP] Change doc and error message for SHOW CREATE TABLE URL: https://github.com/apache/spark/pull/27505 ### What changes were proposed in this pull request? This is a follow-up for #24938 to tweak error

[GitHub] [spark] viirya commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
viirya commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r376757079 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806655 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806658 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
SparkQA commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806934 **[Test build #118088 has

[GitHub] [spark] gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r37675 ## File path: docs/sql-migration-guide.md ## @@ -328,6 +328,8 @@

[GitHub] [spark] gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r376756495 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
viirya commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r376756447 ## File path:

[GitHub] [spark] gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r376756401 ## File path:

[GitHub] [spark] viirya commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
viirya commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806619 cc @gatorsmile This is an

[GitHub] [spark] gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table"

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #24938: [SPARK-27946][SQL] Hive DDL to Spark DDL conversion USING "show create table" URL: https://github.com/apache/spark/pull/24938#discussion_r376756408 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806655 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/27504#issuecomment-583806658 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya opened a new pull request #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Gener…

2020-02-08 Thread GitBox
viirya opened a new pull request #27504: Revert "[SPARK-29721][SQL] Prune unnecessary nested fields from Gener… URL: https://github.com/apache/spark/pull/27504 …ate without Project" This reverts commit a0e63b61e7c5d55ae2a9213b95ab1e87ac7c203c. ### What changes were

[GitHub] [spark] viirya closed pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
viirya closed pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503 This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806250 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806252 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806252 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806250 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints

2020-02-08 Thread GitBox
SparkQA commented on issue #27466: [SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python type hints URL: https://github.com/apache/spark/pull/27466#issuecomment-583806187 **[Test build #118087 has

[GitHub] [spark] viirya commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
viirya commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583806136 @gatorsmile I'm ok to revert it.

[GitHub] [spark] HyukjinKwon commented on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static

2020-02-08 Thread GitBox
HyukjinKwon commented on issue #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static URL: https://github.com/apache/spark/pull/26875#issuecomment-583806095 @beliefer, seems the author is inactive. Can you make some perf numbers? If that's going to take a

[GitHub] [spark] zhengruifeng commented on issue #27501: [SPARK-30662][ML][PySpark] Put back the API changes for HasBlockSize in ALS/MLP

2020-02-08 Thread GitBox
zhengruifeng commented on issue #27501: [SPARK-30662][ML][PySpark] Put back the API changes for HasBlockSize in ALS/MLP URL: https://github.com/apache/spark/pull/27501#issuecomment-583805890 Merged to master. Thanks @huaxingao

[GitHub] [spark] zhengruifeng closed pull request #27501: [SPARK-30662][ML][PySpark] Put back the API changes for HasBlockSize in ALS/MLP

2020-02-08 Thread GitBox
zhengruifeng closed pull request #27501: [SPARK-30662][ML][PySpark] Put back the API changes for HasBlockSize in ALS/MLP URL: https://github.com/apache/spark/pull/27501 This is an automated message from the Apache Git

[GitHub] [spark] gatorsmile commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
gatorsmile commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583805748 @viirya How about reverting the original commit

[GitHub] [spark] gatorsmile commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
gatorsmile commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583805648 > If a child output is required in a top operator of Generate, we should not prune

[GitHub] [spark] gatorsmile closed pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
gatorsmile closed pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503 This is an automated message from the

[GitHub] [spark] viirya opened a new pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
viirya opened a new pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503 ### What changes were proposed in this pull request? We prune nested fields from

[GitHub] [spark] AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805466 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gatorsmile commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#discussion_r376755585 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805465 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805466 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gatorsmile commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
gatorsmile commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#discussion_r376755585 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805465 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] SparkQA commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
SparkQA commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583805385 **[Test build #118086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/118086/testReport)** for PR 27461 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583802924 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583802922 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
SparkQA commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583803205 **[Test build #118085 has

[GitHub] [spark] viirya commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
viirya commented on a change in pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#discussion_r376753522 ## File path:

[GitHub] [spark] yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#discussion_r376753394 ## File path: pom.xml ## @@ -128,19 +128,19 @@ 3.4.14 2.7.1 0.4.2 -

[GitHub] [spark] yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#discussion_r376748954 ## File path: pom.xml ## @@ -128,19 +128,19 @@ 3.4.14 2.7.1 0.4.2 -

[GitHub] [spark] AmplabJenkins commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583802924 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#discussion_r376753238 ## File path: pom.xml ## @@ -128,19 +128,19 @@ 3.4.14 2.7.1 0.4.2 -

[GitHub] [spark] yhuai commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on issue #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#issuecomment-583802901 @dongjoon-hyun i found hive storage api and hive common have the following common class files ```

[GitHub] [spark] AmplabJenkins commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503#issuecomment-583802922 Merged build finished. Test PASSed.

[GitHub] [spark] yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#discussion_r376753394 ## File path: pom.xml ## @@ -128,19 +128,19 @@ 3.4.14 2.7.1 0.4.2 -

[GitHub] [spark] viirya commented on a change in pull request #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project

2020-02-08 Thread GitBox
viirya commented on a change in pull request #26978: [SPARK-29721][SQL] Prune unnecessary nested fields from Generate without Project URL: https://github.com/apache/spark/pull/26978#discussion_r376753384 ## File path:

[GitHub] [spark] viirya opened a new pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate

2020-02-08 Thread GitBox
viirya opened a new pull request #27503: [SPARK-30761]SQL] Nested column pruning should not prune on required child outputs in Generate URL: https://github.com/apache/spark/pull/27503 ### What changes were proposed in this pull request? We prune nested fields from

[GitHub] [spark] yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles

2020-02-08 Thread GitBox
yhuai commented on a change in pull request #26619: [SPARK-29981][BUILD] Add hive-1.2/2.3 profiles URL: https://github.com/apache/spark/pull/26619#discussion_r376753238 ## File path: pom.xml ## @@ -128,19 +128,19 @@ 3.4.14 2.7.1 0.4.2 -

[GitHub] [spark] zhengruifeng commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest

2020-02-08 Thread GitBox
zhengruifeng commented on issue #27461: [SPARK-30736][ML] One-Pass ChiSquareTest URL: https://github.com/apache/spark/pull/27461#issuecomment-583802102 The lastest commit is somewhat complex, the basic idea is compute the counts of each label, and the matrix of one column, at a time. Or

[GitHub] [spark] AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800692 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800690 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800690 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
AmplabJenkins commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800692 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations

2020-02-08 Thread GitBox
SparkQA commented on issue #26977: [SPARK-30326][SQL] Raise exception if analyzer exceed max iterations URL: https://github.com/apache/spark/pull/26977#issuecomment-583800616 **[Test build #118084 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27496: [SPARK-30757][SQL][DOC] Update the doc on TableCatalog.alterTable's behavior

2020-02-08 Thread GitBox
AmplabJenkins removed a comment on issue #27496: [SPARK-30757][SQL][DOC] Update the doc on TableCatalog.alterTable's behavior URL: https://github.com/apache/spark/pull/27496#issuecomment-583800128 Test PASSed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   >