[GitHub] [spark] zzcclp commented on a change in pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct

2021-02-13 Thread GitBox
zzcclp commented on a change in pull request #31404: URL: https://github.com/apache/spark/pull/31404#discussion_r575769956 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSetOperationsSuite.scala ## @@ -385,6 +385,90 @@ class DataFrameSetOperationsSuite ext

[GitHub] [spark] zzcclp commented on a change in pull request #31404: [SPARK-34283][SQL] Combines all adjacent 'Union' operators into a single 'Union' when using 'Dataset.union.distinct.union.distinct

2021-02-13 Thread GitBox
zzcclp commented on a change in pull request #31404: URL: https://github.com/apache/spark/pull/31404#discussion_r575769521 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSetOperationsSuite.scala ## @@ -385,6 +385,90 @@ class DataFrameSetOperationsSuite ext

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778741200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135144/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778741200 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135144/ -

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575765476 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -725,6 +725,16 @@ abstract class AvroSuite assert(r

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575765283 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala ## @@ -47,7 +51,25 @@ private[sql] class AvroOptions( *

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575765191 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala ## @@ -47,7 +51,25 @@ private[sql] class AvroOptions( *

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575764991 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -702,7 +702,7 @@ abstract class AvroSuite } }

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575764900 ## File path: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala ## @@ -725,6 +725,16 @@ abstract class AvroSuite assert(r

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
dongjoon-hyun commented on a change in pull request #31543: URL: https://github.com/apache/spark/pull/31543#discussion_r575764801 ## File path: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroOptions.scala ## @@ -47,7 +51,25 @@ private[sql] class AvroOptions( *

[GitHub] [spark] SparkQA commented on pull request #31561: [WIP][SPARK-34426] Add driver and executors POD logs to integration tests log when the test fails

2021-02-13 Thread GitBox
SparkQA commented on pull request #31561: URL: https://github.com/apache/spark/pull/31561#issuecomment-778737670 **[Test build #135145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135145/testReport)** for PR 31561 at commit [`73949ef`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778724015 **[Test build #135144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135144/testReport)** for PR 31559 at commit [`8604db2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778737420 **[Test build #135144 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135144/testReport)** for PR 31559 at commit [`8604db2`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778736297 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778736296 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778719714 **[Test build #135143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135143/testReport)** for PR 31559 at commit [`2ba486e`](https://gi

[GitHub] [spark] attilapiros opened a new pull request #31561: [WIP][SPARK-34426] Add driver and executors POD logs to integration tests log when the test fails

2021-02-13 Thread GitBox
attilapiros opened a new pull request #31561: URL: https://github.com/apache/spark/pull/31561 ### What changes were proposed in this pull request? This PR introduces a new protected method in `SparkFunSuite` which is only called when the test failed and can be used to collect logs fo

[GitHub] [spark] SparkQA commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778734574 **[Test build #135143 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135143/testReport)** for PR 31559 at commit [`2ba486e`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778733679 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39725/ ---

[GitHub] [spark] attilapiros commented on pull request #31559: [SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
attilapiros commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778732909 cc @srowen @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] allisonwang-db commented on a change in pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

2021-02-13 Thread GitBox
allisonwang-db commented on a change in pull request #31316: URL: https://github.com/apache/spark/pull/31316#discussion_r575757699 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/unresolved.scala ## @@ -144,10 +143,14 @@ case class UnresolvedAt

[GitHub] [spark] allisonwang-db commented on a change in pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

2021-02-13 Thread GitBox
allisonwang-db commented on a change in pull request #31316: URL: https://github.com/apache/spark/pull/31316#discussion_r575757506 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala ## @@ -741,4 +741,20 @@ private[spark] object Q

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778731061 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39724/

[GitHub] [spark] AmplabJenkins commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778731061 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39724/ -

[GitHub] [spark] SparkQA commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778730683 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39725/ -

[GitHub] [spark] SparkQA commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778724015 **[Test build #135144 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135144/testReport)** for PR 31559 at commit [`8604db2`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778719714 **[Test build #135143 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135143/testReport)** for PR 31559 at commit [`2ba486e`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #31560: [SPARK-34432][SQL][TEST][FOLLOWUP] Add a java implementation of simpl…

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31560: URL: https://github.com/apache/spark/pull/31560#issuecomment-778718324 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] kevincmchen opened a new pull request #31560: [SPARK-34432][SQL][TEST][FOLLOWUP] Add a java implementation of simpl…

2021-02-13 Thread GitBox
kevincmchen opened a new pull request #31560: URL: https://github.com/apache/spark/pull/31560 …e writable data source in `DataSourceV2Suite` ### What changes were proposed in this pull request? This is a followup of https://github.com/apache/spark/pull/19269 In #19269 ,

[GitHub] [spark] kevincmchen closed pull request #31558: [SPARK-34432][SQL][TEST][FOLLOWUP] Add a java implementation of simpl…

2021-02-13 Thread GitBox
kevincmchen closed pull request #31558: URL: https://github.com/apache/spark/pull/31558 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778706439 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778706440 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778694539 **[Test build #135142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135142/testReport)** for PR 31559 at commit [`266bfcc`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778705520 **[Test build #135142 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135142/testReport)** for PR 31559 at commit [`266bfcc`](https://github.co

[GitHub] [spark] github-actions[bot] closed pull request #29837: [SPARK-32463][SQL][DOCS] Add "Type Conversion" section in "Supported Data Types" of SQL docs

2021-02-13 Thread GitBox
github-actions[bot] closed pull request #29837: URL: https://github.com/apache/spark/pull/29837 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] github-actions[bot] commented on pull request #30262: [SPARK-33356] Remove eliminate mutual recursion in PartitionerAwareUnion

2021-02-13 Thread GitBox
github-actions[bot] commented on pull request #30262: URL: https://github.com/apache/spark/pull/30262#issuecomment-778700677 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778700341 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135141/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778700341 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135141/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778669917 **[Test build #135141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135141/testReport)** for PR 31476 at commit [`b8c762a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
SparkQA commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778697579 **[Test build #135141 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135141/testReport)** for PR 31476 at commit [`b8c762a`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
SparkQA commented on pull request #31559: URL: https://github.com/apache/spark/pull/31559#issuecomment-778694539 **[Test build #135142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135142/testReport)** for PR 31559 at commit [`266bfcc`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778694227 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135140/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778694227 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135140/ -

[GitHub] [spark] attilapiros commented on a change in pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
attilapiros commented on a change in pull request #31559: URL: https://github.com/apache/spark/pull/31559#discussion_r575727769 ## File path: dev/create-release/release-build.sh ## @@ -333,7 +333,13 @@ if [[ "$1" == "docs" ]]; then echo "Building Spark docs" cd docs #

[GitHub] [spark] attilapiros commented on a change in pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
attilapiros commented on a change in pull request #31559: URL: https://github.com/apache/spark/pull/31559#discussion_r575727769 ## File path: dev/create-release/release-build.sh ## @@ -333,7 +333,13 @@ if [[ "$1" == "docs" ]]; then echo "Building Spark docs" cd docs #

[GitHub] [spark] attilapiros opened a new pull request #31559: [WIP][SPARK-34433] Lock Jekyll version by Gemfile and Bundler

2021-02-13 Thread GitBox
attilapiros opened a new pull request #31559: URL: https://github.com/apache/spark/pull/31559 ### What changes were proposed in this pull request? Improving the documentation and release process by pinning Jekyll version by Gemfile and Bundler. ### Why are the changes needed?

[GitHub] [spark] SparkQA removed a comment on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778660542 **[Test build #135140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135140/testReport)** for PR 31273 at commit [`e92cbe1`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
SparkQA commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778690769 **[Test build #135140 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135140/testReport)** for PR 31273 at commit [`e92cbe1`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778688407 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135139/ -

[GitHub] [spark] AmplabJenkins commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778688407 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135139/ -

[GitHub] [spark] SparkQA removed a comment on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778645363 **[Test build #135139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135139/testReport)** for PR 31557 at commit [`4e7f173`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
SparkQA commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778683682 **[Test build #135139 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135139/testReport)** for PR 31557 at commit [`4e7f173`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778675245 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39722/

[GitHub] [spark] AmplabJenkins commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778675245 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39722/ -

[GitHub] [spark] SparkQA commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
SparkQA commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778673685 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39722/ ---

[GitHub] [spark] SparkQA commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
SparkQA commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778673212 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39722/ -

[GitHub] [spark] SparkQA commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
SparkQA commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778669917 **[Test build #135141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135141/testReport)** for PR 31476 at commit [`b8c762a`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778667942 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39721/

[GitHub] [spark] AmplabJenkins commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778667942 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39721/ -

[GitHub] [spark] SparkQA commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
SparkQA commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778666233 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39721/ ---

[GitHub] [spark] SparkQA commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
SparkQA commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778665667 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39721/ -

[GitHub] [spark] viirya commented on pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
viirya commented on pull request #31476: URL: https://github.com/apache/spark/pull/31476#issuecomment-778663979 Thanks for the discussion so far. I've updated the change. Please have another look if you have time. Thanks. Th

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r575701986 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/CustomMetric.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [spark] SparkQA commented on pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
SparkQA commented on pull request #31273: URL: https://github.com/apache/spark/pull/31273#issuecomment-778660542 **[Test build #135140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135140/testReport)** for PR 31273 at commit [`e92cbe1`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778660141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39720/

[GitHub] [spark] AmplabJenkins commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778660141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/39720/ -

[GitHub] [spark] viirya commented on a change in pull request #31476: [SPARK-34366][SQL] Add interface for DS v2 metrics

2021-02-13 Thread GitBox
viirya commented on a change in pull request #31476: URL: https://github.com/apache/spark/pull/31476#discussion_r575695979 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/SupportsReportMetrics.java ## @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache Soft

[GitHub] [spark] SparkQA commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
SparkQA commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778654132 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39720/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #31558: [SPARK-34432][SQL][TEST][FOLLOWUP] Add a java implementation of simpl…

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31558: URL: https://github.com/apache/spark/pull/31558#issuecomment-778651325 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] SparkQA commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
SparkQA commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778650221 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39720/ -

[GitHub] [spark] imback82 commented on a change in pull request #31273: [SPARK-34152][SQL] Make CreateViewStatement.child to be LogicalPlan's children so that it's resolved in analyze phase

2021-02-13 Thread GitBox
imback82 commented on a change in pull request #31273: URL: https://github.com/apache/spark/pull/31273#discussion_r575621089 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala ## @@ -940,7 +949,15 @@ class Analyzer(override val cata

[GitHub] [spark] kevincmchen opened a new pull request #31558: [SPARK-34432][SQL][TEST][FOLLOWUP] Add a java implementation of simpl…

2021-02-13 Thread GitBox
kevincmchen opened a new pull request #31558: URL: https://github.com/apache/spark/pull/31558 …e writable data source in `DataSourceV2Suite` ### What changes were proposed in this pull request? This is a followup of https://github.com/apache/spark/pull/19269 In #19269 ,

[GitHub] [spark] SparkQA commented on pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
SparkQA commented on pull request #31557: URL: https://github.com/apache/spark/pull/31557#issuecomment-778645363 **[Test build #135139 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135139/testReport)** for PR 31557 at commit [`4e7f173`](https://github.com

[GitHub] [spark] MaxGekk opened a new pull request #31557: [SPARK-33210][SQL][DOCS][FOLLOWUP] Fix descriptions of the SQL configs for the parquet INT96 rebase modes

2021-02-13 Thread GitBox
MaxGekk opened a new pull request #31557: URL: https://github.com/apache/spark/pull/31557 ### What changes were proposed in this pull request? Fix descriptions of the SQL configs `spark.sql.legacy.parquet.int96RebaseModeInRead` and `spark.sql.legacy.parquet.int96RebaseModeInWrite`, and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778635501 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135137/ -

[GitHub] [spark] AmplabJenkins commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778635501 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135137/ -

[GitHub] [spark] SparkQA removed a comment on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778598045 **[Test build #135137 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135137/testReport)** for PR 29243 at commit [`c63b162`](https://gi

[GitHub] [spark] srowen closed pull request #31483: [SPARK-33434][PYTHON][DOCS] Added RuntimeConfig to PySpark docs

2021-02-13 Thread GitBox
srowen closed pull request #31483: URL: https://github.com/apache/spark/pull/31483 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] SparkQA commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778631477 **[Test build #135137 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135137/testReport)** for PR 29243 at commit [`c63b162`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778628440 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778628440 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778607007 **[Test build #135138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135138/testReport)** for PR 31556 at commit [`a4397ce`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
SparkQA commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778625860 **[Test build #135138 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135138/testReport)** for PR 31556 at commit [`a4397ce`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
SparkQA commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778625693 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39719/ ---

[GitHub] [spark] wangyum commented on a change in pull request #31196: [SPARK-34129][SQL] Add table name to LogicalRelation.simpleString

2021-02-13 Thread GitBox
wangyum commented on a change in pull request #31196: URL: https://github.com/apache/spark/pull/31196#discussion_r575671102 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/LogicalRelation.scala ## @@ -64,7 +64,8 @@ case class LogicalRelation(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778621036 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135136/ -

[GitHub] [spark] AmplabJenkins commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778621036 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135136/ -

[GitHub] [spark] SparkQA removed a comment on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA removed a comment on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778586544 **[Test build #135136 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135136/testReport)** for PR 29243 at commit [`ba71ead`](https://gi

[GitHub] [spark] SparkQA commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778618942 **[Test build #135136 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135136/testReport)** for PR 29243 at commit [`ba71ead`](https://github.co

[GitHub] [spark] uzadude removed a comment on pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
uzadude removed a comment on pull request #31543: URL: https://github.com/apache/spark/pull/31543#issuecomment-778616988 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] uzadude commented on pull request #31543: [SPARK-34416] Adding support for user provided schema url in Avro

2021-02-13 Thread GitBox
uzadude commented on pull request #31543: URL: https://github.com/apache/spark/pull/31543#issuecomment-778616988 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [spark] SparkQA commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
SparkQA commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778613428 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39719/ -

[GitHub] [spark] SparkQA commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
SparkQA commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778607007 **[Test build #135138 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/135138/testReport)** for PR 31556 at commit [`a4397ce`](https://github.com

[GitHub] [spark] beliefer commented on a change in pull request #31316: [SPARK-33599][SQL][FOLLOWUP] Group exception messages in catalyst/analysis

2021-02-13 Thread GitBox
beliefer commented on a change in pull request #31316: URL: https://github.com/apache/spark/pull/31316#discussion_r575657743 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala ## @@ -732,4 +732,20 @@ private[spark] object QueryCo

[GitHub] [spark] beliefer commented on pull request #31548: [SPARK-34127][SQL] Support table valued command

2021-02-13 Thread GitBox
beliefer commented on pull request #31548: URL: https://github.com/apache/spark/pull/31548#issuecomment-778605560 cc @wangyum This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778604639 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
AmplabJenkins commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778604639 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778603541 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39718/ ---

[GitHub] [spark] SparkQA commented on pull request #29243: [SPARK-32444][SQL] Infer filters from DPP

2021-02-13 Thread GitBox
SparkQA commented on pull request #29243: URL: https://github.com/apache/spark/pull/29243#issuecomment-778603034 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39718/ -

[GitHub] [spark] MaxGekk commented on pull request #31556: [SPARK-34431][CORE] Only load `hive-site.xml` once

2021-02-13 Thread GitBox
MaxGekk commented on pull request #31556: URL: https://github.com/apache/spark/pull/31556#issuecomment-778602188 @hvanhovell @HyukjinKwon @dongjoon-hyun @yaooqinn Could you review this PR, please. This is an automated messag

  1   2   >