[GitHub] [spark] dongjoon-hyun commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
dongjoon-hyun commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812817415 Could you review this please when you have some time, @viirya , @attilapiros , @HyukjinKwon ? -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812811721 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41454/

[GitHub] [spark] AmplabJenkins commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812811721 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41454/ --

[GitHub] [spark] SparkQA commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
SparkQA commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812811715 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41454/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-812811027 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41455/

[GitHub] [spark] AmplabJenkins commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-812811027 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41455/ --

[GitHub] [spark] SparkQA commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-02 Thread GitBox
SparkQA commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-812809468 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
SparkQA commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812809446 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41454/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812806921 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136877/

[GitHub] [spark] AmplabJenkins commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812806921 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136877/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812805674 **[Test build #136877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136877/testReport)** for PR 32042 at commit

[GitHub] [spark] SparkQA commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
SparkQA commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812806889 **[Test build #136877 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136877/testReport)** for PR 32042 at commit

[GitHub] [spark] SparkQA commented on pull request #31968: [SPARK-34873][SQL] Avoid wrapped in withNewExecutionId twice when run SQL with side effects

2021-04-02 Thread GitBox
SparkQA commented on pull request #31968: URL: https://github.com/apache/spark/pull/31968#issuecomment-812805687 **[Test build #136878 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136878/testReport)** for PR 31968 at commit

[GitHub] [spark] SparkQA commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
SparkQA commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812805674 **[Test build #136877 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136877/testReport)** for PR 32042 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812805426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41453/

[GitHub] [spark] AmplabJenkins commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812805426 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41453/ --

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812803813 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] dongjoon-hyun commented on pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
dongjoon-hyun commented on pull request #32042: URL: https://github.com/apache/spark/pull/32042#issuecomment-812803422 Could you review this, @ScrapCodes ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] dongjoon-hyun closed pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
dongjoon-hyun closed pull request #32042: URL: https://github.com/apache/spark/pull/32042 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] dongjoon-hyun opened a new pull request #32042: [SPARK-34948][K8S] Add ownerReference to executor configmap to fix leakages

2021-04-02 Thread GitBox
dongjoon-hyun opened a new pull request #32042: URL: https://github.com/apache/spark/pull/32042 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was

[GitHub] [spark] yaooqinn commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
yaooqinn commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812800803 > It seems we need to update the TPCDS query results accordingly if we change the schemas. I'll check this later. Shall we comment out the action

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32041: URL: https://github.com/apache/spark/pull/32041#issuecomment-812800304 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41451/

[GitHub] [spark] SparkQA commented on pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
SparkQA commented on pull request #32041: URL: https://github.com/apache/spark/pull/32041#issuecomment-812800296 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41451/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32041: URL: https://github.com/apache/spark/pull/32041#issuecomment-812800304 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41451/ --

[GitHub] [spark] SparkQA commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
SparkQA commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812799629 **[Test build #136876 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136876/testReport)** for PR 32037 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812799534 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812799536 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136870/

[GitHub] [spark] AmplabJenkins commented on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812799536 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136870/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812799534 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812786946 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
SparkQA commented on pull request #32041: URL: https://github.com/apache/spark/pull/32041#issuecomment-812780328 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41451/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812730700 **[Test build #136870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136870/testReport)** for PR 32038 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812776944 **[Test build #136875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136875/testReport)** for PR 31827 at commit

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812778318 **[Test build #136875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136875/testReport)** for PR 31827 at commit

[GitHub] [spark] SparkQA commented on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
SparkQA commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812778316 **[Test build #136870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136870/testReport)** for PR 32038 at commit

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812776944 **[Test build #136875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136875/testReport)** for PR 31827 at commit

[GitHub] [spark] imback82 commented on pull request #32032: [SPARK-34701][SQL] Introduce TransformAfterAnalysis rule that allows a logical plan to be transformed after all the analysis rules run.

2021-04-02 Thread GitBox
imback82 commented on pull request #32032: URL: https://github.com/apache/spark/pull/32032#issuecomment-812775891 @cloud-fan I created an alternate solution to this #32041. Please let me know which approach makes more sense. Thanks! -- This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
SparkQA commented on pull request #32041: URL: https://github.com/apache/spark/pull/32041#issuecomment-812775782 **[Test build #136874 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136874/testReport)** for PR 32041 at commit

[GitHub] [spark] imback82 opened a new pull request #32041: [SPARK-34701][SQL] Introduce CommandWithAnalyzedChildren for a command to have its children only analyzed but not optimized

2021-04-02 Thread GitBox
imback82 opened a new pull request #32041: URL: https://github.com/apache/spark/pull/32041 ### What changes were proposed in this pull request? Note that this PR proposes an alternate solution to #32032. This PR proposes to introduce the `CommandWithAnalyzedChildren`

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812768016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812768018 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136871/

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812768018 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136871/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812768016 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] maropu commented on pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
maropu commented on pull request #32040: URL: https://github.com/apache/spark/pull/32040#issuecomment-812766403 Probably, we can add it somewhere in the `SQL, DataFrames, and Datasets` doc: https://spark.apache.org/docs/3.1.1/sql-getting-started.html just like the doc of structured

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812765782 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] github-actions[bot] commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2021-04-02 Thread GitBox
github-actions[bot] commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-812762588 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] mbaldini commented on pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
mbaldini commented on pull request #32040: URL: https://github.com/apache/spark/pull/32040#issuecomment-812761741 Ah I see. Where would be the correct location? I'd be happy to update it.On Apr 2, 2021 4:56 PM, Takeshi Yamamuro ***@***.***> wrote: @maropu commented on this pull request.

[GitHub] [spark] SparkQA removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812758824 **[Test build #136873 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136873/testReport)** for PR 31827 at commit

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812761452 **[Test build #136873 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136873/testReport)** for PR 31827 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812730721 **[Test build #136871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136871/testReport)** for PR 32031 at commit

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812761051 **[Test build #136871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136871/testReport)** for PR 32031 at commit

[GitHub] [spark] sunchao commented on a change in pull request #29695: [SPARK-22390][SPARK-32833][SQL] JDBC V2 Datasource aggregate push down

2021-04-02 Thread GitBox
sunchao commented on a change in pull request #29695: URL: https://github.com/apache/spark/pull/29695#discussion_r606460240 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala ## @@ -700,6 +704,49 @@ object

[GitHub] [spark] warrenzhu25 commented on a change in pull request #31869: [SPARK-34777][UI] StagePage input/output size records not show when records greater than zero

2021-04-02 Thread GitBox
warrenzhu25 commented on a change in pull request #31869: URL: https://github.com/apache/spark/pull/31869#discussion_r606519888 ## File path: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ## @@ -786,9 +786,13 @@ private[spark] object ApiHelper {

[GitHub] [spark] SparkQA removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812758231 **[Test build #136872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136872/testReport)** for PR 31827 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812760081 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136872/

[GitHub] [spark] AmplabJenkins commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812760081 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136872/ -- This

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812760065 **[Test build #136872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136872/testReport)** for PR 31827 at commit

[GitHub] [spark] maropu commented on pull request #32037: [SPARK-34944][SQL][TESTS] Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread GitBox
maropu commented on pull request #32037: URL: https://github.com/apache/spark/pull/32037#issuecomment-812759283 It seems we need to update the TPCDS query results accordingly if we change the schemas. I'll check this later. -- This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812758824 **[Test build #136873 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136873/testReport)** for PR 31827 at commit

[GitHub] [spark] maropu commented on a change in pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
maropu commented on a change in pull request #32040: URL: https://github.com/apache/spark/pull/32040#discussion_r606513566 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala ## @@ -27,6 +27,35 @@ import

[GitHub] [spark] maropu commented on a change in pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
maropu commented on a change in pull request #32040: URL: https://github.com/apache/spark/pull/32040#discussion_r606513566 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/TimeWindow.scala ## @@ -27,6 +27,35 @@ import

[GitHub] [spark] SparkQA commented on pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
SparkQA commented on pull request #31827: URL: https://github.com/apache/spark/pull/31827#issuecomment-812758231 **[Test build #136872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136872/testReport)** for PR 31827 at commit

[GitHub] [spark] twoentartian commented on a change in pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
twoentartian commented on a change in pull request #31827: URL: https://github.com/apache/spark/pull/31827#discussion_r606511432 ## File path: docs/sql-data-sources-csv.md ## @@ -0,0 +1,54 @@ +--- +layout: global +title: CSV Files +displayTitle: CSV Files +license: | +

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812757806 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136867/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-812757804 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136868/

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812757806 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136867/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-812757804 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/136868/ -- This

[GitHub] [spark] twoentartian commented on a change in pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
twoentartian commented on a change in pull request #31827: URL: https://github.com/apache/spark/pull/31827#discussion_r606508497 ## File path: docs/sql-data-sources-csv.md ## @@ -0,0 +1,54 @@ +--- +layout: global +title: CSV Files +displayTitle: CSV Files +license: | +

[GitHub] [spark] twoentartian commented on a change in pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
twoentartian commented on a change in pull request #31827: URL: https://github.com/apache/spark/pull/31827#discussion_r606507673 ## File path: docs/sql-data-sources-csv.md ## @@ -0,0 +1,54 @@ +--- +layout: global +title: CSV Files +displayTitle: CSV Files +license: | +

[GitHub] [spark] twoentartian commented on a change in pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
twoentartian commented on a change in pull request #31827: URL: https://github.com/apache/spark/pull/31827#discussion_r606507022 ## File path: docs/sql-data-sources-csv.md ## @@ -0,0 +1,54 @@ +--- +layout: global +title: CSV Files +displayTitle: CSV Files +license: | +

[GitHub] [spark] twoentartian commented on a change in pull request #31827: [SPARK-34492][DOCS] Add "CSV Files" page for Data Source documents.

2021-04-02 Thread GitBox
twoentartian commented on a change in pull request #31827: URL: https://github.com/apache/spark/pull/31827#discussion_r606506702 ## File path: docs/sql-data-sources-csv.md ## @@ -0,0 +1,54 @@ +--- +layout: global +title: CSV Files +displayTitle: CSV Files +license: | +

[GitHub] [spark] SparkQA removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-812665178 **[Test build #136868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136868/testReport)** for PR 30144 at commit

[GitHub] [spark] SparkQA commented on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-02 Thread GitBox
SparkQA commented on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-812751318 **[Test build #136868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136868/testReport)** for PR 30144 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812664868 **[Test build #136867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136867/testReport)** for PR 31913 at commit

[GitHub] [spark] SparkQA commented on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812750905 **[Test build #136867 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136867/testReport)** for PR 31913 at commit

[GitHub] [spark] shardulm94 edited a comment on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

2021-04-02 Thread GitBox
shardulm94 edited a comment on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-812750599 @tgravescs @xkrogen `spark.jar.ivySettings` today only supports files present on the client. It does not support `local://` or `hdfs://` files. Can the scope of this

[GitHub] [spark] shardulm94 commented on pull request #31591: [SPARK-34472][YARN] Ship ivySettings file to driver in cluster mode

2021-04-02 Thread GitBox
shardulm94 commented on pull request #31591: URL: https://github.com/apache/spark/pull/31591#issuecomment-812750599 @tgravescs @xkrogen `spark.jar.ivySettings` today only supports files present on the client. It does not support `local://` or `hdfs://` files. Can the scope of this PR be

[GitHub] [spark] AmplabJenkins commented on pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32040: URL: https://github.com/apache/spark/pull/32040#issuecomment-812748989 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] mbaldini opened a new pull request #32040: Add @ExpressionDescription to TimeWindow to generate missing documentation

2021-04-02 Thread GitBox
mbaldini opened a new pull request #32040: URL: https://github.com/apache/spark/pull/32040 ### What changes were proposed in this pull request? Added missing `@ExpressionDescription` annotation to `TimeWindow` to generate a missing section of documentation for the sql `window` function.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812747716 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41448/

[GitHub] [spark] AmplabJenkins commented on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812747716 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41448/ --

[GitHub] [spark] SparkQA commented on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
SparkQA commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812747697 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41448/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812745539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41449/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812745537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812745537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812745539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41449/ --

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812743893 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32038: [SPARK-34945][DOC] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
SparkQA commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812742224 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41448/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
SparkQA commented on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812741133 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41447/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
SparkQA removed a comment on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812730667 **[Test build #136869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136869/testReport)** for PR 32039 at commit

[GitHub] [spark] SparkQA commented on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
SparkQA commented on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812739126 **[Test build #136869 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136869/testReport)** for PR 32039 at commit

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service to support dynamic allocation on Kubernetes

2021-04-02 Thread GitBox
SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-812730721 **[Test build #136871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136871/testReport)** for PR 32031 at commit

[GitHub] [spark] SparkQA commented on pull request #32038: [SPARK-34945] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
SparkQA commented on pull request #32038: URL: https://github.com/apache/spark/pull/32038#issuecomment-812730700 **[Test build #136870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136870/testReport)** for PR 32038 at commit

[GitHub] [spark] SparkQA commented on pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
SparkQA commented on pull request #32039: URL: https://github.com/apache/spark/pull/32039#issuecomment-812730667 **[Test build #136869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/136869/testReport)** for PR 32039 at commit

[GitHub] [spark] sunchao opened a new pull request #32039: [SPARK-34947][SQL] Streaming write to a V2 table should refresh its associated cache

2021-04-02 Thread GitBox
sunchao opened a new pull request #32039: URL: https://github.com/apache/spark/pull/32039 ### What changes were proposed in this pull request? In `WriteToMicroBatchDataSource`, replace `WriteToDataSourceV2` with `AppendData`, as the former is deprecated. To realize this,

[GitHub] [spark] sunchao opened a new pull request #32038: [SPARK-34945] Fix Javadoc for classes in catalyst module

2021-04-02 Thread GitBox
sunchao opened a new pull request #32038: URL: https://github.com/apache/spark/pull/32038 ### What changes were proposed in this pull request? Use proper Java doc format for Java classes within `catalyst` module ### Why are the changes needed? Many Java

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812687895 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41445/

[GitHub] [spark] SparkQA commented on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
SparkQA commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812687880 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41445/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #31913: [WIP][SPARK-34581][SQL] Don't optimize out grouping expressions from aggregate expressions without aggregate function

2021-04-02 Thread GitBox
AmplabJenkins commented on pull request #31913: URL: https://github.com/apache/spark/pull/31913#issuecomment-812687895 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41445/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30144: [SPARK-33229][SQL] Support partial grouping analytics and concatenated grouping analytics

2021-04-02 Thread GitBox
AmplabJenkins removed a comment on pull request #30144: URL: https://github.com/apache/spark/pull/30144#issuecomment-812685001 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/41446/

  1   2   3   4   5   >