[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599170804 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599170802 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599170804 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599170802 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
SparkQA removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158881 **[Test build #119807 has

[GitHub] [spark] SparkQA commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
SparkQA commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599170760 **[Test build #119807 has

[GitHub] [spark] AmplabJenkins commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable()

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable() URL: https://github.com/apache/spark/pull/27908#issuecomment-599170133 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable()

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable() URL: https://github.com/apache/spark/pull/27908#issuecomment-599170131 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable()

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable() URL: https://github.com/apache/spark/pull/27908#issuecomment-599170131 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable()

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable() URL: https://github.com/apache/spark/pull/27908#issuecomment-599170133 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable()

2020-03-14 Thread GitBox
SparkQA commented on issue #27908: [SPARK-31000] Add ability to set table description via Catalog.createTable() URL: https://github.com/apache/spark/pull/27908#issuecomment-599170047 **[Test build #119811 has

[GitHub] [spark] SparkQA commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
SparkQA commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169636 **[Test build #119810 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169237 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169233 Merged build finished. Test PASSed.

[GitHub] [spark] nchammas commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
nchammas commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169553 > assuming it's also manually tested (e.g., version checking when it's not installed) Can confirm I tested it

[GitHub] [spark] HyukjinKwon commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599169480 cc @cloud-fan too - I realised that you touched lots of codes related to this during

[GitHub] [spark] HyukjinKwon commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169387 @nchammas sure, looks good! one nit in the PR title I fixed.

[GitHub] [spark] nchammas commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
nchammas commented on issue #27917: [SPARK-31153][BUILD][3.0] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169322 cc @HyukjinKwon. It's my first time backporting a change. Did I do it right? [Contributing

[GitHub] [spark] AmplabJenkins commented on issue #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169237 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917#issuecomment-599169233 Merged build finished. Test PASSed. This is an

[GitHub] [spark] nchammas opened a new pull request #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
nchammas opened a new pull request #27917: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27917 Backport of #27910 / 0ce5519f179a8f88a688dece754596c3166528b7. --- This PR cleans up several failures -- most of them silent

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392638387 ## File path: dev/requirements.txt ## @@ -1,5 +1,8 @@ -flake8==3.5.0 +pycodestyle==2.5.0 Review

[GitHub] [spark] AmplabJenkins removed a comment on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599168753 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599168749 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599168753 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599168749 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
SparkQA commented on issue #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#issuecomment-599168680 **[Test build #119809 has

[GitHub] [spark] SparkQA commented on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
SparkQA commented on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167765 **[Test build #119808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/119808/testReport)** for PR 27912 at commit

[GitHub] [spark] nchammas commented on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
nchammas commented on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167692 I'd say the high-value rules are the [D100s](http://www.pydocstyle.org/en/5.0.2/error_codes.html), which cover missing docstrings in public

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#discussion_r392641318 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#discussion_r392641318 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167403 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167401 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167403 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167401 Merged build finished. Test PASSed. This is an automated message from the

[GitHub] [spark] nchammas commented on issue #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
nchammas commented on issue #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#issuecomment-599167117 Here's a count of the errors when I try enabling all the rules: ``` ++-+ | error_code|count| ++-+

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#discussion_r392640299 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599166081 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599166082 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#discussion_r392640047 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599166082 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599166081 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
SparkQA removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599151250 **[Test build #119806 has

[GitHub] [spark] SparkQA commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
SparkQA commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599165960 **[Test build #119806 has

[GitHub] [spark] HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#issuecomment-599165500 @nchammas, it has conflicts with branch-3.0. Do you mind if I ask to make a backporting PR? We should port it back to

[GitHub] [spark] HyukjinKwon edited a comment on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon edited a comment on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#issuecomment-599165381 Merged to master. This is an automated message

[GitHub] [spark] HyukjinKwon closed pull request #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon closed pull request #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#issuecomment-599165381 Merged to master and branch-3.0. This is an automated

[GitHub] [spark] HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#issuecomment-599165285 It has a bunch of mistakes we should avoid in general ...

[GitHub] [spark] HyukjinKwon edited a comment on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon edited a comment on issue #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#issuecomment-599165285 It fixes a bunch of mistakes we should avoid in general ...

[GitHub] [spark] HyukjinKwon commented on issue #22994: [BUILD] refactor dev/lint-python in to something readable

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #22994: [BUILD] refactor dev/lint-python in to something readable URL: https://github.com/apache/spark/pull/22994#issuecomment-599165196 This was merged to master (and branch-3.0). This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27910: [SPARK-31153][BUILD] Cleanup several failures in lint-python URL: https://github.com/apache/spark/pull/27910#discussion_r392639302 ## File path: dev/lint-python ## @@ -71,11 +82,8 @@ function pycodestyle_test {

[GitHub] [spark] nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392639239 ## File path: dev/requirements.txt ## @@ -1,5 +1,8 @@ -flake8==3.5.0 +pycodestyle==2.5.0 Review comment:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392638919 ## File path: dev/tox.ini ## @@ -18,4 +18,4 @@ ignore=E226,E241,E305,E402,E722,E731,E741,W503,W504

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392638919 ## File path: dev/tox.ini ## @@ -18,4 +18,4 @@ ignore=E226,E241,E305,E402,E722,E731,E741,W503,W504

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392638671 ## File path: dev/tox.ini ## @@ -18,4 +18,4 @@ ignore=E226,E241,E305,E402,E722,E731,E741,W503,W504

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392638387 ## File path: dev/requirements.txt ## @@ -1,5 +1,8 @@ -flake8==3.5.0 +pycodestyle==2.5.0 Review

[GitHub] [spark] HyukjinKwon commented on issue #27903: [SPARK-31149][PySpark] PySpark job not killing Spark Daemon processes…

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27903: [SPARK-31149][PySpark] PySpark job not killing Spark Daemon processes… URL: https://github.com/apache/spark/pull/27903#issuecomment-599162663 @avenherak, please keep [the PR

[GitHub] [spark] HyukjinKwon commented on a change in pull request #27903: [SPARK-31149][PySpark] PySpark job not killing Spark Daemon processes…

2020-03-14 Thread GitBox
HyukjinKwon commented on a change in pull request #27903: [SPARK-31149][PySpark] PySpark job not killing Spark Daemon processes… URL: https://github.com/apache/spark/pull/27903#discussion_r392637669 ## File path: python/pyspark/daemon.py ## @@ -100,7 +100,7 @@ def

[GitHub] [spark] HyukjinKwon closed pull request #27914: [SPARK-31156] Tweak Greetings in Issues and PR's

2020-03-14 Thread GitBox
HyukjinKwon closed pull request #27914: [SPARK-31156] Tweak Greetings in Issues and PR's URL: https://github.com/apache/spark/pull/27914 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on issue #27914: [SPARK-31156] Tweak Greetings in Issues and PR's

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27914: [SPARK-31156] Tweak Greetings in Issues and PR's URL: https://github.com/apache/spark/pull/27914#issuecomment-599161877 Such kind of messages duplicate the ones in PR template. I won't consider adding this for now.

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158987 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158986 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158986 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158987 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
SparkQA commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158881 **[Test build #119807 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599149420 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
HyukjinKwon commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599158482 ok to test This is an automated message from

[GitHub] [spark] gatorsmile commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions

2020-03-14 Thread GitBox
gatorsmile commented on a change in pull request #27901: [SPARK-31146][SQL] Leverage the helper method for aliasing in built-in SQL expressions URL: https://github.com/apache/spark/pull/27901#discussion_r392630835 ## File path:

[GitHub] [spark] SparkQA commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
SparkQA commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599151250 **[Test build #119806 has

[GitHub] [spark] github-actions[bot] commented on issue #18729: [SPARK-21526] [MLlib] Add support to ML LogisticRegression for setting initial model

2020-03-14 Thread GitBox
github-actions[bot] commented on issue #18729: [SPARK-21526] [MLlib] Add support to ML LogisticRegression for setting initial model URL: https://github.com/apache/spark/pull/18729#issuecomment-599150863 We're closing this PR because it hasn't been updated in a while. This isn't a

[GitHub] [spark] AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599150771 Merged build finished. Test PASSed.

[GitHub] [spark] github-actions[bot] commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs

2020-03-14 Thread GitBox
github-actions[bot] commented on issue #25514: [SPARK-28784][SS] Use CheckpointFileManager in StreamExecution/StreamingQueryManager for checkpoint dirs URL: https://github.com/apache/spark/pull/25514#issuecomment-599150862 We're closing this PR because it hasn't been updated in a while.

[GitHub] [spark] AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599150771 Merged build finished. Test PASSed. This

[GitHub] [spark] github-actions[bot] commented on issue #26754: [SPARK-30115][SQL] Improve limit only query on datasource table

2020-03-14 Thread GitBox
github-actions[bot] commented on issue #26754: [SPARK-30115][SQL] Improve limit only query on datasource table URL: https://github.com/apache/spark/pull/26754#issuecomment-599150859 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the

[GitHub] [spark] github-actions[bot] closed pull request #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent between Literals and subquery

2020-03-14 Thread GitBox
github-actions[bot] closed pull request #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent between Literals and subquery URL: https://github.com/apache/spark/pull/19635 This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599150774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] github-actions[bot] commented on issue #26762: [SPARK-30131] add array_median function

2020-03-14 Thread GitBox
github-actions[bot] commented on issue #26762: [SPARK-30131] add array_median function URL: https://github.com/apache/spark/pull/26762#issuecomment-599150855 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's

[GitHub] [spark] AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599150774 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior

2020-03-14 Thread GitBox
maropu commented on issue #22038: [SPARK-25056][SQL] Unify the InConversion and BinaryComparison behavior URL: https://github.com/apache/spark/pull/22038#issuecomment-599150685 retest this please This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599149340 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599149420 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916#issuecomment-599149340 Can one of the admins verify this patch?

[GitHub] [spark] kachayev opened a new pull request #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax

2020-03-14 Thread GitBox
kachayev opened a new pull request #27916: [SPARK-30532] DataFrameStatFunctions to work with TABLE.COLUMN syntax URL: https://github.com/apache/spark/pull/27916 ### What changes were proposed in this pull request? `DataFrameStatFunctions` now works correctly with fully qualified column

[GitHub] [spark] AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599147305 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599147306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599147305 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599147306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
SparkQA removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124494 **[Test build #119805 has

[GitHub] [spark] SparkQA commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
SparkQA commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599147164 **[Test build #119805 has

[GitHub] [spark] maropu commented on issue #27909: [SPARK-31151][SQL][DOC] Reorganize the migration guide of SQL

2020-03-14 Thread GitBox
maropu commented on issue #27909: [SPARK-31151][SQL][DOC] Reorganize the migration guide of SQL URL: https://github.com/apache/spark/pull/27909#issuecomment-599143392 Thanks! Merged to master/branch-3.0. This is an automated

[GitHub] [spark] maropu closed pull request #27909: [SPARK-31151][SQL][DOC] Reorganize the migration guide of SQL

2020-03-14 Thread GitBox
maropu closed pull request #27909: [SPARK-31151][SQL][DOC] Reorganize the migration guide of SQL URL: https://github.com/apache/spark/pull/27909 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392620708 ## File path: dev/requirements.txt ## @@ -1,5 +1,8 @@ -flake8==3.5.0 +pycodestyle==2.5.0 Review comment:

[GitHub] [spark] nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
nchammas commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392620161 ## File path: dev/tox.ini ## @@ -18,4 +18,4 @@ ignore=E226,E241,E305,E402,E722,E731,E741,W503,W504

[GitHub] [spark] srowen commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests

2020-03-14 Thread GitBox
srowen commented on a change in pull request #27912: [SPARK-31155] Enable pydocstyle tests URL: https://github.com/apache/spark/pull/27912#discussion_r392616546 ## File path: dev/tox.ini ## @@ -18,4 +18,4 @@ ignore=E226,E241,E305,E402,E722,E731,E741,W503,W504

[GitHub] [spark] AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124616 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins removed a comment on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124619 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124619 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
AmplabJenkins commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124616 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet

2020-03-14 Thread GitBox
SparkQA commented on issue #27915: [WIP][SQL] Rebase date/timestamp from/to Julian calendar in parquet URL: https://github.com/apache/spark/pull/27915#issuecomment-599124494 **[Test build #119805 has

  1   2   3   4   5   >