[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648800377 ## File path: python/docs/source/user_guide/pandas_on_spark/typehints.rst ## @@ -1,36 +1,36 @@ - -Type Hints In Koalas -==

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648800130 ## File path: python/docs/source/user_guide/pandas_on_spark/typehints.rst ## @@ -1,36 +1,36 @@ - -Type Hints In Koalas -==

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648800023 ## File path: python/docs/source/user_guide/pandas_on_spark/typehints.rst ## @@ -1,36 +1,36 @@ - -Type Hints In Koalas -==

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648799959 ## File path: python/docs/source/user_guide/pandas_on_spark/typehints.rst ## @@ -1,36 +1,36 @@ - -Type Hints In Koalas -==

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648799755 ## File path: python/docs/source/user_guide/pandas_on_spark/transform_apply.rst ## @@ -85,8 +85,8 @@ then applies the given function with pandas DataF

[GitHub] [spark] cloud-fan commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
cloud-fan commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648799671 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -378,16 +378,26 @@ object DateTimeUtils {

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648799210 ## File path: python/docs/source/user_guide/pandas_on_spark/transform_apply.rst ## @@ -66,7 +66,7 @@ Please refer the API documentations. ---

[GitHub] [spark] SparkQA commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858224105 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44130/ -- This

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795878 ## File path: python/docs/source/user_guide/pandas_on_spark/pandas_pyspark.rst ## @@ -56,15 +56,15 @@ pandas DataFrame can be a Koalas DataFrame easil

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648796059 ## File path: python/docs/source/user_guide/pandas_on_spark/transform_apply.rst ## @@ -34,7 +34,7 @@ to return the same length of the input and the la

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648796016 ## File path: python/docs/source/user_guide/pandas_on_spark/transform_apply.rst ## @@ -6,7 +6,7 @@ Transform and apply a function .. currentmodule:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795759 ## File path: python/docs/source/user_guide/pandas_on_spark/pandas_pyspark.rst ## @@ -5,16 +5,16 @@ From/to pandas and PySpark DataFrames .. currentm

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795702 ## File path: python/docs/source/user_guide/pandas_on_spark/pandas_pyspark.rst ## @@ -5,16 +5,16 @@ From/to pandas and PySpark DataFrames .. currentm

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795639 ## File path: python/docs/source/user_guide/pandas_on_spark/options.rst ## @@ -227,24 +227,24 @@ This is conceptually equivalent to the PySpark exampl

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795252 ## File path: python/docs/source/user_guide/pandas_on_spark/options.rst ## @@ -227,24 +227,24 @@ This is conceptually equivalent to the PySpark exampl

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648795144 ## File path: python/docs/source/user_guide/pandas_on_spark/options.rst ## @@ -227,24 +227,24 @@ This is conceptually equivalent to the PySpark exampl

[GitHub] [spark] SparkQA removed a comment on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858210827 **[Test build #139603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139603/testReport)** for PR 32847 at commit [`bb57429`](https://gi

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794891 ## File path: python/docs/source/user_guide/pandas_on_spark/options.rst ## @@ -3,7 +3,7 @@ Options and settings .. currentmodul

[GitHub] [spark] SparkQA commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858219611 **[Test build #139603 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139603/testReport)** for PR 32847 at commit [`bb57429`](https://github.co

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794764 ## File path: python/docs/source/user_guide/pandas_on_spark/from_to_dbms.rst ## @@ -30,7 +30,7 @@ Reading and writing DataFrames In the example bel

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794551 ## File path: python/docs/source/user_guide/pandas_on_spark/from_to_dbms.rst ## @@ -18,7 +18,7 @@ The APIs to read/write from/to external DBMSes are a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794345 ## File path: python/docs/source/user_guide/pandas_on_spark/from_to_dbms.rst ## @@ -18,7 +18,7 @@ The APIs to read/write from/to external DBMSes are a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794247 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -291,8 +291,8 @@ Therefore, it works seamlessly in pandas as belo

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794163 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -254,9 +254,9 @@ In case of pandas, it works properly out of the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794071 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -227,19 +227,19 @@ See `Default Index Type `_ for more details a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648794040 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -227,19 +227,19 @@ See `Default Index Type `_ for more details a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793950 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -227,19 +227,19 @@ See `Default Index Type `_ for more details a

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793895 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -214,8 +214,8 @@ See `working with PySpark `_ Use ``distributed

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793791 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -214,8 +214,8 @@ See `working with PySpark `_ Use ``distributed

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793680 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -201,11 +201,11 @@ However, you can turn on ``spark.sql.caseSensi

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793340 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -5,23 +5,23 @@ Best Practices Leverage PySpark APIs ---

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793282 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -5,23 +5,23 @@ Best Practices Leverage PySpark APIs ---

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648793204 ## File path: python/docs/source/user_guide/pandas_on_spark/best_practices.rst ## @@ -5,23 +5,23 @@ Best Practices Leverage PySpark APIs ---

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648792946 ## File path: python/docs/source/getting_started/ps_install.rst ## @@ -47,20 +47,20 @@ To put your self inside this environment run:: conda act

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648792682 ## File path: python/docs/source/getting_started/ps_install.rst ## @@ -2,9 +2,9 @@ Installation -Koalas requires PySpark so please ma

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648792440 ## File path: python/docs/source/getting_started/ps_10mins.ipynb ## @@ -530,8 +530,8 @@ "cell_type": "markdown", "metadata": {}, "source":

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648792171 ## File path: python/docs/source/getting_started/ps_10mins.ipynb ## @@ -4,11 +4,11 @@ "cell_type": "markdown", "metadata": {}, "source": [

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648792024 ## File path: python/docs/source/development/ps_design.rst ## @@ -46,40 +46,40 @@ At the risk of overgeneralization, there are two API design approac

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648791956 ## File path: python/docs/source/development/ps_design.rst ## @@ -46,40 +46,40 @@ At the risk of overgeneralization, there are two API design approac

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858216107 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44129/

[GitHub] [spark] AmplabJenkins commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858216107 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44129/ -- T

[GitHub] [spark] SparkQA commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858216087 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44129/ -- This is an automated message from the A

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648791470 ## File path: python/docs/source/development/ps_design.rst ## @@ -4,40 +4,40 @@ Design Principles .. currentmodule:: pyspark.pandas -This section

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858215760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44126/

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648791327 ## File path: python/docs/source/development/ps_design.rst ## @@ -4,40 +4,40 @@ Design Principles .. currentmodule:: pyspark.pandas -This section

[GitHub] [spark] AmplabJenkins commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858215760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44126/ -- T

[GitHub] [spark] SparkQA commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858215740 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44126/ -- This is an automated message from the A

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648791229 ## File path: python/docs/source/development/ps_design.rst ## @@ -4,40 +4,40 @@ Design Principles .. currentmodule:: pyspark.pandas -This section

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648790385 ## File path: python/docs/source/development/ps_contributing.rst ## @@ -131,21 +131,21 @@ We follow `PEP 8

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648790216 ## File path: python/docs/source/development/ps_contributing.rst ## @@ -131,21 +131,21 @@ We follow `PEP 8

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32835: [SPARK-35591][PYTHON][DOCS] Rename "Koalas" to "pandas API on Spark" in the documents

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32835: URL: https://github.com/apache/spark/pull/32835#discussion_r648789664 ## File path: python/docs/source/development/ps_contributing.rst ## @@ -79,7 +79,7 @@ With Python 3.6+, pip can be used as below to install and set u

[GitHub] [spark] HyukjinKwon closed pull request #32844: [MINOR][SQL] Modify the example of rand and randn.

2021-06-09 Thread GitBox
HyukjinKwon closed pull request #32844: URL: https://github.com/apache/spark/pull/32844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[GitHub] [spark] HyukjinKwon commented on pull request #32844: [MINOR][SQL] Modify the example of rand and randn.

2021-06-09 Thread GitBox
HyukjinKwon commented on pull request #32844: URL: https://github.com/apache/spark/pull/32844#issuecomment-858213580 Merged to master, brnach-3.1 and branch-3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] HyukjinKwon closed pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
HyukjinKwon closed pull request #32851: URL: https://github.com/apache/spark/pull/32851 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, pl

[GitHub] [spark] HyukjinKwon commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
HyukjinKwon commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858213265 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32410: [SPARK-35286][SQL] Replace SessionState.start with SessionState.setCurrentSessionState

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32410: URL: https://github.com/apache/spark/pull/32410#discussion_r648787117 ## File path: sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java ## @@ -141,7 +141,8 @@ public void open(Ma

[GitHub] [spark] SparkQA commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858210827 **[Test build #139603 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139603/testReport)** for PR 32847 at commit [`bb57429`](https://github.com

[GitHub] [spark] HyukjinKwon commented on a change in pull request #32410: [SPARK-35286][SQL] Replace SessionState.start with SessionState.setCurrentSessionState

2021-06-09 Thread GitBox
HyukjinKwon commented on a change in pull request #32410: URL: https://github.com/apache/spark/pull/32410#discussion_r648786800 ## File path: sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java ## @@ -141,7 +141,8 @@ public void open(Ma

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858210414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139597/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-858210416 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139594/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858210415 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139602/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858210414 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139597/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858210415 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139602/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-858210416 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139594/ -- This

[GitHub] [spark] dgd-contributor commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
dgd-contributor commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648786227 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -385,9 +385,16 @@ object DateTimeUtils {

[GitHub] [spark] xinrong-databricks commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
xinrong-databricks commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858208737 CC @ueshin @HyukjinKwon @itholic -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [spark] sarutak commented on pull request #32845: [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile

2021-06-09 Thread GitBox
sarutak commented on pull request #32845: URL: https://github.com/apache/spark/pull/32845#issuecomment-858207190 LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] SparkQA commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858204750 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44129/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858143888 **[Test build #139597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139597/testReport)** for PR 32847 at commit [`a245edf`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858201402 **[Test build #139597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139597/testReport)** for PR 32847 at commit [`a245edf`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858191472 **[Test build #139602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139602/testReport)** for PR 32738 at commit [`3a79d06`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858199814 **[Test build #139602 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139602/testReport)** for PR 32738 at commit [`3a79d06`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-858079391 **[Test build #139594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139594/testReport)** for PR 32049 at commit [`4fbe666`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-06-09 Thread GitBox
SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-858197045 **[Test build #139594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139594/testReport)** for PR 32049 at commit [`4fbe666`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-858195736 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44127/

[GitHub] [spark] AmplabJenkins commented on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-858195736 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44127/ -- T

[GitHub] [spark] SparkQA commented on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-06-09 Thread GitBox
SparkQA commented on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-858195723 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44127/ -- This is an automated message from the A

[GitHub] [spark] xuanyuanking commented on pull request #32767: [SPARK-35628][SS] RocksDBFileManager - load checkpoint from DFS

2021-06-09 Thread GitBox
xuanyuanking commented on pull request #32767: URL: https://github.com/apache/spark/pull/32767#issuecomment-858191734 @viirya Great thanks for your help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [spark] SparkQA commented on pull request #32738: [SPARK-35474] Enable disallow_untyped_defs mypy check for pyspark.pandas.indexing.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32738: URL: https://github.com/apache/spark/pull/32738#issuecomment-858191472 **[Test build #139602 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139602/testReport)** for PR 32738 at commit [`3a79d06`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-858189868 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44128/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32850: [SPARK-34920] Add error classes with SQLSTATE

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32850: URL: https://github.com/apache/spark/pull/32850#issuecomment-858189870 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139596/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858189869 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139599/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32850: [SPARK-34920] Add error classes with SQLSTATE

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32850: URL: https://github.com/apache/spark/pull/32850#issuecomment-858189870 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139596/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858189869 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139599/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-858189868 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44128/ -- T

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

2021-06-09 Thread GitBox
SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-858184907 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44128/ -- This

[GitHub] [spark] SparkQA commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858184264 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44126/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31024: [SPARK-33979][SQL] Reorder predicate

2021-06-09 Thread GitBox
SparkQA commented on pull request #31024: URL: https://github.com/apache/spark/pull/31024#issuecomment-858183750 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44127/ -- This is an automated message from the Apache

[GitHub] [spark] github-actions[bot] closed pull request #31505: [SPARK-34174][SQL] Add 'SHOW PARTITIONS' as table-valued function

2021-06-09 Thread GitBox
github-actions[bot] closed pull request #31505: URL: https://github.com/apache/spark/pull/31505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this ser

[GitHub] [spark] github-actions[bot] closed pull request #31506: [SPARK-34171][SQL] Add 'SHOW COLUMNS' as table-valued function

2021-06-09 Thread GitBox
github-actions[bot] closed pull request #31506: URL: https://github.com/apache/spark/pull/31506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this ser

[GitHub] [spark] SparkQA removed a comment on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858166975 **[Test build #139599 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139599/testReport)** for PR 32851 at commit [`43b30bd`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32851: [SPARK-35705][PYTHON] Adjust pandas-on-spark `test_groupby_multiindex_columns` test for different pandas versions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32851: URL: https://github.com/apache/spark/pull/32851#issuecomment-858178032 **[Test build #139599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139599/testReport)** for PR 32851 at commit [`43b30bd`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32850: [SPARK-34920] Add error classes with SQLSTATE

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32850: URL: https://github.com/apache/spark/pull/32850#issuecomment-858115489 **[Test build #139596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139596/testReport)** for PR 32850 at commit [`92e275f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32850: [SPARK-34920] Add error classes with SQLSTATE

2021-06-09 Thread GitBox
SparkQA commented on pull request #32850: URL: https://github.com/apache/spark/pull/32850#issuecomment-858172392 **[Test build #139596 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139596/testReport)** for PR 32850 at commit [`92e275f`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858171993 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44124/

[GitHub] [spark] AmplabJenkins commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858171993 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44124/ -- T

[GitHub] [spark] SparkQA commented on pull request #32847: [WIP] [SPARK-35616][PYTHON] Make astype data-type-based

2021-06-09 Thread GitBox
SparkQA commented on pull request #32847: URL: https://github.com/apache/spark/pull/32847#issuecomment-858171974 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44124/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32848: [SPARK-35194][SQL][FOLLOWUP] Change Seq to collections.Seq in NestedColumnAliasing to pass relevant tests with Scala 2.13

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32848: URL: https://github.com/apache/spark/pull/32848#issuecomment-858169139 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139589/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32848: [SPARK-35194][SQL][FOLLOWUP] Change Seq to collections.Seq in NestedColumnAliasing to pass relevant tests with Scala 2.13

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32848: URL: https://github.com/apache/spark/pull/32848#issuecomment-858169139 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139589/ -- This

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

2021-06-09 Thread GitBox
SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-858168705 **[Test build #139601 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139601/testReport)** for PR 32787 at commit [`1704a9a`](https://github.com

<    1   2   3   4   5   6   7   8   9   10   >