[jira] [Commented] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding

2021-11-15 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444117#comment-17444117 ] Chuck Connell commented on SPARK-37181: --- That would be a good solution, just convert latin-1

[jira] [Comment Edited] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files

2021-11-04 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438789#comment-17438789 ] Chuck Connell edited comment on SPARK-37198 at 11/4/21, 3:42 PM: - There

[jira] [Commented] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files

2021-11-04 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17438789#comment-17438789 ] Chuck Connell commented on SPARK-37198: --- There are many hints/techtips on the Internet which say

[jira] [Updated] (SPARK-37197) PySpark pandas recent issues from chconnell

2021-11-02 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37197: -- Description: SPARK-37180  PySpark.pandas should support __version__ SPARK-37181  

[jira] [Created] (SPARK-37198) pyspark.pandas read_csv() and to_csv() should handle local files

2021-11-02 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37198: - Summary: pyspark.pandas read_csv() and to_csv() should handle local files Key: SPARK-37198 URL: https://issues.apache.org/jira/browse/SPARK-37198 Project: Spark

[jira] [Comment Edited] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it

2021-11-02 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437329#comment-17437329 ] Chuck Connell edited comment on SPARK-37189 at 11/2/21, 1:18 PM: - Ok,

[jira] [Created] (SPARK-37197) PySpark pandas recent issues from chconnell

2021-11-02 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37197: - Summary: PySpark pandas recent issues from chconnell Key: SPARK-37197 URL: https://issues.apache.org/jira/browse/SPARK-37197 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it

2021-11-02 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437329#comment-17437329 ] Chuck Connell commented on SPARK-37189: --- Ok, will do. FYI, getting covid shot today, so I may be

[jira] [Updated] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37189: -- Description: In pyspark.pandas if you write a line like this {quote}DF.plot.hist(bins=30,

[jira] [Created] (SPARK-37189) CLONE - pyspark.pandas histogram accepts the title option but does not add a title to the plot

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37189: - Summary: CLONE - pyspark.pandas histogram accepts the title option but does not add a title to the plot Key: SPARK-37189 URL: https://issues.apache.org/jira/browse/SPARK-37189

[jira] [Updated] (SPARK-37189) pyspark.pandas histogram accepts the range option but does not use it

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37189: -- Summary: pyspark.pandas histogram accepts the range option but does not use it (was: CLONE -

[jira] [Created] (SPARK-37188) pyspark.pandas histogram accepts the title option but does not add a title to the plot

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37188: - Summary: pyspark.pandas histogram accepts the title option but does not add a title to the plot Key: SPARK-37188 URL: https://issues.apache.org/jira/browse/SPARK-37188

[jira] [Created] (SPARK-37187) pyspark.pandas fails to create a histogram of one column from a large DataFrame

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37187: - Summary: pyspark.pandas fails to create a histogram of one column from a large DataFrame Key: SPARK-37187 URL: https://issues.apache.org/jira/browse/SPARK-37187

[jira] [Created] (SPARK-37186) pyspark.pandas should support tseries.offsets

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37186: - Summary: pyspark.pandas should support tseries.offsets Key: SPARK-37186 URL: https://issues.apache.org/jira/browse/SPARK-37186 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37182: -- Comment: was deleted (was: https://issues.apache.org/jira/browse/SPARK-36609) >

[jira] [Resolved] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell resolved SPARK-37182. --- Resolution: Duplicate https://issues.apache.org/jira/browse/SPARK-36609 >

[jira] [Commented] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436992#comment-17436992 ] Chuck Connell commented on SPARK-37182: --- Duplicate of 

[jira] [Created] (SPARK-37184) pyspark.pandas should support DF["column"].str.split("some_suffix").str[0]

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37184: - Summary: pyspark.pandas should support DF["column"].str.split("some_suffix").str[0] Key: SPARK-37184 URL: https://issues.apache.org/jira/browse/SPARK-37184

[jira] [Created] (SPARK-37183) pyspark.pandas.DataFrame.map() should support .fillna()

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37183: - Summary: pyspark.pandas.DataFrame.map() should support .fillna() Key: SPARK-37183 URL: https://issues.apache.org/jira/browse/SPARK-37183 Project: Spark

[jira] [Created] (SPARK-37182) pyspark.pandas.to_numeric() should support the errors option

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37182: - Summary: pyspark.pandas.to_numeric() should support the errors option Key: SPARK-37182 URL: https://issues.apache.org/jira/browse/SPARK-37182 Project: Spark

[jira] [Created] (SPARK-37181) pyspark.pandas.read_csv() should support latin-1 encoding

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37181: - Summary: pyspark.pandas.read_csv() should support latin-1 encoding Key: SPARK-37181 URL: https://issues.apache.org/jira/browse/SPARK-37181 Project: Spark

[jira] [Updated] (SPARK-37180) PySpark.pandas should support __version__

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37180: -- Description: In regular pandas you can say {quote}pd.___version___  {quote} to get the pandas

[jira] [Updated] (SPARK-37180) PySpark.pandas should support __version__

2021-11-01 Thread Chuck Connell (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuck Connell updated SPARK-37180: -- Description: In regular pandas you can say {quote}{{pd.__version__ }}{quote} to get the

[jira] [Created] (SPARK-37180) PySpark.pandas should support __version__

2021-11-01 Thread Chuck Connell (Jira)
Chuck Connell created SPARK-37180: - Summary: PySpark.pandas should support __version__ Key: SPARK-37180 URL: https://issues.apache.org/jira/browse/SPARK-37180 Project: Spark Issue Type: