[jira] [Updated] (SPARK-38109) pyspark DataFrame.replace() is sensitive to column name case in pyspark 3.2 but not in 3.1

2022-02-04 Thread ss (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ss updated SPARK-38109: --- Description: The `subset` argument for `DataFrame.replace()` accepts one or more column names. In pyspark 3.2 the c

[jira] [Updated] (SPARK-38109) pyspark DataFrame.replace() is sensitive to column name case in pyspark 3.2 but not in 3.1

2022-02-04 Thread ss (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ss updated SPARK-38109: --- Description: The `subset` argument for `DataFrame.replace()` accepts one or more column names. In pyspark 3.2 the c

[jira] [Created] (SPARK-38109) pyspark DataFrame.replace() is sensitive to column name case in pyspark 3.2 but not in 3.1

2022-02-04 Thread ss (Jira)
ss created SPARK-38109: -- Summary: pyspark DataFrame.replace() is sensitive to column name case in pyspark 3.2 but not in 3.1 Key: SPARK-38109 URL: https://issues.apache.org/jira/browse/SPARK-38109 Project: Spark

[jira] [Updated] (SPARK-38109) pyspark DataFrame.replace() is sensitive to column name case in pyspark 3.2 but not in 3.1

2022-02-04 Thread ss (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ss updated SPARK-38109: --- Description: The `subset` argument for `DataFrame.replace()` accepts one or more column names. In pyspark 3.2 the c

[jira] [Commented] (SPARK-26570) Out of memory when InMemoryFileIndex bulkListLeafFiles

2020-01-15 Thread ShivaKumar SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016200#comment-17016200 ] ShivaKumar SS commented on SPARK-26570: --- Unfortunately I have hit the same issue. 

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

2019-11-25 Thread ShivaKumar SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Labels: dataframe (was: ) > Spark partitionby saves as columnName={value} | Can it be only co

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

2019-11-25 Thread ShivaKumar SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Description: I am using scala and spark. This is using Dataframe and in dataframe i have a co

[jira] [Created] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

2019-11-25 Thread ShivaKumar SS (Jira)
ShivaKumar SS created SPARK-30023: - Summary: Spark partitionby saves as columnName={value} | Can it be only columnvalue Key: SPARK-30023 URL: https://issues.apache.org/jira/browse/SPARK-30023 Project:

[jira] [Updated] (SPARK-30023) Spark partitionby saves as columnName={value} | Can it be only columnvalue

2019-11-25 Thread ShivaKumar SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShivaKumar SS updated SPARK-30023: -- Description: I am using scala and spark. This is using Dataframe and in dataframe i have a co

[jira] [Commented] (SPARK-29214) Oracle sql's to_number equivalent in spark sql

2019-09-23 Thread Sakthi Kavin SS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936234#comment-16936234 ] Sakthi Kavin SS commented on SPARK-29214: - Yes the same issue. Eg: to_number('

[jira] [Created] (SPARK-29214) Oracle sql's to_number equivalent in spark sql

2019-09-23 Thread Sakthi Kavin SS (Jira)
Sakthi Kavin SS created SPARK-29214: --- Summary: Oracle sql's to_number equivalent in spark sql Key: SPARK-29214 URL: https://issues.apache.org/jira/browse/SPARK-29214 Project: Spark Issue Ty

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2019-07-24 Thread ShivaKumar SS (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892098#comment-16892098 ] ShivaKumar SS commented on SPARK-16548: --- Hello guys,  I am using Spark 2.3.0 and