[ https://issues.apache.org/jira/browse/SPARK-39568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17558070#comment-17558070 ]
Gokul Yalavarti commented on SPARK-39568: ----------------------------------------- Used sample data to explain issue, Please provide if there is any better solution. I need to insert values in database with None as Null and all columns should be string for my use case. > when using df.astype("str") on pyspark dataframe. None are converted "None" > --------------------------------------------------------------------------- > > Key: SPARK-39568 > URL: https://issues.apache.org/jira/browse/SPARK-39568 > Project: Spark > Issue Type: Improvement > Components: Pandas API on Spark > Affects Versions: 3.3.0 > Environment: Tried on azure databricks. > Reporter: Gokul Yalavarti > Priority: Major > Attachments: chrome_M3JLsVzzb2.png, > image-2022-06-23-18-33-42-324.png, loan200 - Copy.csv > > > when using df.astype("str") on pyspark dataframe. None are converted "None". > > - Not able to keep Null values as None. instead it is converted to string > "None" for whole column. -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org