[ https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187570#comment-14187570 ]
Michael Armbrust commented on SPARK-3683: ----------------------------------------- Good find! [~jamborta] if you can give code that shows Hive does interpret this as null I'd consider adding it back for compatibility otherwise it seems like this is expected behavior. /cc [~liancheng] > PySpark Hive query generates "NULL" instead of None > --------------------------------------------------- > > Key: SPARK-3683 > URL: https://issues.apache.org/jira/browse/SPARK-3683 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Affects Versions: 1.1.0 > Reporter: Tamas Jambor > Assignee: Davies Liu > > When I run a Hive query in Spark SQL, I get the new Row object, where it does > not convert Hive NULL into Python None instead it keeps it string 'NULL'. > It's only an issue with String type, works with other types. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org