[ https://issues.apache.org/jira/browse/SPARK-41838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676067#comment-17676067 ]
Apache Spark commented on SPARK-41838: -------------------------------------- User 'zhengruifeng' has created a pull request for this issue: https://github.com/apache/spark/pull/39535 > DataFrame.show() fix map printing > --------------------------------- > > Key: SPARK-41838 > URL: https://issues.apache.org/jira/browse/SPARK-41838 > Project: Spark > Issue Type: Sub-task > Components: Connect > Affects Versions: 3.4.0 > Reporter: Sandeep Singh > Priority: Major > > {code:java} > File > "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", > line 1472, in pyspark.sql.connect.functions.posexplode_outer > Failed example: > df.select("id", "a_map", posexplode_outer("an_array")).show() > Expected: > +---+----------+----+----+ > | id| a_map| pos| col| > +---+----------+----+----+ > | 1|{x -> 1.0}| 0| foo| > | 1|{x -> 1.0}| 1| bar| > | 2| {}|null|null| > | 3| null|null|null| > +---+----------+----+----+ > Got: > +---+------+----+----+ > | id| a_map| pos| col| > +---+------+----+----+ > | 1| {1.0}| 0| foo| > | 1| {1.0}| 1| bar| > | 2|{null}|null|null| > | 3| null|null|null| > +---+------+----+----+ > <BLANKLINE>{code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org