[ https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976921#comment-16976921 ]
YoungGyu Chun edited comment on SPARK-29946 at 11/18/19 9:56 PM: ----------------------------------------------------------------- Hi [~viirya] I am trying to sort out this issue. What I found so far is that the mapType is human-readable by calling toString but the UnsafeRow doesn't. I want to make sure what I found is correct: !image-2019-11-18-16-54-46-341.png! was (Author: younggyuchun): Hi [~viirya] I am trying to sort out this issue. What I found so far is that the mapType is human-readable by calling toString but the UnsafeRow doesn't. I want to make sure what I found is correct: !image-2019-11-18-16-54-46-341.png! > Special serialization for certain key types of Map type in JacksonGenerator > --------------------------------------------------------------------------- > > Key: SPARK-29946 > URL: https://issues.apache.org/jira/browse/SPARK-29946 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.0.0 > Reporter: L. C. Hsieh > Priority: Major > Attachments: image-2019-11-18-16-54-46-341.png > > > Currently JacksonGenerator serializes MapType to JSON, the key of map is > serialized by calling toString() of the key. For some types, like UnsafeRow, > the toString is not human readable. So currently the map key in JSON is not > very useful for some types. > We should do special serialization for certain key types of Map. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org