[
https://issues.apache.org/jira/browse/SPARK-29946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976921#comment-16976921
]
YoungGyu Chun edited comment on SPARK-29946 at 11/18/19 9:56 PM:
-----------------------------------------------------------------
Hi [~viirya]
I am trying to sort out this issue. What I found so far is that the mapType is
human-readable by calling toString but the UnsafeRow doesn't. I want to make
sure what I found is correct:
!image-2019-11-18-16-54-46-341.png!
was (Author: younggyuchun):
Hi [~viirya]
I am trying to sort out this issue. What I found so far is that the mapType is
human-readable by calling toString but the UnsafeRow doesn't. I want to make
sure what I found is correct:
!image-2019-11-18-16-54-46-341.png!
> Special serialization for certain key types of Map type in JacksonGenerator
> ---------------------------------------------------------------------------
>
> Key: SPARK-29946
> URL: https://issues.apache.org/jira/browse/SPARK-29946
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: L. C. Hsieh
> Priority: Major
> Attachments: image-2019-11-18-16-54-46-341.png
>
>
> Currently JacksonGenerator serializes MapType to JSON, the key of map is
> serialized by calling toString() of the key. For some types, like UnsafeRow,
> the toString is not human readable. So currently the map key in JSON is not
> very useful for some types.
> We should do special serialization for certain key types of Map.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
