EdisonWang created SPARK-26544:
----------------------------------

             Summary: the string serialized from map/array type is not a valid 
json (while hive is)
                 Key: SPARK-26544
                 URL: https://issues.apache.org/jira/browse/SPARK-26544
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: EdisonWang


when reading a hive table with map/array type, the string serialized by thrift 
server is not a valid json, while hive is. 

For example, select a field whose type is map<string, string>, the spark thrift 
server returns 

 
{code:java}
{"author_id":"123","log_pb":"{"impr_id":"20181231"}","request_id":"001"}
{code}
 

while hive thriftserver returns

 
{code:java}
{"author_id":"123", "log_pb":"{\"impr_id\":\"20181231\"}","request_id":"001"}
{code}
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to