Hyukjin Kwon created SPARK-16434:
------------------------------------
Summary: Avoid record-per type dispatch in JSON when reading
Key: SPARK-16434
URL: https://issues.apache.org/jira/browse/SPARK-16434
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Hyukjin Kwon
Currently, {{JacksonParser.parse}} is doing type dispatch for each row to read
appropriate values.
It might not have to be done like this because the schema of {{DataFrame}} is
already there.
So, appropriate converters can be created first according to the schema, and
then apply them to each row.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
