[
https://issues.apache.org/jira/browse/SPARK-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu resolved SPARK-14972.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 12750
[https://github.com/apache/spark/pull/12750]
> Improve performance of JSON schema inference's inferField step
> --------------------------------------------------------------
>
> Key: SPARK-14972
> URL: https://issues.apache.org/jira/browse/SPARK-14972
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Fix For: 2.0.0
>
>
> JSON schema inference spends a lot of time in inferField and there are a
> number of techniques to speed it up, including eliminating unnecessary
> sorting and the use of inefficient collections.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
