Hyukjin Kwon created SPARK-19918: ------------------------------------ Summary: Use TextFileFormat in implementation of JsonFileFormat Key: SPARK-19918 URL: https://issues.apache.org/jira/browse/SPARK-19918 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.2.0 Reporter: Hyukjin Kwon
If we use Dataset for initial loading when inferring the schema, there are advantages. Please refer SPARK-18362 It seems JSON one was supposed to be fixed together but missed according to https://github.com/apache/spark/pull/15813 {quote} A similar problem also affects the JSON file format and this patch originally fixed that as well, but I've decided to split that change into a separate patch so as not to conflict with changes in another JSON PR. {quote} Also, this affects some functionalities because it does not use {{FileScanRDD}}. This problem is described in SPARK-19885 (but it was CSV's case). -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org