Maxim Gekk created SPARK-24959: ---------------------------------- Summary: Do not invoke the CSV/JSON parser for empty schema Key: SPARK-24959 URL: https://issues.apache.org/jira/browse/SPARK-24959 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.3.1 Reporter: Maxim Gekk
Currently JSON and CSV parsers are called even if required schema is empty. Invoking the parser per each line has some non-zero overhead. The action can be skipped. Such optimization should speed up count(), for example. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org