Andrew created SPARK-20035: ------------------------------ Summary: spark-csv writes empty file if no record is in the dataset Key: SPARK-20035 URL: https://issues.apache.org/jira/browse/SPARK-20035 Project: Spark Issue Type: Bug Components: Input/Output Affects Versions: 2.0.2 Environment: Spark 2.0.2 Linux/Windows Reporter: Andrew
When there is no record in a dataset, the call to write with the spark-csv creates empty file (i.e. with no title line) ``` dataset.write().format("com.databricks.spark.csv").option("header", "true").save("... file name here ..."); ``` The same file then cannot be read by using the same format (i.e. spark-csv) since it is empty as below. The same call works if the dataset has at least one record. ``` sqlCtx.read().format("com.databricks.spark.csv").option("header", "true").option("inferSchema", "true").load("... file name here ..."); ``` This is not right, you should always be able to read the file that you wrote to. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org