[ https://issues.apache.org/jira/browse/SPARK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225823#comment-15225823 ]
Kashish Jain commented on SPARK-14344: -------------------------------------- Thanks for the info. I didn't have the setup for the master. Checked it over spark1.3.1 and spark-1.5.1 though. Seems to be broken on spark-1.3.1 but working in spark-1.5.1. I have done a local fix for this in spark1.2.1 and spark1.3.1. Should I open a PR for this? > saveAsParquetFile creates _metafile even when disabled > ------------------------------------------------------ > > Key: SPARK-14344 > URL: https://issues.apache.org/jira/browse/SPARK-14344 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.2.1, 1.3.1 > Reporter: Kashish Jain > Priority: Minor > Original Estimate: 168h > Remaining Estimate: 168h > > Specifying the property "spark.hadoop.parquet.enable.summary-metadata false" > in spark.property does not prevent the creation of _metadata file in case of > rdd.saveAsParquetFile("TableName") -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org