[ https://issues.apache.org/jira/browse/SPARK-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Naveen Pishe updated SPARK-12214: --------------------------------- Affects Version/s: 1.4.0 1.5.0 > Spark to provide an API to save user-defined metadata as part of Sequence > File header > ------------------------------------------------------------------------------------- > > Key: SPARK-12214 > URL: https://issues.apache.org/jira/browse/SPARK-12214 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Affects Versions: 1.3.0, 1.4.0, 1.5.0 > Reporter: Naveen Pishe > Labels: Sequence, header, metadata, sequencefile > > There is requirement to save "user-defined" Metadata as part of Sequence File > "Header" using Spark. > To write a User-defined metadata as part of Sequence File using regular > Hadoop API's I pass the metadata object to SequenceFile.Writer constructor > which when creates a SequenceFile ensures the metadata is part of the > sequence file header. > Currently Spark's JavaPairRDD Api provides methods to save an RDD to an > SequenceFile format, but I don't see any API which can either give the > SequenceFile.writer or a method where in I can pass the user-defined metadata > so as to be written as part of sequence file header. > The enhancement request an API to implement the same -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org