[ https://issues.apache.org/jira/browse/MAPREDUCE-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12999728#comment-12999728 ]
Harsh J Chouraria commented on MAPREDUCE-1360: ---------------------------------------------- This sounded interesting for me to work upon. So here's some questions after a brief investigation: I investigated what goes on inside of the SkippingRecordReader but couldn't find any area that gets Writable limited. The sequence files for skipped records are created with the Key/Value classes which are then used to load their acceptable serialization classes. Which part of the skipping framework is Writable limited now? > Record skipping should work with more serializations > ---------------------------------------------------- > > Key: MAPREDUCE-1360 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1360 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Reporter: Aaron Kimball > > Record skipping currently supports WritableSerialization, but cannot handle > non-class-based serialization systems (e.g., AvroSerialization). The record > skipping mechanism should be made compatible with the metadata-based > serialization configuration. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira