[ https://issues.apache.org/jira/browse/AVRO-380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806026#action_12806026 ]
Philip Zeyliger commented on AVRO-380: -------------------------------------- Meant to add: overall approach looks good. > Avro Container File format change: add block size to block descriptor > ---------------------------------------------------------------------- > > Key: AVRO-380 > URL: https://issues.apache.org/jira/browse/AVRO-380 > Project: Avro > Issue Type: Improvement > Components: doc, java, spec > Affects Versions: 1.3.0 > Reporter: Scott Carey > Fix For: 1.3.0 > > Attachments: AVRO-380.patch > > > The new file format in AVRO-160 limits a few use cases that I have found to > be important. > A block currently contains a count of the number of records, the block data, > and a sync marker. > This change would add the block size, in bytes, along side the number of > records. > This allows efficient access to a block's data without the need to decode the > data into individual Datums, which is useful for various use cases. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.