[
https://issues.apache.org/jira/browse/AVRO-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Scott Carey updated AVRO-414:
-----------------------------
Attachment: AVRO-414.patch
This patch depends on AVRO-392 and will apply after either of the last two
patches there (with or without DirectBinaryDecoder).
This includes an "appendAllFrom(DataFileStream)" method on DataFileWriter.
This uses a new package protected block-based file iterator in DataFileStream,
which has been changed to use this for regular iteration as well. The Codec
API has been simplified as a result -- inputs and outputs to encoding are
ByteBuffers.
A new test class tests concatenation with various codec combinations.
> Binary File concatenate and block-based apppend / compress / uncompress
> -----------------------------------------------------------------------
>
> Key: AVRO-414
> URL: https://issues.apache.org/jira/browse/AVRO-414
> Project: Avro
> Issue Type: New Feature
> Components: java
> Reporter: Scott Carey
> Assignee: Scott Carey
> Attachments: AVRO-414.patch
>
>
> The block based format of the binary file allows for block-based operations
> that do not decode or encode data.
> Two such use cases are:
> * Change the compression codec or compression level of a file without
> decoding.
> * Concatenate two files with identical schemas together quickly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
