[ https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449239#comment-13449239 ]
Doug Cutting commented on AVRO-806: ----------------------------------- Raymie, putting the code in Avro's lang/java directory does not in fact create any tight coupling. Trevni's core module still does not depend on anything in Avro. Avro releases will contain a trevni-core.jar file that depends on nothing else in Avro. That said, you earlier complained (above) that Trevni's core implementation doesn't share enough with Avro. Placing these in a common project would permit such sharing if it was desired. For example, as you indicated, they might share an optimized library for serialization and deserialization of scalar values. The patch I've attached makes no changes to Trevni code, only to build files so that Trevni's source code can be placed in Avro's lang/java tree. Committing this patch says just two things: # The Avro PMC will maintain the Trevni code (for now); and # Avro and Trevni will be released together (for now); It does not say anything about other couplings or dependencies between the Avro and Trevni implementations or specifications. That's all for future discussion. > add a column-major codec for data files > --------------------------------------- > > Key: AVRO-806 > URL: https://issues.apache.org/jira/browse/AVRO-806 > Project: Avro > Issue Type: New Feature > Components: java, spec > Reporter: Doug Cutting > Assignee: Doug Cutting > Attachments: AVRO-806.patch, AVRO-806.patch, AVRO-806-v2.patch, > avro-file-columnar.pdf > > > Define a codec that, when a data file's schema is a record schema, writes > blocks within the file in column-major order. This would permit better > compression and also permit efficient skipping of fields that are not of > interest. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira