I assume by non-trivial you meant the extra Seekable stuff I needed to
wrap around the DFS output streams to let Avro take it as append-able?
I don't think its possible for Avro to carry it since Avro (core) does
not reverse-depend on Hadoop. Should we document it somewhere though?
Do you have any
I confess to being a user of rather than a developer of open source, but
perhaps you could elaborate on what depends on means and what the
consequences are?
Isn't it -- or couldn't it be made -- a run-time binding, so that only those
who try to use the HDFS append functionality would be
The avro-mapred module includes a Seekable implementation that works
with HDFS called FsInput:
http://avro.apache.org/docs/current/api/java/org/apache/avro/mapred/FsInput.html
With this, your example can be made considerably smaller.
Doug
On Thu, Feb 7, 2013 at 8:28 AM, Harsh J
