Re: Generic data extraction from an Avro file

2013-02-05 Thread Public Network Services
Thanks for the clarification. Is there any way to use JsonEncoder in the scenario I mentioned, i.e. in totally schema-agnostic data extraction from either binary or JSON files? On Tue, Feb 5, 2013 at 2:58 PM, Doug Cutting cutt...@apache.org wrote: Yes, GenericData.Record#toString() should

Re: Is it possible to append to an already existing avro file

2013-02-05 Thread Doug Cutting
It will work on an OutputStream that supports append. http://avro.apache.org/docs/current/api/java/org/apache/avro/file/DataFileWriter.html#appendTo(org.apache.avro.file.SeekableInput, java.io.OutputStream) So it depends on how well HDFS implements FileSystem#append(), not on any changes in

Re: Is it possible to append to an already existing avro file

2013-02-05 Thread Michael Malak
I don't believe a Hadoop FileSystem is a Java OutputStream? --- On Tue, 2/5/13, Doug Cutting cutt...@apache.org wrote: From: Doug Cutting cutt...@apache.org Subject: Re: Is it possible to append to an already existing avro file To: user@avro.apache.org Date: Tuesday, February 5, 2013, 5:27