to locate the file on hdfs? Could you
please share some pointers what could be leading to this?
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/Is-it-possible-to-append-to-an-already-existing-avro-file-tp3762049p4027785.html
Sent from the Avro - Users mailing list
Thanks for replying. You are correct. I followed this example
https://gist.github.com/QwertyManiac/4724582
--
View this message in context:
http://apache-avro.679487.n3.nabble.com/Is-it-possible-to-append-to-an-already-existing-avro-file-tp3762049p4027789.html
Sent from the Avro - Users
that someone will come
up with an interface that requires just one line of user code to achieve
append.
--- On Wed, 2/6/13, Harsh J ha...@cloudera.com wrote:
From: Harsh J ha...@cloudera.com
Subject: Re: Is it possible to append to an already existing avro file
To: user@avro.apache.org
Date
wrote:
From: Harsh J ha...@cloudera.com
Subject: Re: Is it possible to append to an already existing avro file
To: user@avro.apache.org
Date: Thursday, February 7, 2013, 9:28 AM
I assume by non-trivial you meant the
extra Seekable stuff I needed to
wrap around the DFS output streams to let Avro
, in the hopes that someone will
come up with an interface that requires just one line of user code to
achieve append.
--- On Wed, 2/6/13, Harsh J ha...@cloudera.com wrote:
From: Harsh J ha...@cloudera.com
Subject: Re: Is it possible to append to an already existing avro file
To: user
/13, Harsh J ha...@cloudera.com wrote:
From: Harsh J ha...@cloudera.com
Subject: Re: Is it possible to append to an already existing avro file
To: user@avro.apache.org
Date: Wednesday, February 6, 2013, 11:17 AM
Hey Michael,
It does implement the regular Java OutputStream interface,
as seen
is that will append to a file on the local filesystem, but
not to a file on HDFS.
--- On Tue, 2/5/13, Doug Cutting cutt...@apache.org wrote:
From: Doug Cutting cutt...@apache.org
Subject: Re: Is it possible to append to an already existing avro file
To: user@avro.apache.org
Date: Tuesday
I don't believe a Hadoop FileSystem is a Java OutputStream?
--- On Tue, 2/5/13, Doug Cutting cutt...@apache.org wrote:
From: Doug Cutting cutt...@apache.org
Subject: Re: Is it possible to append to an already existing avro file
To: user@avro.apache.org
Date: Tuesday, February 5, 2013, 5:27
Hi,
is it possible to append to an already existing avro file when it was written
and closed before?
If I use
outputStream = fs.append(avroFilePath);
then later on I get: java.io.IOException: Invalid sync!
Probably because the schema is written twice and some other issues.
If I use
