Agree, we use Thrift at Rapleaf for this purpose. It's trivial to make a ThriftWritable if you want to be crafty, but you can also just use byte[]s and do the serialization and deserialization yourself.

-Bryan

On Nov 1, 2008, at 8:01 PM, Alex Loddengaard wrote:

Take a look at Thrift:
<http://developers.facebook.com/thrift/>

Alex

On Sat, Nov 1, 2008 at 7:15 PM, Zhou, Yunqing <[EMAIL PROTECTED]> wrote:

The project I focused on has many modules written in different languages
(several modules are hadoop jobs).
So I'd like to utilize a common record based data file format for data
exchange.
XML is not efficient for appending new records.
SequenceFile seems not having API of other languages except Java.
Protocol Buffers' hadoop API seems under development.
any recommendation for this?

Thanks


Reply via email to