Re: Tricks to upgrading Sequence Files?

2013-01-30 Thread Terry Healy
process would be better. I'll add the request to JIRA at a minimum. Dave -Original Message- From: Harsh J [mailto:ha...@cloudera.com] Sent: Wednesday, January 30, 2013 2:32 AM To: user@hadoop.apache.org Subject: Re: Tricks to upgrading Sequence Files? This is a pretty

Re: Tricks to upgrading Sequence Files?

2013-01-29 Thread Harsh J
This is a pretty interesting question, but unfortunately there isn't an inbuilt way in SequenceFiles itself to handle this. However, your key/value classes can be made to handle versioning perhaps - detecting if what they've read is of an older time and decoding it appropriately (while handling

RE: Tricks to upgrading Sequence Files?

2013-01-29 Thread David Parks
, January 30, 2013 2:32 AM To: user@hadoop.apache.org Subject: Re: Tricks to upgrading Sequence Files? This is a pretty interesting question, but unfortunately there isn't an inbuilt way in SequenceFiles itself to handle this. However, your key/value classes can be made to handle versioning perhaps

Tricks to upgrading Sequence Files?

2013-01-28 Thread David Parks
Anyone have any good tricks for upgrading a sequence file. We maintain a sequence file like a flat file DB and the primary object in there changed in recent development. It's trivial to write a job to read in the sequence file, update the object, and write it back out in the new format.