Re: Tricks to upgrading Sequence Files?

2013-01-30 Thread Terry Healy
and cloned it into the original name. > > All in all an hours work only, but having a cleaner process would be better. > I'll add the request to JIRA at a minimum. > > Dave > > > -Original Message- > From: Harsh J [mailto:ha...@cloudera.com] > Sent: We

RE: Tricks to upgrading Sequence Files?

2013-01-29 Thread David Parks
lto:ha...@cloudera.com] Sent: Wednesday, January 30, 2013 2:32 AM To: Subject: Re: Tricks to upgrading Sequence Files? This is a pretty interesting question, but unfortunately there isn't an inbuilt way in SequenceFiles itself to handle this. However, your key/value classes can be made to handle v

Re: Tricks to upgrading Sequence Files?

2013-01-29 Thread Harsh J
This is a pretty interesting question, but unfortunately there isn't an inbuilt way in SequenceFiles itself to handle this. However, your key/value classes can be made to handle versioning perhaps - detecting if what they've read is of an older time and decoding it appropriately (while handling new

Tricks to upgrading Sequence Files?

2013-01-28 Thread David Parks
Anyone have any good tricks for upgrading a sequence file. We maintain a sequence file like a flat file DB and the primary object in there changed in recent development. It's trivial to write a job to read in the sequence file, update the object, and write it back out in the new format.