Hi Torsten, The existing hadoop-lzo project doesn't use the C code in indexing, though I think you're right that the classes will fail to initialize if the native libraries aren't available. Could I encourage you to simply post a patch that fixes this rather than forking a new project?
This code is tricky and we've finally gotten it right (fingers crossed) - I don't see the sense in having two projects that do the same thing when this basically amounts to a bug fix. -Todd On Tue, Aug 31, 2010 at 7:37 AM, Torsten Curdt <tcu...@apache.org> wrote: > For those people using LZO compression: > > While I know there is > > http://github.com/kevinweil/hadoop-lzo > > The native stuff makes it a bit of a hurdle. Especially if you are > just running on Amazon Elastic Map Reduce it's way easier to just run > this java-only indexer instead. > > http://github.com/tcurdt/lzo-index > > It's not much tested yet and I am sure it will still need some work > ...but I thought I just announce it and maybe get some more testers > and maybe some feedback. > > cheers > -- > Torsten > -- Todd Lipcon Software Engineer, Cloudera