Re: Enable Snappy compression - not able to load the libs on startup

2012-07-11 Thread Asaf Mesika
start-hbase is wrapper script on of hbase-daemon, which is on top of hbase. HBase itself takes, in some cases (as shown below), environment variables from hadoop shel script. The first thing you need to check is what I wrote before: the value of the -Djava.library.path using "ps -ef|grep hbase".

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-10 Thread Arvid Warnecke
Hello Asaf, On Tue, Jul 10, 2012 at 02:20:03PM +0300, Asaf Mesika wrote: > On Jul 10, 2012, at 8:57 AM, Arvid Warnecke wrote: > > On Mon, Jul 09, 2012 at 09:10:12PM +0300, Asaf Mesika wrote: > >> On Jul 9, 2012, at 21:00 PM, Harsh J wrote: > >>> The hbase-daemon.sh does not ssh back into the host,

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-10 Thread Asaf Mesika
On Jul 10, 2012, at 8:57 AM, Arvid Warnecke wrote: > Hello, > > On Mon, Jul 09, 2012 at 09:10:12PM +0300, Asaf Mesika wrote: >> On Jul 9, 2012, at 21:00 PM, Harsh J wrote: >>> The hbase-daemon.sh does not ssh back into the host, so preserves any >>> environment variables you haven't otherwise se

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-09 Thread Arvid Warnecke
Hello, On Mon, Jul 09, 2012 at 09:10:12PM +0300, Asaf Mesika wrote: > On Jul 9, 2012, at 21:00 PM, Harsh J wrote: > > The hbase-daemon.sh does not ssh back into the host, so preserves any > > environment variables you haven't otherwise set in the hbase-env.sh > > file. I guess that did the trick f

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-09 Thread Asaf Mesika
Maybe you should look at the content of the jvm argument switch -Djava.library.path, (ps -ef | grep hbase , to see the command line). This will give you a hint on the directories the .so object is being looked for. On Jul 9, 2012, at 21:00 PM, Harsh J wrote: > The hbase-daemon.sh does not ssh b

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-09 Thread Harsh J
The hbase-daemon.sh does not ssh back into the host, so preserves any environment variables you haven't otherwise set in the hbase-env.sh file. I guess that did the trick for you. On Mon, Jul 9, 2012 at 11:14 PM, Arvid Warnecke wrote: > Hello Harsh, > > On Mon, Jul 09, 2012 at 07:14:56AM +0530, H

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-09 Thread Arvid Warnecke
Hello Harsh, On Mon, Jul 09, 2012 at 07:14:56AM +0530, Harsh J wrote: > Perhaps the pre-compiled set does not work against the version of libs > in your ArchLinux. We've noticed this to be the case between CentOS 5 > and 6 versions too (5 doesn't pick up the Snappy codec for some > reason). > > T

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-08 Thread Harsh J
Perhaps the pre-compiled set does not work against the version of libs in your ArchLinux. We've noticed this to be the case between CentOS 5 and 6 versions too (5 doesn't pick up the Snappy codec for some reason). Try recompiling them on the hadoop side (ant compile-native, etc.). For a loose depe

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-08 Thread Arvid Warnecke
Hello Paul, On Sun, Jul 08, 2012 at 06:45:46PM +0200, Paul Cavallaro wrote: > On Sun, Jul 8, 2012 at 9:48 AM, Arvid Warnecke wrote: > > I already found some old entries from mailinglists and articles at > > Cloudera how to use the Snappy library from Hadoop in HBase, but it does > > not seem to w

Re: Enable Snappy compression - not able to load the libs on startup

2012-07-08 Thread Paul Cavallaro
I would first ask if you've installed the native snappy libraries on the machine? http://hbase.apache.org/book/snappy.compression.html That seems to be the likely culprit here. Thanks, -Paul On Sun, Jul 8, 2012 at 9:48 AM, Arvid Warnecke wrote: > Hello, > > I already found some old entries f

Enable Snappy compression - not able to load the libs on startup

2012-07-08 Thread Arvid Warnecke
Hello, I already found some old entries from mailinglists and articles at Cloudera how to use the Snappy library from Hadoop in HBase, but it does not seem to work for me. I installed Hadoop and HBase from the tarballs, because there are no packages available for Arch Linux. Everything worked fin