Maybe best to just not set it. Then it will default to gz which is always available.
On Fri, May 31, 2019 at 4:51 PM Jeffrey Manno <[email protected]> wrote: > Out of available ones, which do you think is best? There is zStandard and a > few others I can't recall. > > On Fri, May 31, 2019, 4:48 PM Keith Turner <[email protected]> wrote: > > > On Thu, May 30, 2019 at 5:33 PM Jeffrey Manno <[email protected]> > > wrote: > > > > > That makes sense. Do you think we should update accumulo-testing? > > Currently > > > > > > > I think that makes sense to update the defaults in accumulo-testing to > not > > use snappy. > > > > > > > 'cingest createtable' function > > > utilizes that compression method which is how the issue was > discovered. > > We > > > could just remove it to use the default or change it to a different > > > compression method. > > > > > > On Thu, May 30, 2019 at 2:31 PM Mike Miller <[email protected]> > > > wrote: > > > > > > > It is random whether the Hadoop developer who did the release built > it > > > with > > > > Snappy or whatever options. > > > > > > > > You will either have to built Hadoop yourself (have fun with that 😁) > > or > > > > use a different version. I ran into this issue when we added > > > Zstandard. I > > > > put some notes on the issue here if you want to try building Hadoop: > > > > https://github.com/apache/accumulo/issues/438 > > > > > > > > On Thu, May 30, 2019 at 2:03 PM Jeffrey Manno < > > [email protected]> > > > > wrote: > > > > > > > > > I did some more digging on this. It does appear that snappy is not > > > being > > > > > properly built while the rest of the other native libraries are. I > am > > > not > > > > > completely sure on why this is. Whether its because of installing > > > through > > > > > fluo-uno or with this version of hadoop (3.2.0). I did get past > this > > by > > > > > adding the libsnappy.so.1 file manually. > > > > > > > > > > On Tue, May 28, 2019 at 5:36 PM Jeffrey Manno < > > > [email protected]> > > > > > wrote: > > > > > > > > > > > I have ran into this issue before. I believe it has something to > do > > > > with > > > > > > the second part Christopher mentioned. > > > > > > I know installing snappy into the OS only causes more headaches. > I > > > can > > > > > > take a deeper look into it tomorrow. > > > > > > > > > > > > On Tue, May 28, 2019 at 5:31 PM Christopher <[email protected] > > > > > > wrote: > > > > > > > > > > > >> You might need to install snappy into your OS. > > > > > >> On Fedora: 'sudo dnf install snappy' > > > > > >> On RHEL/CentOS: 'sudo yum install snappy' > > > > > >> > > > > > >> It's also possible that the version of Hadoop you're using > doesn't > > > > > >> have its native libraries built, but it's hard to know more > > without > > > > > >> seeing more of the error message (like an associated stack trace > > or > > > > > >> logger class name). If it is Hadoop not having it's native > > libraries > > > > > >> built, I'm not sure how to rebuild Hadoop from source. > > > > > >> > > > > > >> On Tue, May 28, 2019 at 3:48 PM Jeffrey Zeiberg < > > [email protected] > > > > > > > > > >> wrote: > > > > > >> > > > > > > >> > I am seeing this in my error logs on my Uno instance when I > run > > > the > > > > > >> > "./bin/cingest ingest" in accumulo-testing. Anyone else > seeing > > > > this? > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > >
