Pinal Shah created ATLAS-4941:
---------------------------------
Summary: Atlas fails to startup locally after compression type has
changed to SNAPPY
Key: ATLAS-4941
URL: https://issues.apache.org/jira/browse/ATLAS-4941
Project: Atlas
Issue Type: Bug
Components: atlas-core
Reporter: Pinal Shah
Assignee: Pinal Shah
After compression type is set to SNAPPY,
When Atlas is build locally, it fails giving below console exception
{code:java}
java.lang.RuntimeException: org.apache.atlas.AtlasException:
org.apache.hadoop.hbase.DoNotRetryIOException:
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z Set
hbase.table.sanity.checks to false at conf or table descriptor if you want to
bypass sanity checks
at
org.apache.hadoop.hbase.util.TableDescriptorChecker.warnOrThrowExceptionForFailure(TableDescriptorChecker.java:318)
at
org.apache.hadoop.hbase.util.TableDescriptorChecker.warnOrThrowExceptionForFailure(TableDescriptorChecker.java:33
{code}
{code:java}
Caused by: java.lang.UnsatisfiedLinkError:
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy()Z at
org.apache.hadoop.util.NativeCodeLoader.buildSupportsSnappy(Native Method)
at
org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:63)
at
org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:136)
{code}
*Workaround*
- sudo apt install libsnappy-dev
- added above configs in "hbase/conf/hbase-env.sh"
{code:java}
export HADOOP_HOME=/usr/local/hadoop-3.2.4
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$HADOOP_HOME/lib/native{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
