I've found the reason. beacuse my env is CDH5.14, the hive version is 1.1 it
contains a lower version commons-configuration*.jar
but there is also other problems about version compatibility, for example：
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.hive.metastore.api.Database.getCatalogName()Ljava/lang/String;
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getDatabaseName(HiveMetaStoreBridge.java:586)
So is there any plan to support hadoop with old version?
-------- Forwarding messages --------
From: "lk_hadoop" <lk_had...@163.com>
Date: 2020-06-11 09:04:28
To: "dev@atlas.apache.org" <dev@atlas.apache.org>,"u...@atlas.apache.org"
<u...@atlas.apache.org>
Subject: Fw:Re:Re:import-hive.sh error with 2.1.0-rc1
I just make a soft link /etc/atlas/conf/atlas-application.properties to my
atlas-application.properties ,and I run hook-bin/import-hive.sh -d test_db
,then I got the errpr:
2020-06-11 08:55:31,699 INFO - [main:] ~ Looking for
atlas-application.properties in classpath (ApplicationProperties:121)
2020-06-11 08:55:31,702 INFO - [main:] ~ Loading atlas-application.properties
from file:/etc/atlas/conf/atlas-application.properties
(ApplicationProperties:134)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using graphdb backend 'janus'
(ApplicationProperties:314)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using storage backend 'hbase2'
(ApplicationProperties:325)
2020-06-11 08:55:31,739 INFO - [main:] ~ Using index backend 'solr'
(ApplicationProperties:336)
2020-06-11 08:55:31,739 INFO - [main:] ~ Atlas is running in MODE: PROD.
(ApplicationProperties:340)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting solr-wait-searcher property
'true' (ApplicationProperties:346)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting index.search.map-name
property 'false' (ApplicationProperties:350)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting
atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache = true (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372)
2020-06-11 08:55:31,745 ERROR - [main:] ~ Import failed
(HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:123)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 2 more
I found that the property 'atlas.graph.index.search.solr.wait-searcher'
default value is boolean: true, and when
ApplicationProperties line:142 Configuration configuration =
appProperties.interpolatedConfiguration();
will call method AbstractConfiguration.getLsit(String key) ,this method can't
map a boolean value to List.
I don't know is this a bug ,or it's my mistake,can anyone help?
-------- Forwarding messages --------
From: "lk_hadoop" <lk_had...@163.com>
Date: 2020-06-10 21:45:18
To: u...@atlas.apache.org
Subject: Re:Re:import-hive.sh error with 2.1.0-rc1
org.apache.commons.configuration.AbstractConfiguration.getList(String key,
List<?> defaultValue) can't map a boolean value to list
public List<Object> getList(String key, List<?> defaultValue)
{
Object value = getProperty(key);
List<Object> list;
if (value instanceof String)
{
list = new ArrayList<Object>(1);
list.add(interpolate((String) value));
}
else if (value instanceof List)
{
list = new ArrayList<Object>();
List<?> l = (List<?>) value;
// add the interpolated elements in the new list
for (Object elem : l)
{
list.add(interpolate(elem));
}
}
else if (value == null)
{
list = (List<Object>) defaultValue;
}
else if (value.getClass().isArray())
{
return Arrays.asList((Object[]) value);
}
else if (isScalarValue(value))
{
return Collections.singletonList((Object) value.toString());
}
else
{
throw new ConversionException('\'' + key + "' doesn't map to a List object: " +
value + ", a "
+ value.getClass().getName());
}
return list;
}
At 2020-06-10 18:59:22, "lk_hadoop" <lk_had...@163.com> wrote:
even if I change the vaue to false or comment out this line, I still got the
same error：
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
At 2020-06-10 18:27:41, "lk_hadoop" <lk_had...@163.com> wrote:
hi,all:
I try to import hive metadata ,I got error :
ERROR - [main:] ~ Import failed (HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:123)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 2 more
my config is :
atlas.graph.index.search.solr.wait-searcher=true
