Fw:Fw:Re:Re:import-hive.sh error with 2.1.0-rc1
I've found the reason. beacuse my env is CDH5.14, the hive version is 1.1 it
contains a lower version commons-configuration*.jar
but there is also other problems about version compatibility, for example：
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.hive.metastore.api.Database.getCatalogName()Ljava/lang/String;
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.getDatabaseName(HiveMetaStoreBridge.java:586)
So is there any plan to support hadoop with old version?
Forwarding messages ----
From: "lk_hadoop"
Date: 2020-06-11 09:04:28
To: "dev@atlas.apache.org" ,"u...@atlas.apache.org"
Subject: Fw:Re:Re:import-hive.sh error with 2.1.0-rc1
I just make a soft link /etc/atlas/conf/atlas-application.properties to my
atlas-application.properties ,and I run hook-bin/import-hive.sh -d test_db
,then I got the errpr:
2020-06-11 08:55:31,699 INFO - [main:] ~ Looking for
atlas-application.properties in classpath (ApplicationProperties:121)
2020-06-11 08:55:31,702 INFO - [main:] ~ Loading atlas-application.properties
from file:/etc/atlas/conf/atlas-application.properties
(ApplicationProperties:134)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using graphdb backend 'janus'
(ApplicationProperties:314)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using storage backend 'hbase2'
(ApplicationProperties:325)
2020-06-11 08:55:31,739 INFO - [main:] ~ Using index backend 'solr'
(ApplicationProperties:336)
2020-06-11 08:55:31,739 INFO - [main:] ~ Atlas is running in MODE: PROD.
(ApplicationProperties:340)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting solr-wait-searcher property
'true' (ApplicationProperties:346)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting index.search.map-name
property 'false' (ApplicationProperties:350)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting
atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache = true (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372)
2020-06-11 08:55:31,745 ERROR - [main:] ~ Import failed
(HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:123)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 2 more
I found that the property 'atlas.graph.index.search.solr.wait-searcher'
default value is boolean: true, and when
ApplicationProperties line:142 Configuration configuration =
appProperties.interpolatedConfiguration();
will call method AbstractConfiguration.getLsit(String key) ,this method can't
map a boolean value to List.
I don't know is this a bug ,or it's my mistake,can anyone help?
---- Forwarding messages
From: "lk_hadoop"
Date: 2020-06-10 21:45:18
To: u...@atlas.apache.org
Subject: Re:Re:import-hive.sh error with 2.1.0-rc1
org.apache.commons.configuration.AbstractConfiguration.getList(String key,
List defaultValue) can't map a boolean value to list
public List getList(String key, List defaultValue)
{
Object value = getProperty(key);
List list;
if (value instanceof String)
{
list = new ArrayList(1);
list.add(interpolate((String) value));
}
else if (value instanceof List)
{
list = new ArrayList();
List l = (List) value;
// add the interpolated elements in the new list
for (Object elem : l)
{
list.add(interpolate(elem));
}
}
else if (value == null)
{
list = (List) defaultValue;
}
else if (value.getClass().isArray())
{
return Arrays.asList((Object[]) value);
}
else if (isScalarValue(value))
{
return Collections.singletonList((Object) value.toString());
Fw:Re:Re:import-hive.sh error with 2.1.0-rc1
I just make a soft link /etc/atlas/conf/atlas-application.properties to my
atlas-application.properties ,and I run hook-bin/import-hive.sh -d test_db
,then I got the errpr:
2020-06-11 08:55:31,699 INFO - [main:] ~ Looking for
atlas-application.properties in classpath (ApplicationProperties:121)
2020-06-11 08:55:31,702 INFO - [main:] ~ Loading atlas-application.properties
from file:/etc/atlas/conf/atlas-application.properties
(ApplicationProperties:134)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using graphdb backend 'janus'
(ApplicationProperties:314)
2020-06-11 08:55:31,737 INFO - [main:] ~ Using storage backend 'hbase2'
(ApplicationProperties:325)
2020-06-11 08:55:31,739 INFO - [main:] ~ Using index backend 'solr'
(ApplicationProperties:336)
2020-06-11 08:55:31,739 INFO - [main:] ~ Atlas is running in MODE: PROD.
(ApplicationProperties:340)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting solr-wait-searcher property
'true' (ApplicationProperties:346)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting index.search.map-name
property 'false' (ApplicationProperties:350)
2020-06-11 08:55:31,739 INFO - [main:] ~ Setting
atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache = true (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372)
2020-06-11 08:55:31,740 INFO - [main:] ~ Property (set to default)
atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372)
2020-06-11 08:55:31,745 ERROR - [main:] ~ Import failed
(HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:123)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 2 more
I found that the property 'atlas.graph.index.search.solr.wait-searcher'
default value is boolean: true, and when
ApplicationProperties line:142 Configuration configuration =
appProperties.interpolatedConfiguration();
will call method AbstractConfiguration.getLsit(String key) ,this method can't
map a boolean value to List.
I don't know is this a bug ,or it's my mistake,can anyone help?
Forwarding messages
From: "lk_hadoop"
Date: 2020-06-10 21:45:18
To: u...@atlas.apache.org
Subject: Re:Re:import-hive.sh error with 2.1.0-rc1
org.apache.commons.configuration.AbstractConfiguration.getList(String key,
List defaultValue) can't map a boolean value to list
public List getList(String key, List defaultValue)
{
Object value = getProperty(key);
List list;
if (value instanceof String)
{
list = new ArrayList(1);
list.add(interpolate((String) value));
}
else if (value instanceof List)
{
list = new ArrayList();
List l = (List) value;
// add the interpolated elements in the new list
for (Object elem : l)
{
list.add(interpolate(elem));
}
}
else if (value == null)
{
list = (List) defaultValue;
}
else if (value.getClass().isArray())
{
return Arrays.asList((Object[]) value);
}
else if (isScalarValue(value))
{
return Collections.singletonList((Object) value.toString());
}
else
{
throw new ConversionException('\'' + key + "' doesn't map to a List object: " +
value + ", a "
+ value.getClass().getName());
}
return list;
}
At 2020-06-10 18:59:22, "lk_hadoop" wrote:
even if I change the vaue to false or comment out this line, I still got the
same error：
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
At 2020-06-10 18:27:41, "lk_hadoop" wrote:
hi,all:
I try to import hive metadata ,I got error :
ERROR - [main:] ~ Import failed (HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application proper
Fw:Re:Re:import-hive.sh error with 2.1.0-rc1
Forwarding messages
From: "lk_hadoop"
Date: 2020-06-10 21:45:18
To: u...@atlas.apache.org
Subject: Re:Re:import-hive.sh error with 2.1.0-rc1
org.apache.commons.configuration.AbstractConfiguration.getList(String key,
List defaultValue) can't map a boolean value to list
public List getList(String key, List defaultValue)
{
Object value = getProperty(key);
List list;
if (value instanceof String)
{
list = new ArrayList(1);
list.add(interpolate((String) value));
}
else if (value instanceof List)
{
list = new ArrayList();
List l = (List) value;
// add the interpolated elements in the new list
for (Object elem : l)
{
list.add(interpolate(elem));
}
}
else if (value == null)
{
list = (List) defaultValue;
}
else if (value.getClass().isArray())
{
return Arrays.asList((Object[]) value);
}
else if (isScalarValue(value))
{
return Collections.singletonList((Object) value.toString());
}
else
{
throw new ConversionException('\'' + key + "' doesn't map to a List object: " +
value + ", a "
+ value.getClass().getName());
}
return list;
}
At 2020-06-10 18:59:22, "lk_hadoop" wrote:
even if I change the vaue to false or comment out this line, I still got the
same error：
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
At 2020-06-10 18:27:41, "lk_hadoop" wrote:
hi,all:
I try to import hive metadata ,I got error :
ERROR - [main:] ~ Import failed (HiveMetaStoreBridge:179)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:147)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:100)
at
org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:123)
Caused by: org.apache.commons.configuration.ConversionException:
'atlas.graph.index.search.solr.wait-searcher' doesn't map to a List object:
true, a java.lang.Boolean
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at
org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at
org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:142)
... 2 more
my config is :
atlas.graph.index.search.solr.wait-searcher=true
Re:Re:atlas-release-2.1.0-rc1 start up error
sorry, I know the reason , I need to creat solr index manully. At 2020-06-09 14:20:51, "lk_hadoop" wrote: >I foud the reason, because I use elasticsearch as backend first to start >atlas, I need to remove the hbase table create by JanusGraph. >but there is another problem: >the solr I config with : >atlas.graph.index.search.solr.mode=http >atlas.graph.index.search.solr.http-urls=http://10.8.130.52:8983/solr >first I give the wrong url, now when I start up atlas I got error: >ERROR - [main:] ~ Unable to save documents to Solr as one of the shape objects >stored were not compatible with Solr. (Solr6Index:613) >org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error >from server at http://10.8.130.52:8983/solr: Expected mime type >application/octet-stream but got text/html. > > >Error 404 Not Found > >HTTP ERROR 404 >Problem accessing /solr/vertex_index/update. Reason: >Not Found > > > > >at >org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591) >at >org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) >at >org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242) >at >org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:663) >at >org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:638) >at >org.janusgraph.diskstorage.solr.Solr6Index.commitChanges(Solr6Index.java:611) >at org.janusgraph.diskstorage.solr.Solr6Index.mutate(Solr6Index.java:487) >... > > > > > > > >在 2020-06-09 12:13:09，"lk_hadoop" 写道： > >hi,all: >2020-06-09 11:29:41,005 INFO - [main:] ~ Loading atlas-application.properties >from >file:/home/devuser/atlas/apache-atlas-2.1.0/conf/atlas-application.properties >(ApplicationProperties:134) >2020-06-09 11:29:41,012 INFO - [main:] ~ Using graphdb backend 'janus' >(ApplicationProperties:314) >2020-06-09 11:29:41,012 INFO - [main:] ~ Using storage backend 'hbase2' >(ApplicationProperties:325) >2020-06-09 11:29:41,012 INFO - [main:] ~ Using index backend 'solr' >(ApplicationProperties:336) >2020-06-09 11:29:41,014 INFO - [main:] ~ Atlas is running in MODE: PROD. >(ApplicationProperties:340) >2020-06-09 11:29:41,014 INFO - [main:] ~ Setting solr-wait-searcher property >'true' (ApplicationProperties:346) >2020-06-09 11:29:41,014 INFO - [main:] ~ Setting index.search.map-name >property 'false' (ApplicationProperties:350) >2020-06-09 11:29:41,015 INFO - [main:] ~ Setting >atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360) >2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) >atlas.graph.cache.db-cache = true (ApplicationProperties:372) >2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) >atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372) >2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) >atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372) >2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) >atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372) >2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) >atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372) >2020-06-09 11:29:41,023 INFO - [main:] ~ > > Atlas Server (STARTUP) > > >project.name:apache-atlas >project.description:Metadata Management and Data Governance Platform over >Hadoop >build.user:devuser >build.epoch:1591663542701 >project.version:2.1.0 >build.version:2.1.0 >vc.revision:release >vc.source.url:scm:git:git://git.apache.org/atlas.git/atlas-webapp > > (Atlas:215) >2020-06-09 11:29:41,023 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> >(Atlas:216) >2020-06-09 11:29:41,023 INFO - [main:] ~ Server starting with TLS ? false on >port 21000 (Atlas:217) >2020-06-09 11:29:41,024 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< >(Atlas:218) >2020-06-09 11:29:41,811 INFO - [main:] ~ Logged in user devuser (auth:SIMPLE) >(LoginProcessor:77) >2020-06-09 11:29:42,174 INFO - [main:] ~ Not running setup per configuration >atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189) >2020-06-09 11:29:44,478 WARN - [main:] ~ Local setting >index.search
Re:atlas-release-2.1.0-rc1 start up error
I foud the reason, because I use elasticsearch as backend first to start atlas, I need to remove the hbase table create by JanusGraph. but there is another problem: the solr I config with : atlas.graph.index.search.solr.mode=http atlas.graph.index.search.solr.http-urls=http://10.8.130.52:8983/solr first I give the wrong url, now when I start up atlas I got error: ERROR - [main:] ~ Unable to save documents to Solr as one of the shape objects stored were not compatible with Solr. (Solr6Index:613) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://10.8.130.52:8983/solr: Expected mime type application/octet-stream but got text/html. Error 404 Not Found HTTP ERROR 404 Problem accessing /solr/vertex_index/update. Reason: Not Found at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:663) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:638) at org.janusgraph.diskstorage.solr.Solr6Index.commitChanges(Solr6Index.java:611) at org.janusgraph.diskstorage.solr.Solr6Index.mutate(Solr6Index.java:487) ... 在 2020-06-09 12:13:09，"lk_hadoop" 写道： hi,all: 2020-06-09 11:29:41,005 INFO - [main:] ~ Loading atlas-application.properties from file:/home/devuser/atlas/apache-atlas-2.1.0/conf/atlas-application.properties (ApplicationProperties:134) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using graphdb backend 'janus' (ApplicationProperties:314) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using storage backend 'hbase2' (ApplicationProperties:325) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using index backend 'solr' (ApplicationProperties:336) 2020-06-09 11:29:41,014 INFO - [main:] ~ Atlas is running in MODE: PROD. (ApplicationProperties:340) 2020-06-09 11:29:41,014 INFO - [main:] ~ Setting solr-wait-searcher property 'true' (ApplicationProperties:346) 2020-06-09 11:29:41,014 INFO - [main:] ~ Setting index.search.map-name property 'false' (ApplicationProperties:350) 2020-06-09 11:29:41,015 INFO - [main:] ~ Setting atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372) 2020-06-09 11:29:41,023 INFO - [main:] ~ Atlas Server (STARTUP) project.name:apache-atlas project.description:Metadata Management and Data Governance Platform over Hadoop build.user:devuser build.epoch:1591663542701 project.version:2.1.0 build.version:2.1.0 vc.revision:release vc.source.url:scm:git:git://git.apache.org/atlas.git/atlas-webapp (Atlas:215) 2020-06-09 11:29:41,023 INFO - [main:] ~ >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> (Atlas:216) 2020-06-09 11:29:41,023 INFO - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:217) 2020-06-09 11:29:41,024 INFO - [main:] ~ <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< (Atlas:218) 2020-06-09 11:29:41,811 INFO - [main:] ~ Logged in user devuser (auth:SIMPLE) (LoginProcessor:77) 2020-06-09 11:29:42,174 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189) 2020-06-09 11:29:44,478 WARN - [main:] ~ Local setting index.search.solr.mode=http (Type: GLOBAL_OFFLINE) is overridden by globally managed value (cloud). Use the ManagementSystem interfa ce instead of the local configuration to control this setting. (ReadConfigurationBuilder:268) 2020-06-09 11:29:44,480 WARN - [main:] ~ Local setting index.search.backend=solr (Type: GLOBAL_OFFLINE) is overridden by globally managed value (elasticsearch). Use the ManagementSystem i nterface instead of the local configuration to control this setting. (ReadConfigurationBuilder:268) 2020-06-09 11:29:44,488
atlas-release-2.1.0-rc1 start up error
hi,all: 2020-06-09 11:29:41,005 INFO - [main:] ~ Loading atlas-application.properties from file:/home/devuser/atlas/apache-atlas-2.1.0/conf/atlas-application.properties (ApplicationProperties:134) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using graphdb backend 'janus' (ApplicationProperties:314) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using storage backend 'hbase2' (ApplicationProperties:325) 2020-06-09 11:29:41,012 INFO - [main:] ~ Using index backend 'solr' (ApplicationProperties:336) 2020-06-09 11:29:41,014 INFO - [main:] ~ Atlas is running in MODE: PROD. (ApplicationProperties:340) 2020-06-09 11:29:41,014 INFO - [main:] ~ Setting solr-wait-searcher property 'true' (ApplicationProperties:346) 2020-06-09 11:29:41,014 INFO - [main:] ~ Setting index.search.map-name property 'false' (ApplicationProperties:350) 2020-06-09 11:29:41,015 INFO - [main:] ~ Setting atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:360) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:372) 2020-06-09 11:29:41,015 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:372) 2020-06-09 11:29:41,023 INFO - [main:] ~ Atlas Server (STARTUP) project.name:apache-atlas project.description:Metadata Management and Data Governance Platform over Hadoop build.user:devuser build.epoch:1591663542701 project.version:2.1.0 build.version:2.1.0 vc.revision:release vc.source.url:scm:git:git://git.apache.org/atlas.git/atlas-webapp (Atlas:215) 2020-06-09 11:29:41,023 INFO - [main:] ~ > (Atlas:216) 2020-06-09 11:29:41,023 INFO - [main:] ~ Server starting with TLS ? false on port 21000 (Atlas:217) 2020-06-09 11:29:41,024 INFO - [main:] ~ < (Atlas:218) 2020-06-09 11:29:41,811 INFO - [main:] ~ Logged in user devuser (auth:SIMPLE) (LoginProcessor:77) 2020-06-09 11:29:42,174 INFO - [main:] ~ Not running setup per configuration atlas.server.run.setup.on.start. (SetupSteps$SetupRequired:189) 2020-06-09 11:29:44,478 WARN - [main:] ~ Local setting index.search.solr.mode=http (Type: GLOBAL_OFFLINE) is overridden by globally managed value (cloud). Use the ManagementSystem interfa ce instead of the local configuration to control this setting. (ReadConfigurationBuilder:268) 2020-06-09 11:29:44,480 WARN - [main:] ~ Local setting index.search.backend=solr (Type: GLOBAL_OFFLINE) is overridden by globally managed value (elasticsearch). Use the ManagementSystem i nterface instead of the local configuration to control this setting. (ReadConfigurationBuilder:268) 2020-06-09 11:29:44,488 WARN - [main:] ~ Local setting index.search.map-name=false (Type: GLOBAL) is overridden by globally managed value (true). Use the ManagementSystem interface instea d of the local configuration to control this setting. (ReadConfigurationBuilder:268) 2020-06-09 11:29:44,758 INFO - [main:] ~ Failed to obtain graph instance, retrying 3 times, error: java.lang.IllegalArgumentException: Could not instantiate implementation: org.janusgraph. diskstorage.es.ElasticSearchIndex (AtlasGraphProvider:100) why index.search.backend is overridden by globally managed value (elasticsearch) ?
Fw:atlas 2 start error with hbase 1.2
hi,all :
Forwarding messages
From: "lk_hadoop"
Date: 2020-06-08 15:53:01
To: u...@atlas.apache.org
Subject: atlas 2 start error with hbase 1.2
hi,all:
I'm using atlas-release-2.1.0-rc0 ,with hbase 1.2.0 , when start atlas I
got error :
Caused by:
org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException:
org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family
table does not exist in region hbase:meta,,1.1588230740 in table 'hbase:meta',
{TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 =>
'|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'},
{NAME => 'info', BLOOMFILTER => 'NONE', VERSIONS => '10', IN_MEMORY => 'true',
KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER',
COMPRESSION => 'NONE', CACHE_DATA_IN_L1 => 'true', MIN_VERSIONS => '0',
BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}
It's that mean I can only use atlas 2 with hbase2.0+ ?
Fw:build with profile embedded-cassandra-solr not work
hi,all: Forwarding messages From: "lk_hadoop" Date: 2020-06-08 21:15:24 To: u...@atlas.apache.org Subject: build with profile embedded-cassandra-solr not work hi,all: I'm using atlas-release-2.1.0-rc0 build with : mvn clean -DskipTests package -Pdist,embedded-cassandra-solr when I try atlas_start.py , I got error: Context initialization failed (ContextLoader:350) org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.context.event.internalEventListenerProcessor': BeanPostProcessor before instantia tion of bean failed; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionAdvisor' defined in URL [jar:file:/ home/devuser/atlas/apache-atlas-2.1.0/server/webapp/atlas/WEB-INF/lib/atlas-repository-2.1.0.jar!/org/apache/atlas/GraphTransactionAdvisor.class]: Unsatisfied dependency expressed through c onstructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'graphTransactionInterceptor' defined in URL [jar :file:/home/devuser/atlas/apache-atlas-2.1.0/server/webapp/atlas/WEB-INF/lib/atlas-repository-2.1.0.jar!/org/apache/atlas/GraphTransactionInterceptor.class]: Unsatisfied dependency expresse d through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'get' defined in org.apache.atlas.repository.gr aph.AtlasGraphProvider: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.atlas.repos itory.graphdb.AtlasGraph]: Factory method 'get' threw exception; nested exception is java.lang.NoClassDefFoundError: org/apache/cassandra/dht/RandomPartitioner$BigIntegerToken at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:477) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:867) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:543) at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443) at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325) at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107) at org.apache.atlas.web.setup.KerberosAwareListener.contextInitialized(KerberosAwareListener.java:31) at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:843) at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:533) at org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:816) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:345) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1404) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1366) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:778) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:262) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:520) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:131) at org.eclipse.jetty.server.Server.start(Server.java:422) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:105) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61) at org.eclipse.jetty.server.Server.doStart(Server.java:389) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:98) at org.apache.atlas.Atlas.main(Atlas.java:133)
