Rya uses the hadoop-common library to manage the configuration properties. This class is a descendent of org.apache.hadoop.conf.Configuration :
https://github.com/apache/incubator-rya/blob/master/dao/accumulo.rya/src/main/java/org/apache/rya/accumulo/AccumuloRdfConfiguration.java When Rya calls (AccumuloRdfConfiguration.java:323) org.apache.hadoop.conf.Configuration.getInstances(...) it checks for HADOOP_HOME and throws your error. You might be able to turn that off using Configuration <http://hadoop.apache.org/docs/r3.0.1/api/org/apache/hadoop/conf/Configuration.html#Configuration-boolean-> (boolean loadDefaults) constructor as described here: http://hadoop.apache.org/docs/r3.0.1/api/org/apache/hadoop/conf/Configuration.html Quote: Unless explicitly turned off, Hadoop by default specifies two resources, loaded in-order from the classpath: 1. core-default.xml <http://hadoop.apache.org/docs/r3.0.1/hadoop-project-dist/hadoop-common/core-default.xml>: Read-only defaults for hadoop. 2. core-site.xml: Site-specific configuration for a given hadoop installation. BTW, I think we would all love to hear more about your use of Rya on Google Cloud. david. On Fri, Jun 29, 2018 at 1:00 PM David Lotts <[email protected]> wrote: > Hi Maxim, > Rya uses an Accumulo client. The Accumulo client is dependent on Hadoop, > particularly HDFS and zookeeper. > The environment variable HADOOP_HOME or corresponding property is > required to find the path to the locally installed hadoop runtime files. > Details can be found in the Accumulo manual where it describes running > client code: > > > https://accumulo.apache.org/1.7/accumulo_user_manual.html#_writing_accumulo_clients > > david. > > > On Wed, Jun 20, 2018 at 9:16 AM Maxim Kolchin <[email protected]> > wrote: > >> Hi all, >> >> I'm running Apache Accumulo on Google VMs (aka Compute Engine) and use >> Google Cloud Storage as a replacement for HDFS. Hadoop (its MapReduce >> part) >> is only used to run the import job to load some RDF to Accumulo, so I shut >> it down when the job finishes. >> >> When I trying to startup Rya I see the following exception: >> java.io.IOException: HADOOP_HOME or hadoop.home.dir are not set. The full >> log is at [1]. >> >> Does it mean that Rya requires a direct access to Hadoop? I guess Rya is >> looking for a Hadoop cluster in Zookeeper and when it can't find it there >> it's looking for the HADOOP_HOME. >> >> [1]: https://gist.github.com/KMax/687293ce666754ce8eed11c369a0db05 >> >> Thank you in advance! >> Maxim Kolchin >> >> E-mail: [email protected] >> Tel.: +7 (911) 199-55-73 >> Homepage: http://kolchinmax.ru >> >
