Hej, I'm currently writing some Unittest for my GiraphJob using the ConnectedComponentsComputationTest as bases on how to do it.
When I run the Untitest I get: "java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses." The development machine does not have Hadoop or Zookeper installed, but I thought InternalVertexRunner would not require those to run. anyone any Idea? ________log_________ 014-04-02 15:00:11,609 WARN [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2014-04-02 15:00:11,726 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max 2014-04-02 15:00:11,726 INFO [pool-1-thread-1] server.ZooKeeperServerMain (ZooKeeperServerMain.java:runFromConfig(94)) - Starting server 2014-04-02 15:00:11,727 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb 2014-04-02 15:00:11,729 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb 2014-04-02 15:00:11,729 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative 2014-04-02 15:00:11,736 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.user.classpath.first is deprecated. Instead, use mapreduce.job.user.classpath.first 2014-04-02 15:00:11,737 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts 2014-04-02 15:00:11,738 INFO [main] job.GiraphJob (GiraphJob.java:run(223)) - run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 0, old value = 4) 2014-04-02 15:00:11,740 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT 2014-04-02 15:00:11,740 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:host.name =mneumann-ThinkPad-T430s 2014-04-02 15:00:11,740 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.version=1.7.0_51 2014-04-02 15:00:11,740 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.vendor=Oracle Corporation 2014-04-02 15:00:11,740 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.home=/usr/lib/jvm/java-7-oracle/jre 2014-04-02 15:00:11,741 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.class.path=/home/mneumann/workspace/ConComp/target/test-classes:/home/mneumann/workspace/ConComp/target/classes:/home/mneumann/workspace/ConComp/lib/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.2.0.2.0.6.0-76-jar-with-dependencies.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-common/2.2.0.2.0.6.0-76/hadoop-common-2.2.0.2.0.6.0-76.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-annotations/2.2.0.2.0.6.0-76/hadoop-annotations-2.2.0.2.0.6.0-76.jar:/usr/lib/jvm/java-7-oracle/lib/tools.jar:/home/mneumann/.m2/repository/com/google/guava/guava/11.0.2/guava-11.0.2.jar:/home/mneumann/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/mneumann/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/mneumann/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar:/home/mneumann/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/mneumann/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/mneumann/.m2/repository/commons-codec/commons-codec/1.4/commons-codec-1.4.jar:/home/mneumann/.m2/repository/commons-io/commons-io/2.1/commons-io-2.1.jar:/home/mneumann/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/mneumann/.m2/repository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/home/mneumann/.m2/repository/org/mortbay/jetty/jetty/6.1.26/jetty-6.1.26.jar:/home/mneumann/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-json/1.9/jersey-json-1.9.jar:/home/mneumann/.m2/repository/org/codehaus/jettison/jettison/1.1/jettison-1.1.jar:/home/mneumann/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/home/mneumann/.m2/repository/com/sun/xml/bind/jaxb-impl/2.2.3-1/jaxb-impl-2.2.3-1.jar:/home/mneumann/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/mneumann/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/mneumann/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.8.3/jackson-jaxrs-1.8.3.jar:/home/mneumann/.m2/repository/org/codehaus/jackson/jackson-xc/1.8.3/jackson-xc-1.8.3.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/home/mneumann/.m2/repository/asm/asm/3.1/asm-3.1.jar:/home/mneumann/.m2/repository/tomcat/jasper-compiler/5.5.23/jasper-compiler-5.5.23.jar:/home/mneumann/.m2/repository/tomcat/jasper-runtime/5.5.23/jasper-runtime-5.5.23.jar:/home/mneumann/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/mneumann/.m2/repository/commons-el/commons-el/1.0/commons-el-1.0.jar:/home/mneumann/.m2/repository/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar:/home/mneumann/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/mneumann/.m2/repository/net/java/dev/jets3t/jets3t/0.6.1/jets3t-0.6.1.jar:/home/mneumann/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar:/home/mneumann/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/mneumann/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/mneumann/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/mneumann/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/mneumann/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/mneumann/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/home/mneumann/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar:/home/mneumann/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/home/mneumann/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/mneumann/.m2/repository/org/apache/avro/avro/1.7.4/avro-1.7.4.jar:/home/mneumann/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar:/home/mneumann/.m2/repository/org/xerial/snappy/snappy-java/ 1.0.4.1/snappy-java-1.0.4.1.jar:/home/mneumann/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-auth/2.2.0.2.0.6.0-76/hadoop-auth-2.2.0.2.0.6.0-76.jar:/home/mneumann/.m2/repository/com/jcraft/jsch/0.1.42/jsch-0.1.42.jar:/home/mneumann/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/home/mneumann/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/mneumann/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.2.0.2.0.6.0-76/hadoop-mapreduce-client-core-2.2.0.2.0.6.0-76.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.2.0.2.0.6.0-76/hadoop-yarn-common-2.2.0.2.0.6.0-76.jar:/home/mneumann/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.2.0.2.0.6.0-76/hadoop-yarn-api-2.2.0.2.0.6.0-76.jar:/home/mneumann/.m2/repository/com/google/inject/guice/3.0/guice-3.0.jar:/home/mneumann/.m2/repository/javax/inject/javax.inject/1/javax.inject-1.jar:/home/mneumann/.m2/repository/aopalliance/aopalliance/1.0/aopalliance-1.0.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-test-framework/jersey-test-framework-grizzly2/1.9/jersey-test-framework-grizzly2-1.9.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-test-framework/jersey-test-framework-core/1.9/jersey-test-framework-core-1.9.jar:/home/mneumann/.m2/repository/javax/servlet/javax.servlet-api/3.0.1/javax.servlet-api-3.0.1.jar:/home/mneumann/.m2/repository/junit/junit/4.8.2/junit-4.8.2.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/mneumann/.m2/repository/com/sun/jersey/jersey-grizzly2/1.9/jersey-grizzly2-1.9.jar:/home/mneumann/.m2/repository/org/glassfish/grizzly/grizzly-http/2.1.2/grizzly-http-2.1.2.jar:/home/mneumann/.m2/repository/org/glassfish/grizzly/grizzly-framework/2.1.2/grizzly-framework-2.1.2.jar:/home/mneumann/.m2/repository/org/glassfish/gmbal/gmbal-api-only/3.0.0-b023/gmbal-api-only-3.0.0-b023.jar:/home/mneumann/.m2/repository/org/glassfish/external/management-api/3.0.0-b012/management-api-3.0.0-b012.jar:/home/mneumann/.m2/repository/org/glassfish/grizzly/grizzly-http-server/2.1.2/grizzly-http-server-2.1.2.jar:/home/mneumann/.m2/repository/org/glassfish/grizzly/grizzly-rcm/2.1.2/grizzly-rcm-2.1.2.jar:/home/mneumann/.m2/repository/org/glassfish/grizzly/grizzly-http-servlet/2.1.2/grizzly-http-servlet-2.1.2.jar:/home/mneumann/.m2/repository/org/glassfish/javax.servlet/3.1/javax.servlet-3.1.jar:/home/mneumann/.m2/repository/com/sun/jersey/contribs/jersey-guice/1.9/jersey-guice-1.9.jar:/home/mneumann/.m2/repository/com/google/inject/extensions/guice-servlet/3.0/guice-servlet-3.0.jar:/home/mneumann/.m2/repository/io/netty/netty/3.6.2.Final/netty-3.6.2.Final.jar:/home/mneumann/Software/eclipse/configuration/org.eclipse.osgi/bundles/164/1/.cp/:/home/mneumann/Software/eclipse/configuration/org.eclipse.osgi/bundles/163/1/.cp/ 2014-04-02 15:00:11,741 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2014-04-02 15:00:11,741 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.io.tmpdir=/tmp 2014-04-02 15:00:11,742 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:java.compiler=<NA> 2014-04-02 15:00:11,742 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.name=Linux 2014-04-02 15:00:11,742 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.arch=amd64 2014-04-02 15:00:11,742 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:os.version=3.11.0-18-generic 2014-04-02 15:00:11,743 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.name=mneumann 2014-04-02 15:00:11,743 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.home=/home/mneumann 2014-04-02 15:00:11,743 INFO [pool-1-thread-1] server.ZooKeeperServer (Environment.java:logEnv(97)) - Server environment:user.dir=/home/mneumann/workspace/ConComp 2014-04-02 15:00:11,751 INFO [pool-1-thread-1] server.ZooKeeperServer (ZooKeeperServer.java:setTickTime(663)) - tickTime set to 2000 2014-04-02 15:00:11,751 INFO [pool-1-thread-1] server.ZooKeeperServer (ZooKeeperServer.java:setMinSessionTimeout(672)) - minSessionTimeout set to 10000 2014-04-02 15:00:11,751 INFO [pool-1-thread-1] server.ZooKeeperServer (ZooKeeperServer.java:setMaxSessionTimeout(681)) - maxSessionTimeout set to 100000 2014-04-02 15:00:11,775 INFO [pool-1-thread-1] server.NIOServerCnxn (NIOServerCnxn.java:<init>(143)) - binding to port 0.0.0.0/0.0.0.0:22182 2014-04-02 15:00:11,803 INFO [pool-1-thread-1] persistence.FileTxnSnapLog (FileTxnSnapLog.java:save(208)) - Snapshotting: 0 2014-04-02 15:00:11,805 INFO [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 2014-04-02 15:00:11,822 ERROR [main] security.UserGroupInformation (UserGroupInformation.java:doAs(1494)) - PriviledgedActionException as:mneumann (auth:SIMPLE) cause:java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses. 2014-04-02 15:00:11,823 INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:22182] server.NIOServerCnxn (NIOServerCnxn.java:run(278)) - NIOServerCnxn factory exited run method java.io.IOException: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.
