Re: Giraph Basic Job Run
Hi Ritesh, As far as I have checked this error Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 usually comes when the code compilation is done in one version and code is run in another version(usually lower) but I have explicitly set java 7 for compilation while packaging the project and moreover I have Java 7 set in classpath(referred bashrc) and this error Unsupported major.minor version 51.0 itself says that the compilation is done in java 7. So does that mean my Java is taking lower version than Java 7 even though I am able to see the classpath set to Java 7. java version 1.7.0_21 Java(TM) SE Runtime Environment (build 1.7.0_21-b11) Java HotSpot(TM) 64-Bit Server VM (build 23.21-b01, mixed mode) Although I have faced this classversion error several times while running code from eclipse but this is the first time I am facing this issue with maven build and I don't find any reason for it to behave vague. Experts suggestions will be highly appreciated. Thanks! On Tue, Jul 1, 2014 at 8:29 PM, Ritesh Kumar Singh riteshoneinamill...@gmail.com wrote: I guess u have both Java 6 and Java 7 installed in your PC. And now when you are trying to run hadoop, its forcing Giraph which is made for java 7 to to run on a java 6 jvm. I will suggest you to have a look in your .bashrc file for the default java version and try to make java 7 as the default JVM. Hope this helps On Tue, Jul 1, 2014 at 5:45 PM, Vineet Mishra clearmido...@gmail.com wrote: Hi All, I am new to Giraph and I am running quick example from http://giraph.apache.org/quick_start.html While running the Giraph job it is throwing java class version error, although I am having Java and Javac set to version 7 still I don't have any nerve why is this happening. *Running command :* hadoop jar /usr/local/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /home/user/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /home/user/output/shortestpaths -w 1 *Error Trace :* Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:266) at org.apache.hadoop.util.RunJar.main(RunJar.java:149) Version Used : Hadoop 1.1.2 Java 1.7 Any help would be highly appreciated. Thanks in advance!
Re: Giraph Basic Job Run
Hi, I've had this error before. Code compiled on Java 7 and bashrc file setting JAVA_HOME to Java 7, but still get this error. For me, the reason was because the Hadoop processes were still running on Java 6. This is was because, in hadoop-env.sh, I had set JAVA_HOME to point to Java 6. So, the processes were running on Java 6 and it wasn't able to run the code compiled in Java 7. Check out on which Java your Hadoop processes are running. Hope this helps Regards, Sundar On Wed, Jul 2, 2014 at 12:18 PM, Vineet Mishra clearmido...@gmail.com wrote: Hi Ritesh, As far as I have checked this error Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 usually comes when the code compilation is done in one version and code is run in another version(usually lower) but I have explicitly set java 7 for compilation while packaging the project and moreover I have Java 7 set in classpath(referred bashrc) and this error Unsupported major.minor version 51.0 itself says that the compilation is done in java 7. So does that mean my Java is taking lower version than Java 7 even though I am able to see the classpath set to Java 7. java version 1.7.0_21 Java(TM) SE Runtime Environment (build 1.7.0_21-b11) Java HotSpot(TM) 64-Bit Server VM (build 23.21-b01, mixed mode) Although I have faced this classversion error several times while running code from eclipse but this is the first time I am facing this issue with maven build and I don't find any reason for it to behave vague. Experts suggestions will be highly appreciated. Thanks! On Tue, Jul 1, 2014 at 8:29 PM, Ritesh Kumar Singh riteshoneinamill...@gmail.com wrote: I guess u have both Java 6 and Java 7 installed in your PC. And now when you are trying to run hadoop, its forcing Giraph which is made for java 7 to to run on a java 6 jvm. I will suggest you to have a look in your .bashrc file for the default java version and try to make java 7 as the default JVM. Hope this helps On Tue, Jul 1, 2014 at 5:45 PM, Vineet Mishra clearmido...@gmail.com wrote: Hi All, I am new to Giraph and I am running quick example from http://giraph.apache.org/quick_start.html While running the Giraph job it is throwing java class version error, although I am having Java and Javac set to version 7 still I don't have any nerve why is this happening. *Running command :* hadoop jar /usr/local/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /home/user/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /home/user/output/shortestpaths -w 1 *Error Trace :* Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:266) at org.apache.hadoop.util.RunJar.main(RunJar.java:149) Version Used : Hadoop 1.1.2 Java 1.7 Any help would be highly appreciated. Thanks in advance!
Re: Giraph Basic Job Run
Thanks man! This works. (Y) On Wed, Jul 2, 2014 at 12:51 PM, Sundara Raghavan Sankaran sun...@crayondata.com wrote: Hi, I've had this error before. Code compiled on Java 7 and bashrc file setting JAVA_HOME to Java 7, but still get this error. For me, the reason was because the Hadoop processes were still running on Java 6. This is was because, in hadoop-env.sh, I had set JAVA_HOME to point to Java 6. So, the processes were running on Java 6 and it wasn't able to run the code compiled in Java 7. Check out on which Java your Hadoop processes are running. Hope this helps Regards, Sundar On Wed, Jul 2, 2014 at 12:18 PM, Vineet Mishra clearmido...@gmail.com wrote: Hi Ritesh, As far as I have checked this error Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 usually comes when the code compilation is done in one version and code is run in another version(usually lower) but I have explicitly set java 7 for compilation while packaging the project and moreover I have Java 7 set in classpath(referred bashrc) and this error Unsupported major.minor version 51.0 itself says that the compilation is done in java 7. So does that mean my Java is taking lower version than Java 7 even though I am able to see the classpath set to Java 7. java version 1.7.0_21 Java(TM) SE Runtime Environment (build 1.7.0_21-b11) Java HotSpot(TM) 64-Bit Server VM (build 23.21-b01, mixed mode) Although I have faced this classversion error several times while running code from eclipse but this is the first time I am facing this issue with maven build and I don't find any reason for it to behave vague. Experts suggestions will be highly appreciated. Thanks! On Tue, Jul 1, 2014 at 8:29 PM, Ritesh Kumar Singh riteshoneinamill...@gmail.com wrote: I guess u have both Java 6 and Java 7 installed in your PC. And now when you are trying to run hadoop, its forcing Giraph which is made for java 7 to to run on a java 6 jvm. I will suggest you to have a look in your .bashrc file for the default java version and try to make java 7 as the default JVM. Hope this helps On Tue, Jul 1, 2014 at 5:45 PM, Vineet Mishra clearmido...@gmail.com wrote: Hi All, I am new to Giraph and I am running quick example from http://giraph.apache.org/quick_start.html While running the Giraph job it is throwing java class version error, although I am having Java and Javac set to version 7 still I don't have any nerve why is this happening. *Running command :* hadoop jar /usr/local/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.2.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vip /home/user/input/tiny_graph.txt -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /home/user/output/shortestpaths -w 1 *Error Trace :* Exception in thread main java.lang.UnsupportedClassVersionError: org/apache/giraph/GiraphRunner : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:321) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:266) at org.apache.hadoop.util.RunJar.main(RunJar.java:149) Version Used : Hadoop 1.1.2 Java 1.7 Any help would be highly appreciated. Thanks in advance!
java.lang.Throwable: Child Error
i've got this problem running my code for a simpleSelectComputation: java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258 i don't know what does it mean but if it referes to mapred.child.java.opts in which way will i have to change this value? who can help me?
Re: Couldn't instantiate
Hi Carmen,
Glad that one problem is fixed, and I can take a look at this one as well.
--John
Sent from my iPhone
On Jul 2, 2014, at 6:50 AM, Carmen Manzulli carmenmanzu...@gmail.com wrote:
ok; i've done what you have told me...but now i've got this problem..
ava.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
this is my Computation code:
import org.apache.giraph.GiraphRunner;
import org.apache.giraph.graph.BasicComputation;
import org.apache.giraph.graph.Vertex;
import org.apache.giraph.edge.Edge;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.io.NullWritable;
import org.apache.hadoop.util.ToolRunner;
public class SimpleSelectionComputation extends
BasicComputationText,NullWritable,Text,NullWritable {
@Override
public void compute(VertexText,NullWritable,Text
vertex,IterableNullWritable messages){
Text source = new Text(http://dbpedia.org/resource/1040s;);
if (getSuperstep()==0)
{
if(vertex.getId()==source)
{
System.out.println(il soggetto +vertex.getId()+ ha i
seguenti predicati e oggetti:);
for(EdgeText,Text e : vertex.getEdges())
{
System.out.println(e.getValue()+\t+e.getTargetVertexId());
}
}
vertex.voteToHalt();
}
}
public static void main(String[] args) throws Exception {
System.exit(ToolRunner.run(new GiraphRunner(), args));
}
}
Re: Couldn't instantiate
Hi Carmen,
Please post more of the exception stack trace, not enough here for me to
figure anything out. :)
Thanks
--John
On Wed, Jul 2, 2014 at 7:33 AM, soozandjohny...@gmail.com wrote:
Hi Carmen,
Glad that one problem is fixed, and I can take a look at this one as well.
--John
Sent from my iPhone
On Jul 2, 2014, at 6:50 AM, Carmen Manzulli carmenmanzu...@gmail.com
wrote:
ok; i've done what you have told me...but now i've got this problem..
ava.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258)
this is my Computation code:
import org.apache.giraph.GiraphRunner;
import org.apache.giraph.graph.BasicComputation;
import org.apache.giraph.graph.Vertex;
import org.apache.giraph.edge.Edge;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.io.NullWritable;
import org.apache.hadoop.util.ToolRunner;
public class SimpleSelectionComputation extends
BasicComputationText,NullWritable,Text,NullWritable {
@Override
public void compute(VertexText,NullWritable,Text
vertex,IterableNullWritable messages){
Text source = new Text(http://dbpedia.org/resource/1040s;);
if (getSuperstep()==0)
{
if(vertex.getId()==source)
{
System.out.println(il soggetto +vertex.getId()+ ha i
seguenti predicati e oggetti:);
for(EdgeText,Text e : vertex.getEdges())
{
System.out.println(e.getValue()+\t+e.getTargetVertexId());
}
}
vertex.voteToHalt();
}
}
public static void main(String[] args) throws Exception {
System.exit(ToolRunner.run(new GiraphRunner(), args));
}
}
Re: Couldn't instantiate
ok course :) ! java.lang.Throwable: Child Error at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271) Caused by: java.io.IOException: Task process exit with nonzero status of 1. at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:258) and from the command line: /../lib/commons-beanutils-1.7.0.jar:/usr/local/hadoop/libexec/../lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoop/libexec/../lib/commons-cli-1.2.jar:/usr/local/hadoop/libexec/../lib/commons-codec-1.4.jar:/usr/local/hadoop/libexec/../lib/commons-collections-3.2.1.jar:/usr/local/hadoop/libexec/../lib/commons-configuration-1.6.jar:/usr/local/hadoop/libexec/../lib/commons-daemon-1.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-digester-1.8.jar:/usr/local/hadoop/libexec/../lib/commons-el-1.0.jar:/usr/local/hadoop/libexec/../lib/commons-httpclient-3.0.1.jar:/usr/local/hadoop/libexec/../lib/commons-io-2.1.jar:/usr/local/hadoop/libexec/../lib/commons-lang-2.4.jar:/usr/local/hadoop/libexec/../lib/commons-logging-1.1.1.jar:/usr/local/hadoop/libexec/../lib/commons-logging-api-1.0.4.jar:/usr/local/hadoop/libexec/../lib/commons-math-2.1.jar:/usr/local/hadoop/libexec/../lib/commons-net-3.1.jar:/usr/local/hadoop/libexec/../lib/core-3.1.1.jar:/usr/local/hadoop/libexec/../lib/hadoop-capacity-scheduler-1.2.1.jar:/usr/local/hadoop/libexec/../lib/hadoop-fairscheduler-1.2.1.jar:/usr/local/hadoop/libexec/../lib/hadoop-thriftfs-1.2.1.jar:/usr/local/hadoop/libexec/../lib/hsqldb-1.8.0.10.jar:/usr/local/hadoop/libexec/../lib/jackson-core-asl-1.8.8.jar:/usr/local/hadoop/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/usr/local/hadoop/libexec/../lib/jasper-compiler-5.5.12.jar:/usr/local/hadoop/libexec/../lib/jasper-runtime-5.5.12.jar:/usr/local/hadoop/libexec/../lib/jdeb-0.8.jar:/usr/local/hadoop/libexec/../lib/jersey-core-1.8.jar:/usr/local/hadoop/libexec/../lib/jersey-json-1.8.jar:/usr/local/hadoop/libexec/../lib/jersey-server-1.8.jar:/usr/local/hadoop/libexec/../lib/jets3t-0.6.1.jar:/usr/local/hadoop/libexec/../lib/jetty-6.1.26.jar:/usr/local/hadoop/libexec/../lib/jetty-util-6.1.26.jar:/usr/local/hadoop/libexec/../lib/jsch-0.1.42.jar:/usr/local/hadoop/libexec/../lib/junit-4.5.jar:/usr/local/hadoop/libexec/../lib/kfs-0.2.2.jar:/usr/local/hadoop/libexec/../lib/log4j-1.2.15.jar:/usr/local/hadoop/libexec/../lib/mockito-all-1.8.5.jar:/usr/local/hadoop/libexec/../lib/oro-2.0.8.jar:/usr/local/hadoop/libexec/../lib/servlet-api-2.5-20081211.jar:/usr/local/hadoop/libexec/../lib/slf4j-api-1.4.3.jar:/usr/local/hadoop/libexec/../lib/slf4j-log4j12-1.4.3.jar:/usr/local/hadoop/libexec/../lib/xmlenc-0.52.jar:/usr/local/hadoop/libexec/../lib/jsp-2.1/jsp-2.1.jar:/usr/local/hadoop/libexec/../lib/jsp-2.1/jsp-api-2.1.jar 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.library.path=/usr/local/hadoop/libexec/../lib/native/Linux-amd64-64:/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201407021315_0003/attempt_201407021315_0003_m_00_0/work 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201407021315_0003/attempt_201407021315_0003_m_00_0/work/tmp 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:java.compiler=NA 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.name=Linux 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.arch=amd64 2014-07-02 15:49:17,492 INFO org.apache.zookeeper.ZooKeeper: Client environment:os.version=3.11.0-24-generic 2014-07-02 15:49:17,493 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.name=hduser 2014-07-02 15:49:17,493 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.home=/home/hduser 2014-07-02 15:49:17,493 INFO org.apache.zookeeper.ZooKeeper: Client environment:user.dir=/app/hadoop/tmp/mapred/local/taskTracker/hduser/jobcache/job_201407021315_0003/attempt_201407021315_0003_m_00_0/work 2014-07-02 15:49:17,493 INFO org.apache.zookeeper.ZooKeeper: Initiating client connection, connectString=carmen-HP-Pavilion-Sleekbook-15:22181 sessionTimeout=6 watcher=org.apache.giraph.master.BspServiceMaster@465962c4 2014-07-02 15:49:17,509 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server carmen-HP-Pavilion-Sleekbook-15/127.0.1.1:22181. Will not attempt to authenticate using SASL (unknown error) 2014-07-02 15:49:17,509 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to carmen-HP-Pavilion-Sleekbook-15/127.0.1.1:22181, initiating session 2014-07-02 15:49:17,515 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server carmen-HP-Pavilion-Sleekbook-15/127.0.1.1:22181, sessionid = 0x146f756106b0001, negotiated timeout = 60 2014-07-02 15:49:17,516 INFO org.apache.giraph.bsp.BspService: process: Asynchronous connection complete. 2014-07-02 15:49:17,530 INFO
Hadoop 2.3.0 - UnknownHostException: Invalid host name: local host is (unknown)
I've recently upgraded my Hadoop instance from 0.20.2 to 2.3.0. I've verified that M/R jobs work correctly on the instance and am in the process of verifying that the instance is capable of executing Giraph jobs successfully. I'm currently trying to run the SimpleShortestPathsComputation from the examples and have encountered an error. Here's an excerpt from the log... ERROR [org.apache.hadoop.yarn.client.api.async.impl.NMClientAsyncImpl #0] yarn.GiraphApplicationMaster (GiraphApplicationMaster.java:onStartContainerError(688)) - Failed to start Container container_... java.net.UnknownHostException: Invalid host name: local host is: (unknown)... The command I'm using to execute the job is... $HADOOP_HOME/bin/hadoop jar $GIRAPH_COMPLETE_JAR \ org.apache.giraph.GiraphRunner \ org.apache.giraph.examples.SimpleShortestPathsComputation \ -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat \ -vip tiny.txt \ -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat \ -op shortest-paths \ -w 1 \ -yj $GIRAPH_COMPLETE_JAR I'm guessing that something isn't configured correctly in my Hadoop instance or I'm missing a parameter in the execution of the job. Note that I have also tried tacking on the following additional parameters and I still see the error... -ca giraph.zkList=localhost:2181 -ca giraph.SplitMasterWorker=true -ca mapred.job.tracker=54311 -ca mapreduce.job.tracker=54311 Any idea what might be wrong? Larry
