Re: Giraph (1.1.0-SNAPSHOT and 1.0.0-RC3) unit tests fail
Hi Roman. I checked out release-1.1.0-RC0 and succeeded to build it. $ git checkout release-1.1.0-RC0 $ mvn clean $ mvn package -Phadoop_2 -DskipTests ## SUCCESS However, when I ran the tests with LocalJobRunner, it failed. $ mvn clean $ mvn package -Phadoop_2 It passed tests from Core and Examples, but it failed at Accumulo I/O. testAccumuloInputOutput(org.apache.giraph.io.accumulo.TestAccumuloVertexFormat) The error log contained the following exception java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected Next I wanted to run the tests with a running Hadoop2 instance, but I'm having trouble to set it up (I'm quite new to Hadoop). Could you show me some example configuration (etc/hadoop/* files) of Hadoop 2.2.0 single-node cluster? That would be very helpful. On Sun, Jun 29, 2014 at 5:06 PM, Toshio ITO toshio9@toshiba.co.jp wrote: Hi Roman. Thanks for the reply. OK, I'll try hadoop_1 and hadoop_2 with the latest release-1.1.0-RC0 and report the result. That would be extremely helpful! And speaking of which -- I'd like to remind folks that taking RC0 for a spin would really help at this point. If we ever want to have 1.1.0 out we need the required PMC votes. Thanks, Roman. Toshio Ito
Re: Giraph (1.1.0-SNAPSHOT and 1.0.0-RC3) unit tests fail
Hi Roman, I got the same error when running hadoop_2 profile. According to this [1] the Accumulo version we use in giraph (1.4) is not compatible with Hadoop 2. I think this is the issue. [1] http://apache-accumulo.1065345.n5.nabble.com/Accumulo-Hadoop-version-compatibility-matrix-tp3893p3894.html Thanks Akila On Mon, Jun 30, 2014 at 2:21 PM, Toshio ITO toshio9@toshiba.co.jp wrote: Hi Roman. I checked out release-1.1.0-RC0 and succeeded to build it. $ git checkout release-1.1.0-RC0 $ mvn clean $ mvn package -Phadoop_2 -DskipTests ## SUCCESS However, when I ran the tests with LocalJobRunner, it failed. $ mvn clean $ mvn package -Phadoop_2 It passed tests from Core and Examples, but it failed at Accumulo I/O. testAccumuloInputOutput(org.apache.giraph.io.accumulo.TestAccumuloVertexFormat) The error log contained the following exception java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected Next I wanted to run the tests with a running Hadoop2 instance, but I'm having trouble to set it up (I'm quite new to Hadoop). Could you show me some example configuration (etc/hadoop/* files) of Hadoop 2.2.0 single-node cluster? That would be very helpful. On Sun, Jun 29, 2014 at 5:06 PM, Toshio ITO toshio9@toshiba.co.jp wrote: Hi Roman. Thanks for the reply. OK, I'll try hadoop_1 and hadoop_2 with the latest release-1.1.0-RC0 and report the result. That would be extremely helpful! And speaking of which -- I'd like to remind folks that taking RC0 for a spin would really help at this point. If we ever want to have 1.1.0 out we need the required PMC votes. Thanks, Roman. Toshio Ito
Couldn't instantiate
Hi, I'm trying to run a selectionComputation with my own code for VertexInputFormat but giraph' job starts to work and then fails with: java.lang.IllegalStateException: run: Caught an unrecoverable exception newInstance: Couldn't instantiate sisinflab.SimpleRDFVertexInputFormat at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:101) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.IllegalStateException: newInstance: Couldn't instantiate sisinflab.SimpleRDFVertexInputFormat at org.apache.giraph.utils.ReflectionUtils.newInstance(ReflectionUtils.java:105) at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.createVertexInputFormat(ImmutableClassesGiraphConfiguration.java:235) at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.createWrappedVertexInputFormat(ImmutableClassesGiraphConfiguration.java:246) at org.apache.giraph.graph.GraphTaskManager.checkInput(GraphTaskManager.java:171) at org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:207) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:59) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:89) ... 7 more Caused by: java.lang.InstantiationException at sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at java.lang.Class.newInstance(Class.java:374) at org.apache.giraph.utils.ReflectionUtils.newInstance(ReflectionUtils.java:103) ... 13 more what does it mean? where is the problem? Who can help me? Carmen
Re: Couldn't instantiate
Hi Carmen, Question--did you only define an arguments constructor? If so, I think you are getting this because you did not define a no-arguments constructor with public visibility. If this is not the case, I recommend posting your source code and I will be happy to help. --John On Mon, Jun 30, 2014 at 9:38 AM, Carmen Manzulli carmenmanzu...@gmail.com wrote: Hi, I'm trying to run a selectionComputation with my own code for VertexInputFormat but giraph' job starts to work and then fails with: java.lang.IllegalStateException: run: Caught an unrecoverable exception newInstance: Couldn't instantiate sisinflab.SimpleRDFVertexInputFormat at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:101) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:364) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.lang.IllegalStateException: newInstance: Couldn't instantiate sisinflab.SimpleRDFVertexInputFormat at org.apache.giraph.utils.ReflectionUtils.newInstance(ReflectionUtils.java:105) at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.createVertexInputFormat(ImmutableClassesGiraphConfiguration.java:235) at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.createWrappedVertexInputFormat(ImmutableClassesGiraphConfiguration.java:246) at org.apache.giraph.graph.GraphTaskManager.checkInput(GraphTaskManager.java:171) at org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:207) at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:59) at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:89) ... 7 more Caused by: java.lang.InstantiationException at sun.reflect.InstantiationExceptionConstructorAccessorImpl.newInstance(InstantiationExceptionConstructorAccessorImpl.java:48) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at java.lang.Class.newInstance(Class.java:374) at org.apache.giraph.utils.ReflectionUtils.newInstance(ReflectionUtils.java:103) ... 13 more what does it mean? where is the problem? Who can help me? Carmen
