The reason is that the particular computation (SimpleShortestPathsComputation) is expecting vertices with Long ids, while the EdgeInputFormat is parsing Integers. You have to fix one of the two accordingly.
On Mon, Jun 3, 2013 at 11:22 PM, Peter Holland <d99991...@mydit.ie> wrote: > Thank you for your response Claudio. > > I updated the command with the input class you suggested. > > *bin/hadoop jar > /home/ubuntu/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar > * > * org.apache.giraph.GiraphRunner > org.apache.giraph.examples.SimpleShortestPathsComputation * > *-eif org.apache.giraph.io.formats.IntNullTetxEdgeInputFormat* > *-eip /simpleEdgeList/SimpleEdgeList.tsv* > *-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat * > *-op /outShortestEdgeList01 * > *-w 1* > > Unfortunately I am getting an error message > > *13/06/03 23:00:08 INFO utils.ConfigurationUtils: No vertex input format > specified. Ensure your InputFormat does not require one.* > *Exception in thread "main" java.lang.IllegalArgumentException: > checkClassTypes: Vertex index types don't match, vertex - class > org.apache.hadoop.io.LongWritable, edge input format - class > org.apache.hadoop.io.IntWritable* > * at > org.apache.giraph.job.GiraphConfigurationValidator.verifyEdgeInputFormatGenericTypes(GiraphConfigurationValidator.java:266) > * > * at > org.apache.giraph.job.GiraphConfigurationValidator.validateConfiguration(GiraphConfigurationValidator.java:125) > * > * at > org.apache.giraph.utils.ConfigurationUtils.parseArgs(ConfigurationUtils.java:155) > * > * at org.apache.giraph.GiraphRunner.run(GiraphRunner.java:74)* > * at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)* > * at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)* > * at org.apache.giraph.GiraphRunner.main(GiraphRunner.java:124)* > * at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)* > * at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > * > * at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > * > * at java.lang.reflect.Method.invoke(Method.java:597)* > * at org.apache.hadoop.util.RunJar.main(RunJar.java:156)* > > > On 3 June 2013 21:00, Claudio Martella <claudio.marte...@gmail.com> wrote: > >> with the only problem that you picked an abstract class again... >> I advised you to use an inputformat that has the name of the types in the >> class name, hence org.apache.giraph.io.formats.IntNullTextEdgeInputFormat >> should work for you. >> >> >> On Mon, Jun 3, 2013 at 9:34 PM, Peter Holland <d99991...@mydit.ie> wrote: >> >>> Thank you for the advice Claudio >>> >>> I updated the run command to use different io classes >>> >>> *bin/hadoop jar >>> /home/ubuntu/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar >>> * >>> * org.apache.giraph.GiraphRunner >>> org.apache.giraph.examples.SimpleShortestPathsComputation * >>> *-eif org.apache.giraph.io.EdgeInputFormat* >>> * -eip /simpleEdgeList/SimpleEdgeList.tsv* >>> *-of org.apache.giraph.io.formats.IdWithValueTextOutputFormat * >>> *-op /outShortestEdgeList01 * >>> *-w 1* >>> * >>> * >>> This code does start a MapReduce job but progress stays at 0%. The log >>> file for the job has the following IOException error; >>> >>> *MapAttempt TASK_TYPE="MAP" TASKID="task_201306031954_0002_m_000000" >>> TASK_ATTEMPT_ID="attempt_201306031954_0002_m_000000_0" TASK_STATUS="FAILED" >>> FINISH_TIME="1370282492527" HOSTNAME="ubuntu-VirtualBox" >>> ERROR="java\.lang\.Throwable: Child Error* >>> * at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:271)* >>> *Caused by: java\.io\.IOException: Task process exit with nonzero >>> status of 1\.* >>> * at org\.apache\.hadoop\.mapred\.TaskRunner\.run(TaskRunner\.java:258)* >>> >>> So, this leaves 3 questions; >>> Is the edge list file format correct? (a tab separated file with a .tsv >>> extension) >>> Is the input class correct? >>> Is the output class correct? >>> >>> Thank you, >>> Peter >>> >>> >>> >>> >>> On 3 June 2013 01:05, Claudio Martella <claudio.marte...@gmail.com>wrote: >>> >>>> Hi Peter, >>>> >>>> shortly, those are abstract classes, that's why you cannot instantiate >>>> them. You'll have to use a specific class extending those classes that are >>>> aware of the types of the signature of the vertex (I, V, E, M). check out >>>> some classes in the format package that have those types in the class name. >>>> >>>> >>>> On Mon, Jun 3, 2013 at 1:25 AM, Peter Holland <d99991...@mydit.ie>wrote: >>>> >>>>> Hello, >>>>> I'm new to Giraph and I'm trying to run SimpleShortestPathsComputation >>>>> using an edge list input file. I have some questions and and error message >>>>> that hopefully I can get some help with. >>>>> >>>>> Edge List File Format >>>>> What is the correct format for an edge list input file? >>>>> I have a .tsv file with a vertex represented as an integer. Is this >>>>> correct? >>>>> >>>>> 5 11 >>>>> 1 6 >>>>> 6 9 >>>>> 6 8 >>>>> 8 9 >>>>> ..... >>>>> >>>>> Input File Class: >>>>> Is org.apache.giraph.io.formats.*TextEdgeInputFormat *the only input >>>>> format that can be used for edge lists? >>>>> >>>>> Output File Class: >>>>> Does the output format depend on the job you are running? I have been >>>>> using org.apache.giraph.io.formats.*TextVertexOutputFormat* for >>>>> SimpleShortestPathsComputation. >>>>> >>>>> Run Command: >>>>> So this is the command I am using to try to run the >>>>> SimpleShortestPathsComputation using an edge list input file. >>>>> >>>>> *bin/hadoop jar >>>>> /home/ubuntu/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar >>>>> org.apache.giraph.GiraphRunner >>>>> org.apache.giraph.examples.SimpleShortestPathsComputation * >>>>> *-eif org.apache.giraph.io.formats.TextEdgeInputFormat * >>>>> *-eip /simpleEdgeList/SimpleEdgeList.tsv * >>>>> *-of org.apache.giraph.io.formats.TextVertexOutputFormat * >>>>> *-op /outShortest* >>>>> *-w 3* >>>>> >>>>> Error Message >>>>> When I run the above command I get the following error message: >>>>> Exception in thread "main" java.lang.IllegalStateException: >>>>> newInstance: Couldn't instantiate >>>>> org.apache.giraph.io.formats.TextVertexOutputFormat >>>>> >>>>> Thank you, >>>>> Peter >>>>> >>>> >>>> >>>> >>>> -- >>>> Claudio Martella >>>> claudio.marte...@gmail.com >>>> >>> >>> >> >> >> -- >> Claudio Martella >> claudio.marte...@gmail.com >> > > -- Claudio Martella claudio.marte...@gmail.com
