I've managed to get giraph-formats-contrib to build successfully by removing
<!--type>test-jar</type--> from the pom dependency for giraph. That allows maven to match with the giraph jar I installed locally. I realise I'm missing some knowledge about maven having not used it much before - so help appreciated. I'd like to make changes to my environment or whatever to allow trunk to build from a clean checkout as I'm sure it does for you guys. rob On Thu, Nov 8, 2012 at 2:35 PM, Rob Styles <r...@dynamicorange.com> wrote: > Hi, > > I'm building Giraph on a VM with CDH4 installed and running. I'll be > running jobs on a 6 machine cluster running CDH4. > > I've checked out trunk and attempted a build. Giraph builds successfully > but giraph-formats-contrib fails to build with a failure to find Giraph. > > I'd like to make use of HBase as my storage, possibly combining the Girpah > output format with a Vertere (https://github.com/mmmmmrob/Vertere), a > tool I use to convert tabular data into a graph (currently RDF). > > I've tried installing the giraph jar into my local maven cache with > > mvn install:install-file > -Dfile=giraph/target/giraph-0.2-SNAPSHOT-for-hadoop-2.0.0-alpha-jar-with-dependencies.jar > -DgroupId=org.apache.giraph -DartifactId=giraph -Dversion=0.2-SNAPSHOT > -Dpackaging=jar > > That seems to make no difference AFAICT. > > Any help appreciated. > > Build output below: > > [robst@data giraph]$ mvn clean compile > [INFO] Scanning for projects... > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Build Order: > [INFO] > [INFO] Apache Giraph Parent > [INFO] Apache Giraph > [INFO] Apache Giraph Formats > [INFO] > > [INFO] > ------------------------------------------------------------------------ > [INFO] Building Apache Giraph Parent 0.2-SNAPSHOT > [INFO] > ------------------------------------------------------------------------ > [INFO] > [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ parent --- > [INFO] > > [INFO] > ------------------------------------------------------------------------ > [INFO] Building Apache Giraph 0.2-SNAPSHOT > [INFO] > ------------------------------------------------------------------------ > [INFO] > [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ giraph --- > [INFO] Deleting /home/robst/giraph/giraph/target > [INFO] > [INFO] --- maven-enforcer-plugin:1.0.1:enforce (enforce-maven) @ giraph --- > [INFO] > [INFO] --- munge-maven-plugin:1.0:munge (munge) @ giraph --- > [INFO] > [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ > giraph --- > [debug] execute contextualize > [INFO] Using 'UTF-8' encoding to copy filtered resources. > [INFO] skip non existing resourceDirectory > /home/robst/giraph/giraph/src/main/resources > [INFO] > [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ giraph > --- > [INFO] Compiling 331 source files to > /home/robst/giraph/giraph/target/munged/classes > [INFO] > [INFO] --- maven-assembly-plugin:2.3:single (build-fat-jar) @ giraph --- > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/NOTICE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/NOTICE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/ASL2.0 already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] Building jar: > /home/robst/giraph/giraph/target/giraph-0.2-SNAPSHOT-for-hadoop-0.20.203.0-jar-with-dependencies.jar > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/NOTICE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/NOTICE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/LICENSE.txt already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/ASL2.0 already added, skipping > [INFO] META-INF/NOTICE already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] META-INF/MANIFEST.MF already added, skipping > [INFO] > > [INFO] > ------------------------------------------------------------------------ > [INFO] Building Apache Giraph Formats 0.2-SNAPSHOT > [INFO] > ------------------------------------------------------------------------ > [WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to > local.repository (file:../../local.repository/trunk): No connector > available to access repository local.repository > (file:../../local.repository/trunk) of type legacy using the available > factories WagonRepositoryConnectorFactory > [WARNING] The POM for org.apache.hadoop:hadoop-core:jar:0.20.1 is missing, > no dependency information available > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Giraph Parent .............................. SUCCESS [0.202s] > [INFO] Apache Giraph ..................................... SUCCESS > [11.186s] > [INFO] Apache Giraph Formats ............................. FAILURE [0.381s] > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 11.984s > [INFO] Finished at: Thu Nov 08 14:28:41 GMT 2012 > [INFO] Final Memory: 29M/494M > [INFO] > ------------------------------------------------------------------------ > [ERROR] Failed to execute goal on project giraph-formats-contrib: Could > not resolve dependencies for project > org.apache.giraph:giraph-formats-contrib:jar:0.2-SNAPSHOT: Failure to find > org.apache.giraph:giraph:jar:tests:0.2-SNAPSHOT in > http://repo1.maven.org/maven2 was cached in the local repository, > resolution will not be reattempted until the update interval of central has > elapsed or updates are forced -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :giraph-formats-contrib > >
