Alejandro, I was reading here that we need to use Sun JDK instead of Open JDK.
http://stackoverflow.com/questions/1124771/how-to-solve-java-io-ioexception-error-12-cannot-allocate-memory-calling-run Actually, I am using Open JDK right now. Should I installed Sun JDK 6 or Oracle JDK 7? Which is more compatible with Hadoop? Thanks, Lenin On Tue, May 28, 2013 at 10:25 PM, Alejandro Abdelnur <t...@cloudera.com>wrote: > Lenin, > > it seems you have some memory issues in your setup. Please run mvn using > the -X option, that will give more information about the failure. > > thanks > > > On Tue, May 28, 2013 at 8:28 AM, Lenin Raj <emaille...@gmail.com> wrote: > > > Hello, > > > > I am skipping the tests for now. I am able to build everything except web > > app. See log below: > > > > [INFO] > > [INFO] --- maven-war-plugin:2.1:war (default-war) @ oozie-webapp --- > > [INFO] Packaging webapp > > [INFO] Assembling webapp [oozie-webapp] in > > [/usr/local/oozie/oozie/webapp/target/oozie-webapp-3.3.2] > > [INFO] Processing war project > > [INFO] Copying webapp webResources > > [/usr/local/oozie/oozie/webapp/target/site] to > > [/usr/local/oozie/oozie/webapp/target/oozie-webapp-3.3.2] > > [INFO] Copying webapp resources > > [/usr/local/oozie/oozie/webapp/src/main/webapp] > > [INFO] Processing overlay [ id org.apache.oozie:oozie-docs] > > [INFO] Webapp assembled in [4280 msecs] > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Apache Oozie Main ................................. SUCCESS > [0.926s] > > [INFO] Apache Oozie Client ............................... SUCCESS > > [20.394s] > > [INFO] Apache Oozie Hadoop 1.1.1.oozie-3.3.2 ............. SUCCESS > [4.919s] > > [INFO] Apache Oozie Hadoop Distcp 1.1.1.oozie-3.3.2 ...... SUCCESS > [0.196s] > > [INFO] Apache Oozie Hadoop 1.1.1.oozie-3.3.2 Test ........ SUCCESS > [0.633s] > > [INFO] Apache Oozie Hadoop 2.0.2-alpha.oozie-3.3.2 ....... SUCCESS > > [13.409s] > > [INFO] Apache Oozie Hadoop 2.0.2-alpha.oozie-3.3.2 Test .. SUCCESS > [0.598s] > > [INFO] Apache Oozie Hadoop Distcp 2.0.2-alpha.oozie-3.3.2 SUCCESS > [0.223s] > > [INFO] Apache Oozie Hadoop Libs .......................... SUCCESS > [7.645s] > > [INFO] Apache Oozie Hbase 0.94.2.oozie-3.3.2 ............. SUCCESS > [1.443s] > > [INFO] Apache Oozie Hbase Libs ........................... SUCCESS > [1.402s] > > [INFO] Apache Oozie Share Lib Pig ........................ SUCCESS > [6.292s] > > [INFO] Apache Oozie Share Lib Streaming .................. SUCCESS > [0.473s] > > [INFO] Apache Oozie Share Lib Distcp ..................... SUCCESS > [0.482s] > > [INFO] Apache Oozie Share Lib Hive ....................... SUCCESS > [9.513s] > > [INFO] Apache Oozie Share Lib Sqoop ...................... SUCCESS > [0.697s] > > [INFO] Apache Oozie Share Lib Oozie ...................... SUCCESS > [0.377s] > > [INFO] Apache Oozie Core ................................. SUCCESS > > [30.649s] > > [INFO] Apache Oozie Tests ................................ SUCCESS > [0.060s] > > [INFO] Apache Oozie Tests For Pig ........................ SUCCESS > [3.100s] > > [INFO] Apache Oozie Docs ................................. SUCCESS > > [23.886s] > > [INFO] Apache Oozie WebApp ............................... FAILURE > > [34.821s] > > [INFO] Apache Oozie Examples ............................. SKIPPED > > [INFO] Apache Oozie Share Lib ............................ SKIPPED > > [INFO] Apache Oozie Tools ................................ SKIPPED > > [INFO] Apache Oozie MiniOozie ............................ SKIPPED > > [INFO] Apache Oozie Distro ............................... SKIPPED > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] BUILD FAILURE > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Total time: 2:43.473s > > [INFO] Finished at: Tue May 28 20:54:14 IST 2013 > > [INFO] Final Memory: 72M/173M > > [INFO] > > ------------------------------------------------------------------------ > > [ERROR] Failed to execute goal > > org.apache.maven.plugins:maven-war-plugin:2.1:war (default-war) on > project > > oozie-webapp: Error assembling WAR: Failed to read filesystem attributes > > for: > > /usr/local/oozie/oozie/webapp/target/oozie-webapp-3.3.2/WEB-INF/web.xml: > > Failed to retrieve numeric file attributes using: '/bin/sh -c ls -1nlad > > /usr/local/oozie/oozie/webapp/target/oozie-webapp-3.3.2/WEB-INF/web.xml': > > Error while executing process. Cannot run program "/bin/sh": > > java.io.IOException: error=12, Cannot allocate memory -> [Help 1] > > [ERROR] > > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e > > switch. > > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > > [ERROR] > > [ERROR] For more information about the errors and possible solutions, > > please read the following articles: > > [ERROR] [Help 1] > > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > > [ERROR] > > [ERROR] After correcting the problems, you can resume the build with the > > command > > [ERROR] mvn <goals> -rf :oozie-webapp > > > > ERROR, Oozie distro creation failed > > > > I can spot that it fails at "Cannot run program "/bin/sh": > > java.io.IOException: error=12, Cannot allocate memory" > > > > > > Thanks, > > Lenin > > > > > > On Tue, May 28, 2013 at 8:53 PM, Alejandro Abdelnur <t...@cloudera.com > > >wrote: > > > > > Lenin, > > > > > > Can you please run mvn with the -X option? that would print a lot of > > > additional information from the build and may help identify what is the > > > issue. > > > > > > Thanks. > > > > > > > > > On Tue, May 28, 2013 at 8:16 AM, Lenin Raj <emaille...@gmail.com> > wrote: > > > > > > > root@li339-83:~/.m2/repository# rm -R * > > > > root@li339-83:~/.m2/repository# ls > > > > root@li339-83:~/.m2/repository# > > > > > > > > Ah! Now a little improvement over last time. I see two additional > lines > > > > > > > > *------------------------------------------------------- > > > > T E S T S > > > > ------------------------------------------------------- > > > > Concurrency config is parallel='classes', perCoreThreadCount=false, > > > > threadCount=1, useUnlimitedThreads=false > > > > Running org.apache.oozie.workflow.lite.TestLiteWorkflowLib > > > > Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 17.576 > > > sec > > > > ./bin/mkdistro.sh: line 71: 5878 Killed mvn clean > > > package > > > > assembly:single ${MVN_OPTS} "$@" > > > > > > > > ERROR, Oozie distro creation failed > > > > * > > > > Shall I try with -DskipTests? > > > > > > > > > > > > Thanks, > > > > Lenin > > > > > > > > > > > > On Tue, May 28, 2013 at 8:36 PM, Alejandro Abdelnur < > t...@cloudera.com > > > > >wrote: > > > > > > > > > Lenin, > > > > > > > > > > Even if using Maven 3, the cache is by default at ~/.m2/repository/ > > > > > > > > > > Please give that a try. > > > > > > > > > > Thanks > > > > > > > > > > > > > > > On Tue, May 28, 2013 at 8:00 AM, Lenin Raj <emaille...@gmail.com> > > > wrote: > > > > > > > > > > > Have the version 3.0.3 > > > > > > > > > > > > *root@li339-83:/usr/local/hadoop/hadoop# mvn --version* > > > > > > Apache Maven 3.0.3 (r1075438; 2011-02-28 23:01:09+0530) > > > > > > Maven home: /usr/share/maven3 > > > > > > Java version: 1.6.0_24, vendor: Sun Microsystems Inc. > > > > > > Java home: /usr/lib/jvm/java-6-openjdk/jre > > > > > > Default locale: en_US, platform encoding: UTF-8 > > > > > > OS name: "linux", version: "3.8.4-linode50", arch: "i386", > family: > > > > "unix" > > > > > > > > > > > > where can I locate .m3 cache dir? > > > > > > > > > > > > > > > > > > Thanks, > > > > > > Lenin > > > > > > > > > > > > > > > > > > On Tue, May 28, 2013 at 8:27 PM, Alejandro Abdelnur < > > > t...@cloudera.com > > > > > > >wrote: > > > > > > > > > > > > > odd, would you try using the latest version of maven and also > > > > trashing > > > > > > your > > > > > > > .m2 cache? > > > > > > > > > > > > > > Thanks. > > > > > > > > > > > > > > > > > > > > > On Tue, May 28, 2013 at 7:41 AM, Lenin Raj < > emaille...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > > > Hello, I tried after using that MAVEN_OPTS. > > > > > > > > > > > > > > > > But it fails with the same error at the same location. > > > > > > > > > > > > > > > > *root@li339-83:/usr/local/oozie/oozie# echo $MAVEN_OPTS > > > > > > > > -Xmx1024m* > > > > > > > > > > > > > > > > Any other pointers? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > Lenin > > > > > > > > > > > > > > > > > > > > > > > > On Tue, May 28, 2013 at 1:31 AM, Alejandro Abdelnur < > > > > > t...@cloudera.com > > > > > > > > >wrote: > > > > > > > > > > > > > > > > > Hi Lenin, > > > > > > > > > > > > > > > > > > We don't have binary distributions available. Would you try > > > > raising > > > > > > the > > > > > > > > > memory for Maven before running your build? > > > > > > > > > > > > > > > > > > $ export MAVEN_OPTS=-Xmx1024m > > > > > > > > > > > > > > > > > > Thanks > > > > > > > > > > > > > > > > > > > > > > > > > > > On Mon, May 27, 2013 at 11:27 AM, Lenin Raj < > > > > emaille...@gmail.com> > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > > > > > > > > > I was searching for the binary distribution of oozie > here: > > > > > > > > > > > > > > > > > > > > http://apache.mirrors.tds.net/oozie/3.3.2/ > > > > > > > > > > > > > > > > > > > > It has only the source distribution. *Is binary > > distribution > > > > not > > > > > > > > > > available?* > > > > > > > > > > > > > > > > > > > > So, I tried to build from this source using > > > > > > > > > > > > > > > > > > > > *./bin/mkdistro.sh* > > > > > > > > > > > > > > > > > > > > It went fine but stopped at a point: > > > > > > > > > > * > > > > > > > > > > [INFO] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------------------------ > > > > > > > > > > [INFO] Building Apache Oozie Core 3.3.2 > > > > > > > > > > [INFO] > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------------------------ > > > > > > > > > > [WARNING] Could not transfer metadata > > > > asm:asm/maven-metadata.xml > > > > > > > > from/to > > > > > > > > > > local.repository (file:../../local.repository/trunk): No > > > > > connector > > > > > > > > > > available to access repository local.repository > > > > > > > > > > (file:../../local.repository/trunk) of type legacy using > > the > > > > > > > available > > > > > > > > > > factories WagonRepositoryConnectorFactory > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-clean-plugin:2.4.1:clean > (default-clean) @ > > > > > > > oozie-core > > > > > > > > > --- > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-resources-plugin:2.5:resources > > > > > > (default-resources) @ > > > > > > > > > > oozie-core --- > > > > > > > > > > [debug] execute contextualize > > > > > > > > > > [INFO] Using 'UTF-8' encoding to copy filtered resources. > > > > > > > > > > [INFO] Copying 12 resources > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-compiler-plugin:2.3.2:compile > > > > (default-compile) > > > > > @ > > > > > > > > > > oozie-core --- > > > > > > > > > > [INFO] Compiling 385 source files to > > > > > > > > > > /usr/local/oozie/oozie/core/target/classes > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-antrun-plugin:1.6:run (default) @ > > oozie-core > > > > --- > > > > > > > > > > [INFO] Executing tasks > > > > > > > > > > > > > > > > > > > > main: > > > > > > > > > > [INFO] Executed tasks > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-dependency-plugin:2.4:build-classpath > > > > > > > > > > (create-mrapp-generated-classpath) @ oozie-core --- > > > > > > > > > > [INFO] Wrote classpath file > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > '/usr/local/oozie/oozie/core/target/test-classes/mrapp-generated-classpath'. > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-resources-plugin:2.5:testResources > > > > > > > > > (default-testResources) > > > > > > > > > > @ oozie-core --- > > > > > > > > > > [debug] execute contextualize > > > > > > > > > > [INFO] Using 'UTF-8' encoding to copy filtered resources. > > > > > > > > > > [INFO] Copying 79 resources > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-compiler-plugin:2.3.2:testCompile > > > > > > > > (default-testCompile) > > > > > > > > > @ > > > > > > > > > > oozie-core --- > > > > > > > > > > [INFO] Compiling 245 source files to > > > > > > > > > > /usr/local/oozie/oozie/core/target/test-classes > > > > > > > > > > [INFO] > > > > > > > > > > [INFO] --- maven-surefire-plugin:2.12:test > (default-test) @ > > > > > > > oozie-core > > > > > > > > > --- > > > > > > > > > > [INFO] Surefire report directory: > > > > > > > > > > /usr/local/oozie/oozie/core/target/surefire-reports > > > > > > > > > > > > > > > > > > > > ------------------------------------------------------- > > > > > > > > > > T E S T S > > > > > > > > > > ------------------------------------------------------- > > > > > > > > > > Concurrency config is parallel='classes', > > > > > perCoreThreadCount=false, > > > > > > > > > > threadCount=1, useUnlimitedThreads=false > > > > > > > > > > ./bin/mkdistro.sh: line 71: 6907 Killed > > mvn > > > > > clean > > > > > > > > > package > > > > > > > > > > assembly:single ${MVN_OPTS} "$@" > > > > > > > > > > > > > > > > > > > > ERROR, Oozie distro creation failed > > > > > > > > > > > > > > > > > > > > * > > > > > > > > > > *Can someone point me to the binary distribution or help > me > > > in > > > > > > > > resolving > > > > > > > > > > this build issue?* > > > > > > > > > > > > > > > > > > > > I have maven version 3. > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > Lenin > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > Alejandro > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Alejandro > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Alejandro > > > > > > > > > > > > > > > > > > > > > -- > > > Alejandro > > > > > > > > > -- > Alejandro >