Yeah, I'm getting it too. I'll dive in and take a look. FYI, I usually build with the "-Dcrunch.platform=2" option.
On Tue, Jan 22, 2013 at 3:01 PM, Whitacre,Micah <[email protected]>wrote: > For my code I'm maintaining a fork of Crunch simply because I target the > CDH4.1.x endstates. When consuming the latest changes the tests are > however failing. > > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.113 sec > <<< FAILURE! > testJoin(org.apache.crunch.lib.join.MultiAvroSchemaJoinIT) Time elapsed: > 1.113 sec <<< ERROR! > org.apache.crunch.CrunchRuntimeException: java.io.IOException: No files > found to materialize at: > /var/folders/0f/l_2w0gxd0p15k9410b18j8q40000gp/T/junit6697703972065781019/tmp-crunch.tmp.dir/crunch-1096140411/p1 > at > org.apache.crunch.materialize.MaterializableIterable.materialize(MaterializableIterable.java:70) > at org.apache.crunch.impl.mr.MRPipeline.run(MRPipeline.java:158) > at > org.apache.crunch.materialize.MaterializableIterable.iterator(MaterializableIterable.java:59) > at com.google.common.collect.Lists.newArrayList(Lists.java:119) > at > org.apache.crunch.lib.join.MultiAvroSchemaJoinIT.testJoin(MultiAvroSchemaJoinIT.java:116) > > The attachment are the only changes I've made to project and are just the > addition of a profile in the root pom.xml. To execute I ran "mvn clean > install -P cdh4". Reviewing the git log I don't see any major changes with > regard to how materialize or join were changed which seems to be related to > the issue. I think it might be related to CRUNCH-127 as that was the only > major change for writing data. > > Trying to compare my profile against the two existing I have noticed > failures when building one of the profiles. Specifically if I run "mvn > clean install" the build will run and complete successfully. However if I > specify the "hadoop-2" profile it fails with a similar exception. > > Executing the following at the root of the git repository. > mvn clean install -P hadoop-2 > > I get a failure during integration testing of crunch. > > Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.52 sec > <<< FAILURE! > testMapsideJoin(org.apache.crunch.lib.join.MapsideJoinIT) Time elapsed: > 2.434 sec <<< ERROR! > org.apache.crunch.CrunchRuntimeException: java.io.IOException: No files > found to materialize at: > /tmp/junit1288475102834326447/tmp-crunch.tmp.dir/crunch-2036458765/p3 > at > org.apache.crunch.materialize.MaterializableIterable.materialize(MaterializableIterable.java:70) > at org.apache.crunch.impl.mr.MRPipeline.run(MRPipeline.java:158) > at > org.apache.crunch.lib.join.MapsideJoinIT.runMapsideJoin(MapsideJoinIT.java:139) > at > org.apache.crunch.lib.join.MapsideJoinIT.testMapsideJoin(MapsideJoinIT.java:116) > > Details about my current setup for building: > > Git commit 75ba3546810fc27b4a6248559fefffd6c3eddb44 > > $ mvn -v > Apache Maven 3.0.4 (r1232337; 2012-01-17 02:44:56-0600) > Maven home: /usr/local/Cellar/maven/3.0.4/libexec > Java version: 1.6.0_37, vendor: Apple Inc. > Java home: /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home > Default locale: en_US, platform encoding: MacRoman > OS name: "mac os x", version: "10.7.5", arch: "x86_64", family: "mac" > > I accept responsibility about maintaining the CDH4 support but I'm > curious, am I building the project correctly? Is this a local setup issue > and not something others encounter as well? > > > CONFIDENTIALITY NOTICE This message and any included attachments are from > Cerner Corporation and are intended only for the addressee. The information > contained in this message is confidential and may constitute inside or > non-public information under international, federal, or state securities > laws. Unauthorized forwarding, printing, copying, distribution, or use of > such information is strictly prohibited and may be unlawful. If you are not > the addressee, please promptly delete this message and notify the sender of > the delivery error by e-mail or you may call Cerner's corporate offices in > Kansas City, Missouri, U.S.A at (+1) (816)221-1024. > -- Director of Data Science Cloudera <http://www.cloudera.com> Twitter: @josh_wills <http://twitter.com/josh_wills>
