[
https://issues.apache.org/jira/browse/MAPREDUCE-1897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12890932#action_12890932
]
Greg Roelofs commented on MAPREDUCE-1897:
-----------------------------------------
I've been working on the internal Yahoo branch for the last couple of weeks,
but I'll be switching back to trunk next week and will retry things then. I
don't have any further info at the moment.
What I think would be stupendously useful is if there were a way to make ant
mvn-install log everything it's doing--not just "I'm about to compile foo" but
literally "I'm cd'ing into this directory", "this is the exact command I'm
running", "here's the complete output from that command", etc. (i.e., what real
makefiles do). Then we could compare your verbose output with mine and maybe
figure out which dependency is broken.
(There are definitely broken dependencies, at least in the Y20 branch; editing
a mapreduce .java file, for example, causes it to be recompiled but not all of
its downstream artifacts to be rebuilt, which can result in unit tests
continuing to use the previous code. I don't understand this build system well
enough to figure out where the breakdown is. Current workaround is to blow
away the entire build directory each time. On trunk I've usually been able to
avoid this problem by manually copying jars from build to ~/.ivy2/cache/...,
but that's annoying, too.)
> trunk build broken on compile-mapred-test
> -----------------------------------------
>
> Key: MAPREDUCE-1897
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1897
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.22.0
> Environment: RHEL4 Linux, Java 1.6.0_15-b03
> Reporter: Greg Roelofs
> Assignee: Konstantin Boudnik
>
> ...apparently. Fresh checkout of trunk (all three hadoop-*),
> build.properties project.version fix, ant veryclean mvn-install of common,
> hdfs, and then mapreduce:
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:52:
> cannot access org.apache.hadoop.test.system.DaemonProtocol
> [javac] class file for org.apache.hadoop.test.system.DaemonProtocol not
> found
> [javac] static class FakeJobTracker extends JobTracker {
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:60:
> non-static variable this cannot be referenced from a static context
> [javac] this.trackers = tts;
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:60:
> cannot find symbol
> [javac] symbol : variable trackers
> [javac] location: class org.apache.hadoop.mapred.FakeObjectUtilities
> [javac] this.trackers = tts;
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:67:
> cannot find symbol
> [javac] symbol : method taskTrackers()
> [javac] location: class
> org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker
> [javac] taskTrackers().size() - getBlacklistedTrackerCount(),
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:67:
> cannot find symbol
> [javac] symbol : method getBlacklistedTrackerCount()
> [javac] location: class
> org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker
> [javac] taskTrackers().size() - getBlacklistedTrackerCount(),
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:68:
> cannot find symbol
> [javac] symbol : method getBlacklistedTrackerCount()
> [javac] location: class
> org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker
> [javac] getBlacklistedTrackerCount(), 0, 0, 0, totalSlots/2,
> totalSlots/2,
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:64:
> method does not override or implement a method from a supertype
> [javac] @Override
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:73:
> non-static variable this cannot be referenced from a static context
> [javac] this.totalSlots = totalSlots;
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/FakeObjectUtilities.java:73:
> cannot find symbol
> [javac] symbol : variable totalSlots
> [javac] location: class org.apache.hadoop.mapred.FakeObjectUtilities
> [javac] this.totalSlots = totalSlots;
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java:91:
> establishFirstContact(org.apache.hadoop.mapred.JobTracker,java.lang.String)
> in org.apache.hadoop.mapred.FakeObjectUtilities cannot be applied to
> (org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker,java.lang.String)
> [javac] FakeObjectUtilities.establishFirstContact(jobTracker,
> s);
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java:170:
> cannot find symbol
> [javac] symbol : constructor
> MyFakeJobInProgress(org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker)
> [javac] location: class
> org.apache.hadoop.mapred.TestJobInProgress.MyFakeJobInProgress
> [javac] MyFakeJobInProgress job1 = new MyFakeJobInProgress(conf,
> jobTracker);
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java:185:
> cannot find symbol
> [javac] symbol : constructor
> MyFakeJobInProgress(org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker)
> [javac] location: class
> org.apache.hadoop.mapred.TestJobInProgress.MyFakeJobInProgress
> [javac] MyFakeJobInProgress job2 = new MyFakeJobInProgress(conf,
> jobTracker);
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java:225:
> cannot find symbol
> [javac] symbol : constructor
> MyFakeJobInProgress(org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker)
> [javac] location: class
> org.apache.hadoop.mapred.TestJobInProgress.MyFakeJobInProgress
> [javac] MyFakeJobInProgress jip = new MyFakeJobInProgress(conf,
> jobTracker);
> [javac] ^
> [javac]
> /home/roelofs/grid/trunk2/hadoop-mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java:296:
> cannot find symbol
> [javac] symbol : constructor
> MyFakeJobInProgress(org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.FakeObjectUtilities.FakeJobTracker)
> [javac] location: class
> org.apache.hadoop.mapred.TestJobInProgress.MyFakeJobInProgress
> [javac] MyFakeJobInProgress jspy = spy(new MyFakeJobInProgress(conf,
> jobTracker));
> [javac] ^
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
