[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Status: Resolved (was: Patch Available) Fix Version/s: 0.21.0 Resolution: Fixed This has been committed and all subtasks are resolved. Closing it as fixed. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: New Feature Components: test Affects Versions: 0.21.0 Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Fix For: 0.21.0 Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated MAPREDUCE-1774: -- Status: Open (was: Patch Available) Retrying Hudson Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sharad Agarwal updated MAPREDUCE-1774: -- Status: Patch Available (was: Open) Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Affects Version/s: 0.21.0 Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: New Feature Components: test Affects Versions: 0.21.0 Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Hadoop Flags: [Reviewed] Issue Type: New Feature (was: Improvement) Component/s: test This is going to be closed as soon as the subtasks are fixed. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: New Feature Components: test Affects Versions: 0.21.0 Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Attachment: MAPREDUCE-1774.patch With another Sreekanth fix jobhistory is retrieved properly now. Tests are running. The only issue I am seeing at the moment is incorrect use of daemon scripts which needs to be addressed separately (HADOOP-6829) I think the patch is ready for the commit as the MR part of the framework works. Some of the test issues should be addressed separate. Longer this patch stays out higher the changes it will get stale. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Status: Open (was: Patch Available) Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Status: Patch Available (was: Open) Let's see once more. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Attachment: MAPREDUCE-1774.patch Same as before but all string literals are replaced with proper named constants from container classes. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
Includes Sreekanth fix for the connectivity problem. It has been caused by
property names change between MR 0.20 and 0.22
- mapred.job.tracker - mapreduce.jobtracker.address
- mapred.task.tracker.report.address -mapreduce.tasktracker.report.address
But because MR lacks a container similar to {{DFSConfigKeys}} there's *no way*
to track such change by Java means. Except by knowing by heart ;(
Tests are running against a real 0.22 cluster now! Some issues are addressed by
HADOOP-6828 (another neat change). A couple more of issues will addressed in
the next iteration. The patch is almost ready at the moment!
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Assignee: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
- This patch addresses audit warnings caused by missing Apache license boiler
plate in a couple of places.
- Javac warnings are caused by using deprecated {{JobConf}} and {{JobContext}}
in two new classes from {{testjar}} package. While this is a valid issue I am
not sure if it has to fought considering 2K+ of similar warnings all over the
MR code.
- Core tests failures are old: they are around for at least 6 days and this
patch hasn't cause any ones
Contrib test failure seems irrelevant (a Mumak testcase
{{TestSimulatorDeterministicReplay}} timing out for over 10 days).
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Assignee: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Status: Patch Available (was: Open) Assignee: Konstantin Boudnik Let's check. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Attachment: MAPREDUCE-1774.patch Coupla more javadoc and import corrections. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Assignee: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
Two missed classes for {{testjar}}; {{system-test.conf}} is renamed to
system-test-mapred.conf}}
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
Merging in Sreekanth's modifications of aspects addressing changes in 0.22 MR
API.
Also, rename of {{core}} to {{common}} was lost somehow, so I had to re-merge
this particular modification once more.
At the moment all code is being properly woven, tests are mostly compiled
except for {{TestFileOwner}} which fails with follow message:
{noformat}
[javac]
.../H0.22/git/mapreduce/src/test/system/test/org/apache/hadoop/mapred/TestFileOwner.java:183:
cannot find symbol
[javac] symbol : variable TASKJARDIR
[javac] location: class org.apache.hadoop.mapred.TaskTracker
[javac] if (filename.equals(TaskTracker.TASKJARDIR)) {
[javac] ^
{noformat}
However, the brief check shows that the symbol is present in the woven class
file.
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch, MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
Changes similar to latest HDFS ones: moving tests to {{src/test/system/test}}
for better build handling; changing Common artifacts from {{core}} to
{{common}}, etc.
Can't fully verify the patch at the moment because aspects are still broken and
need more work there.
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch, MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[
https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Konstantin Boudnik updated MAPREDUCE-1774:
--
Attachment: MAPREDUCE-1774.patch
Workaround for {{test-patch}} version setting. Fixing too wide a mask to
include aspect files.
Large-scale Automated Framework
---
Key: MAPREDUCE-1774
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Konstantin Boudnik
Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch,
MAPREDUCE-1774.patch
This is MapReduce part of HADOOP-6332
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1774) Large-scale Automated Framework
[ https://issues.apache.org/jira/browse/MAPREDUCE-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated MAPREDUCE-1774: -- Attachment: MAPREDUCE-1774.patch This patch version has all correct build modifications in please. However, because of the code changes between MR in 0.20 and in the trunk aspects aren't binding anymore and this needs to be fixed. Large-scale Automated Framework --- Key: MAPREDUCE-1774 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1774 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Konstantin Boudnik Attachments: MAPREDUCE-1774.patch, MAPREDUCE-1774.patch This is MapReduce part of HADOOP-6332 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
