[jira] [Resolved] (MAPREDUCE-3963) NodeManagers die on startup if they can't connect to the RM
[ https://issues.apache.org/jira/browse/MAPREDUCE-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved MAPREDUCE-3963. - Resolution: Duplicate Thanks Bhallamudi! Yes! This issue is a duplicate of MAPREDUCE-3676 NodeManagers die on startup if they can't connect to the RM --- Key: MAPREDUCE-3963 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3963 Project: Hadoop Map/Reduce Issue Type: Bug Components: mrv2, nodemanager Affects Versions: 0.23.1 Reporter: Ravi Prakash Priority: Critical Steps to reproduce. Start the NM when the RM is down. The NM tries 10 times, then exits. It should keep trying forever. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-1688) A failing retry'able notification in JobEndNotifier can affect notifications of other jobs.
[
https://issues.apache.org/jira/browse/MAPREDUCE-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Prakash resolved MAPREDUCE-1688.
-
Resolution: Fixed
Fix Version/s: 0.23.1
Assignee: Ravi Prakash
This has been fixed by MAPREDUCE-3028. Since each AM is now doing the job-end
notification, it has automatically been parallelized. Also, timeouts have been
set in the HttpURLConnection object.
A failing retry'able notification in JobEndNotifier can affect notifications
of other jobs.
---
Key: MAPREDUCE-1688
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1688
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Affects Versions: 0.20.1
Reporter: Vinod Kumar Vavilapalli
Assignee: Ravi Prakash
Fix For: 0.23.1
The JobTracker puts all the notification commands into a delay-queue. It has
a single thread that loops through this queue and sends out the
notifications. When it hits failures with any notification which is
configured to be retired via {{job.end.retry.attempts}} and
{{job.end.retry.interval}}, the notification is queued back again. A single
notification with sufficiently large number of configured retries and which
consistently fails will affect other notifications in the queue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3799) TestServiceLevelAuthorization testServiceLevelAuthorization failing
[ https://issues.apache.org/jira/browse/MAPREDUCE-3799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved MAPREDUCE-3799. - Resolution: Cannot Reproduce Fix Version/s: 0.23.2 0.23.1 Our jenkins job is not seeing this unit test fail again. Seems it has been fixed. If we see this again, I'll reopen this JIRA. TestServiceLevelAuthorization testServiceLevelAuthorization failing --- Key: MAPREDUCE-3799 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3799 Project: Hadoop Map/Reduce Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Ravi Prakash Fix For: 0.23.1, 0.23.2 *Error Message* Expected file distcache not found *Stacktrace* junit.framework.AssertionFailedError: Expected file distcache not found at org.apache.hadoop.mapred.TestMiniMRWithDFS.verifyContents(TestMiniMRWithDFS.java:200) at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:149) at org.apache.hadoop.mapred.TestMiniMRWithDFS.runWordCount(TestMiniMRWithDFS.java:240) at org.apache.hadoop.security.authorize.TestServiceLevelAuthorization.testServiceLevelAuthorization(TestServiceLevelAuthorization.java:95) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3800) TestHarFileSystem testRelativeArchives
[ https://issues.apache.org/jira/browse/MAPREDUCE-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved MAPREDUCE-3800. - Resolution: Cannot Reproduce Fix Version/s: 0.23.2 0.23.1 Our jenkins job is not seeing this unit test fail again. Seems it has been fixed. If we see this again, I'll reopen this JIRA. TestHarFileSystem testRelativeArchives -- Key: MAPREDUCE-3800 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3800 Project: Hadoop Map/Reduce Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Ravi Prakash Labels: test Fix For: 0.23.1, 0.23.2 *Error Message* failed test *Stacktrace* junit.framework.AssertionFailedError: failed test at org.apache.hadoop.tools.TestHarFileSystem.testRelativeArchives(TestHarFileSystem.java:227) -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3406) Add node information to bin/mapred job -list-attempt-ids and other improvements
[ https://issues.apache.org/jira/browse/MAPREDUCE-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved MAPREDUCE-3406. - Resolution: Duplicate Marking as Duplicate. I'd forgot I'd opened MAPREDUCE-3406 Add node information to bin/mapred job -list-attempt-ids and other improvements --- Key: MAPREDUCE-3406 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3406 Project: Hadoop Map/Reduce Issue Type: Improvement Components: mrv2 Affects Versions: 0.23.0 Reporter: Ravi Prakash Assignee: Ravi Prakash Fix For: 0.23.1 From [~rramya] Providing the NM information where the containers are scheduled in bin/mapred job -list-attempt-ids will be helpful in automation, debugging and to avoid grepping through the AM logs. From my own observation, the list-attempt-ids should list the attempt ids and not require the arguments. The arguments if given, can be used to filter the results. From the usage: bq. [-list-attempt-ids job-id task-type task-state]. Valid values for task-type are MAP REDUCE JOB_SETUP JOB_CLEANUP TASK_CLEANUP. Valid values for task-state are running, completed -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3662) Command line ask: NM info where containers are launched
[
https://issues.apache.org/jira/browse/MAPREDUCE-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Prakash resolved MAPREDUCE-3662.
-
Resolution: Duplicate
Marking as Duplicate. I'd forgot I'd opened MAPREDUCE-3406
Command line ask: NM info where containers are launched
---
Key: MAPREDUCE-3662
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3662
Project: Hadoop Map/Reduce
Issue Type: Wish
Components: mrv2
Affects Versions: 0.23.0
Reporter: Ravi Prakash
Courtesy [~rramya]
{quote}
we had requested for the NM information where the containers are scheduled to
be made available in job
-list-attempt-ids. This will be helpful in automation, debugging and avoid
grepping through the AM logs.
{quote}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3482) Enable HTTP proxy to be specified for job end notification
[
https://issues.apache.org/jira/browse/MAPREDUCE-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Prakash resolved MAPREDUCE-3482.
-
Resolution: Duplicate
This is a duplicate of MAPREDUCE-3382
Enable HTTP proxy to be specified for job end notification
--
Key: MAPREDUCE-3482
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3482
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: applicationmaster, mrv2
Affects Versions: 0.23.0
Reporter: Ravi Prakash
Assignee: Anupam Seth
Courtesy Ratandeep Singh Ratti
{quote}
The AM should be able to notify the job.end.notification.url. Hence this
request has to go through HTTP proxy, since ACLs won't be open from the AM to
external machines.
{quote}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3160) Merge -r 1177530:1177531 from trunk to branch-0.23 to fix MAPREDUCE-2996 broke ant test compilation
[
https://issues.apache.org/jira/browse/MAPREDUCE-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravi Prakash resolved MAPREDUCE-3160.
-
Resolution: Invalid
This was a problem with my ivy cache. After clearing it, and rebuilding
everything, this problem went away.
Merge -r 1177530:1177531 from trunk to branch-0.23 to fix MAPREDUCE-2996
broke ant test compilation
---
Key: MAPREDUCE-3160
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3160
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Ravi Prakash
I git bisected and the problem starts from
adb810babaf25b9f9dae75b43d4beac782deaa01 . ant
{noformat}
[jsp-compile] log4j:WARN See
http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[javac]
/home/raviprak/Code/hadoop/hadoop-all/hadoop-mapreduce-project/build.xml:398:
warning: 'includeantruntime' was not set, defaulting to
build.sysclasspath=last; set to false for repeatable builds
[javac] Compiling 2 source files to
/home/raviprak/Code/hadoop/hadoop-all/hadoop-mapreduce-project/build/classes
[javac]
/home/raviprak/Code/hadoop/hadoop-all/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/JobInProgress.java:697:
cannot find symbol
[javac] symbol : constructor
JobInitedEvent(org.apache.hadoop.mapred.JobID,long,int,int,java.lang.String,boolean)
[javac] location: class
org.apache.hadoop.mapreduce.jobhistory.JobInitedEvent
[javac] JobInitedEvent jie = new JobInitedEvent(
[javac] ^
[javac] Note:
/home/raviprak/Code/hadoop/hadoop-all/hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/JobInProgress.java
uses or overrides a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
