[jira] [Commented] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943063#comment-13943063
]
Chen He commented on MAPREDUCE-5804:
+1, download the patch, apply to trunk, run the test, and no timeout reported.
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mit Desai updated MAPREDUCE-5804:
-
Status: Open (was: Patch Available)
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mit Desai updated MAPREDUCE-5804:
-
Status: Patch Available (was: Open)
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943304#comment-13943304
]
Kihwal Lee commented on MAPREDUCE-5804:
---
+1
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated MAPREDUCE-5804:
--
Resolution: Fixed
Fix Version/s: 2.5.0
3.0.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Thanks for working on this. I've committed this to trunk and branch-2.
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Fix For: 3.0.0, 2.5.0
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943347#comment-13943347
]
Mit Desai commented on MAPREDUCE-5804:
--
Thanks [~kihwal]
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Fix For: 3.0.0, 2.5.0
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-4878) JobID.forName() isn't strict enough
[
https://issues.apache.org/jira/browse/MAPREDUCE-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karthik Kambatla updated MAPREDUCE-4878:
Resolution: Later
Status: Resolved (was: Patch Available)
JobID.forName() isn't strict enough
---
Key: MAPREDUCE-4878
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4878
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Robert Kanter
Assignee: Robert Kanter
Attachments: HADOOP-9065.patch, HADOOP-9065_branch-1.patch
If you have a job running as job_201208221603_0003, and then try to kill a
job passing id job_201208221603_003, it will kill job_201208221603_0003
because the last part of the JobID is parsed as an integer. We should make
JobID.forName() stricter to prevent this and similar situations as the
current behavior isn't so obvious.
More specifically, we shouldn't accept JobIDs if the last part of the JobID
is:
{{-}} less than 4 characters (e.g. _003, _123)
{{-}} more than 4 characters and has a leading zero (e.g. _3, _01234)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-4878) JobID.forName() isn't strict enough
[
https://issues.apache.org/jira/browse/MAPREDUCE-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943349#comment-13943349
]
Karthik Kambatla commented on MAPREDUCE-4878:
-
Resolving this as Later, as users haven't really asked of it. Spoke to Robert
- he is okay with closing this too.
JobID.forName() isn't strict enough
---
Key: MAPREDUCE-4878
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4878
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Robert Kanter
Assignee: Robert Kanter
Attachments: HADOOP-9065.patch, HADOOP-9065_branch-1.patch
If you have a job running as job_201208221603_0003, and then try to kill a
job passing id job_201208221603_003, it will kill job_201208221603_0003
because the last part of the JobID is parsed as an integer. We should make
JobID.forName() stricter to prevent this and similar situations as the
current behavior isn't so obvious.
More specifically, we shouldn't accept JobIDs if the last part of the JobID
is:
{{-}} less than 4 characters (e.g. _003, _123)
{{-}} more than 4 characters and has a leading zero (e.g. _3, _01234)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Moved] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli moved YARN-1294 to MAPREDUCE-5806: -- Affects Version/s: (was: 2.1.0-beta) 2.1.0-beta Key: MAPREDUCE-5806 (was: YARN-1294) Project: Hadoop Map/Reduce (was: Hadoop YARN) Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943370#comment-13943370 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5806: The core changes look good to me. One comment on the test-case: can we add a simple test which shows that user can override HADOOP_ROOT_LOGGER and HADOOP_CLIENT_OPTS by using the env config properties? Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5804) TestMRJobsWithProfiler#testProfiler timesout
[
https://issues.apache.org/jira/browse/MAPREDUCE-5804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943394#comment-13943394
]
Hudson commented on MAPREDUCE-5804:
---
SUCCESS: Integrated in Hadoop-trunk-Commit #5371 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/5371/])
MAPREDUCE-5804. TestMRJobsWithProfiler#testProfiler timesout. Contributed by
Mit Desai. (kihwal:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1579995)
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/TestMRJobsWithProfiler.java
TestMRJobsWithProfiler#testProfiler timesout
Key: MAPREDUCE-5804
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5804
Project: Hadoop Map/Reduce
Issue Type: Test
Affects Versions: 2.4.0
Reporter: Mit Desai
Assignee: Mit Desai
Fix For: 3.0.0, 2.5.0
Attachments: LOG.txt, MAPREDUCE-5804.patch
{noformat}
testProfiler(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler) Time
elapsed: 154.972 sec ERROR!
java.lang.Exception: test timed out after 12 milliseconds
at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
at java.io.File.exists(File.java:813)
at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1080)
at sun.misc.URLClassPath.getResource(URLClassPath.java:199)
at java.net.URLClassLoader$1.run(URLClassLoader.java:358)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.log4j.spi.LoggingEvent.init(LoggingEvent.java:165)
at org.apache.log4j.Category.forcedLog(Category.java:391)
at org.apache.log4j.Category.log(Category.java:856)
at
org.apache.commons.logging.impl.Log4JLogger.warn(Log4JLogger.java:208)
at
org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:338)
at
org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:419)
at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:532)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:314)
at org.apache.hadoop.mapreduce.Job$1.run(Job.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1570)
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:311)
at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:599)
at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1344)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1306)
at
org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfiler(TestMRJobsWithProfiler.java:138)
Results :
Tests in error:
TestMRJobsWithProfiler.testProfiler:138 » test timed out after 12
millise...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5787: --- Status: Open (was: Patch Available) Modify ShuffleHandler to support Keep-Alive --- Key: MAPREDUCE-5787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: nodemanager Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Critical Labels: ShuffleKeepalive Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch, MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch, MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch, MAPREDUCE-5787-2.4.0.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5787: --- Labels: (was: ShuffleKeepalive) Hadoop Flags: Reviewed Status: Patch Available (was: Open) Modify ShuffleHandler to support Keep-Alive --- Key: MAPREDUCE-5787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: nodemanager Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Critical Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch, MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch, MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch, MAPREDUCE-5787-2.4.0-v8.patch, MAPREDUCE-5787-2.4.0.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5787: --- Attachment: MAPREDUCE-5787-2.4.0-v8.patch Okay the latest patch looks good. But I did one more minor round of micro-optimization to avoid reconstructing the output path again and again. Will commit it once jenkins says okay. Modify ShuffleHandler to support Keep-Alive --- Key: MAPREDUCE-5787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: nodemanager Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Critical Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch, MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch, MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch, MAPREDUCE-5787-2.4.0-v8.patch, MAPREDUCE-5787-2.4.0.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[
https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943456#comment-13943456
]
Hadoop QA commented on MAPREDUCE-5806:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12636069/apache-yarn-1294.1.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4453//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4453//console
This message is automatically generated.
Log4j settings in container-log4j.properties cannot be overridden
--
Key: MAPREDUCE-5806
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.1.0-beta
Reporter: Eugene Koifman
Assignee: Varun Vasudev
Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch
setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated MAPREDUCE-5806: - Status: Open (was: Patch Available) Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated MAPREDUCE-5806: - Status: Patch Available (was: Open) Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated MAPREDUCE-5806: - Attachment: apache-yarn-1294.2.patch Updated patch with added test for setting HADOOP_ROOT_LOGGER and HADOOP_CLIENT_OPTS Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[
https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943485#comment-13943485
]
Hadoop QA commented on MAPREDUCE-5787:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12636088/MAPREDUCE-5787-2.4.0-v8.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4454//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4454//console
This message is automatically generated.
Modify ShuffleHandler to support Keep-Alive
---
Key: MAPREDUCE-5787
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Components: nodemanager
Affects Versions: 2.4.0
Reporter: Rajesh Balamohan
Assignee: Rajesh Balamohan
Priority: Critical
Attachments: MAPREDUCE-5787-2.4.0-v2.patch,
MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch,
MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch,
MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch,
MAPREDUCE-5787-2.4.0-v8.patch, MAPREDUCE-5787-2.4.0.patch
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[
https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943521#comment-13943521
]
Hadoop QA commented on MAPREDUCE-5806:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12636091/apache-yarn-1294.2.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4455//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4455//console
This message is automatically generated.
Log4j settings in container-log4j.properties cannot be overridden
--
Key: MAPREDUCE-5806
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.1.0-beta
Reporter: Eugene Koifman
Assignee: Varun Vasudev
Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch,
apache-yarn-1294.2.patch
setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5787: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) Committed this to trunk, branch-2 and branch-2.4. Thanks Rajesh! Modify ShuffleHandler to support Keep-Alive --- Key: MAPREDUCE-5787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: nodemanager Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Critical Fix For: 2.4.0 Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch, MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch, MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch, MAPREDUCE-5787-2.4.0-v8.patch, MAPREDUCE-5787-2.4.0.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Resolved] (MAPREDUCE-5786) Support Keep-Alive connections in ShuffleHandler
[ https://issues.apache.org/jira/browse/MAPREDUCE-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-5786. Resolution: Fixed All sub-tasks (only one actually) are done. Support Keep-Alive connections in ShuffleHandler Key: MAPREDUCE-5786 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5786 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Labels: shuffle Currently ShuffleHandler supports fetching map-outputs in batches from same host. But there are scenarios wherein, fetchers pull data aggressively (i.e start pulling the data as when they are available). In this case, the number of mapIds that are pulled from same host remains at 1. This causes lots of connections to be established. Number of connections can be reduced a lot if ShuffleHandler supports Keep-Alive. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5806: --- Status: Open (was: Patch Available) The patch looks good to me. But I'm adding one more little test. Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch, apache-yarn-1294.3.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5806: --- Attachment: apache-yarn-1294.3.patch Same patch with one more test to verify explicit override of HADOOP_ROOT_LOGGER via child-env. Will check it in if jenkins says okay. Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch, apache-yarn-1294.3.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5806: --- Hadoop Flags: Reviewed Status: Patch Available (was: Open) Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch, apache-yarn-1294.3.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5787) Modify ShuffleHandler to support Keep-Alive
[ https://issues.apache.org/jira/browse/MAPREDUCE-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943645#comment-13943645 ] Hudson commented on MAPREDUCE-5787: --- SUCCESS: Integrated in Hadoop-trunk-Commit #5374 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5374/]) MAPREDUCE-5787. Added the ability to keep alive shuffle connections in the MapReduce shuffle-handler. Contributed by Rajesh Balamohan. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1580062) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java Modify ShuffleHandler to support Keep-Alive --- Key: MAPREDUCE-5787 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5787 Project: Hadoop Map/Reduce Issue Type: Sub-task Components: nodemanager Affects Versions: 2.4.0 Reporter: Rajesh Balamohan Assignee: Rajesh Balamohan Priority: Critical Fix For: 2.4.0 Attachments: MAPREDUCE-5787-2.4.0-v2.patch, MAPREDUCE-5787-2.4.0-v3.patch, MAPREDUCE-5787-2.4.0-v4.patch, MAPREDUCE-5787-2.4.0-v5-v6-diff.patch, MAPREDUCE-5787-2.4.0-v5.patch, MAPREDUCE-5787-2.4.0-v6.patch, MAPREDUCE-5787-2.4.0-v7.patch, MAPREDUCE-5787-2.4.0-v8.patch, MAPREDUCE-5787-2.4.0.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[
https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943699#comment-13943699
]
Hadoop QA commented on MAPREDUCE-5806:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12636122/apache-yarn-1294.3.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4456//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4456//console
This message is automatically generated.
Log4j settings in container-log4j.properties cannot be overridden
--
Key: MAPREDUCE-5806
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.1.0-beta
Reporter: Eugene Koifman
Assignee: Varun Vasudev
Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch,
apache-yarn-1294.2.patch, apache-yarn-1294.3.patch
setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5806: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) Committed this to trunk, branch-2 and branch-2.4. Thanks Varun! Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Fix For: 2.4.0 Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch, apache-yarn-1294.3.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (MAPREDUCE-5806) Log4j settings in container-log4j.properties cannot be overridden
[ https://issues.apache.org/jira/browse/MAPREDUCE-5806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943805#comment-13943805 ] Hudson commented on MAPREDUCE-5806: --- SUCCESS: Integrated in Hadoop-trunk-Commit #5377 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5377/]) MAPREDUCE-5806. Fixed a bug in MRAppMaster so as to enable users to properly override HADOOP_ROOT_LOGGER or HADOOP_CLIENT_OPTS. Contributed by Varun Vasudev. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1580100) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java Log4j settings in container-log4j.properties cannot be overridden -- Key: MAPREDUCE-5806 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5806 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 2.1.0-beta Reporter: Eugene Koifman Assignee: Varun Vasudev Fix For: 2.4.0 Attachments: apache-yarn-1294.0.patch, apache-yarn-1294.1.patch, apache-yarn-1294.2.patch, apache-yarn-1294.3.patch setting HADOOP_ROOT_LOGGER, -Dhadoop.root.logger has no effect -- This message was sent by Atlassian JIRA (v6.2#6252)
