[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251175#comment-15251175 ] Hadoop QA commented on MAPREDUCE-6657: -- | (/) *{color:green}+1 overall{color}* |

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-2398: --- Status: Patch Available (was: Reopened) (Sorry for all the extra status noise; Marking as Patch-A

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Fixed > MRBench: setting the baseDir parameter has no effect > -

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: Assignee: Wilfred Spiegelenburg > MRBench: setting the baseDir parameter has no effect > -

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: > MRBench: setting the baseDir parameter has no effect > ---

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Later (Trying a resolve to reset the IN-PROGRESS state as there seems to be no optio

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-2398: --- Assignee: (was: Yang Hao) > MRBench: setting the baseDir parameter has no effect > ---

[jira] [Commented] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251168#comment-15251168 ] Wilfred Spiegelenburg commented on MAPREDUCE-2398: -- [~yanghaogn] do y

[jira] [Commented] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

2016-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251166#comment-15251166 ] Hudson commented on MAPREDUCE-6680: --- FAILURE: Integrated in Hadoop-trunk-Commit #964

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated MAPREDUCE-2398: - Attachment: MAPREDUCE-2398.2.patch This seems to have gone stale for a

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-2398: --- Release Note: (was: Fixes MRBench to properly handle the -baseDir parameter.) > MRBench: settin

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-2398: --- Target Version/s: 3.0.0, 2.9.0 (was: 2.8.0) > MRBench: setting the baseDir parameter has no effec

[jira] [Updated] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated MAPREDUCE-2398: --- Affects Version/s: (was: 0.20.2) > MRBench: setting the baseDir parameter has no effect >

[jira] [Commented] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251116#comment-15251116 ] Karthik Kambatla commented on MAPREDUCE-6684: - Is it okay to scan the done

[jira] [Commented] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251110#comment-15251110 ] Karthik Kambatla commented on MAPREDUCE-6684: - Was looking into this along

[jira] [Updated] (MAPREDUCE-6680) JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)

2016-04-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated MAPREDUCE-6680: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 2.8.0

[jira] [Updated] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-6684: Description: HistoryFileManager.scanIntermediateDirectory() in JHS acquires a lo

[jira] [Updated] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6657: -- Attachment: mapreduce6657.004.patch > job history server can fail on startup when NameNode i

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251038#comment-15251038 ] Haibo Chen commented on MAPREDUCE-6657: --- Thanks [~templedf] and @Ray Chiang for

[jira] [Commented] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251017#comment-15251017 ] Hadoop QA commented on MAPREDUCE-6639: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Commented] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-04-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250889#comment-15250889 ] Ryan Blue commented on MAPREDUCE-6639: -- [~rkanter], can you take a look at this?

[jira] [Updated] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-04-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated MAPREDUCE-6639: - Description: ListLocatedFileStatusFetcher uses a thread pool, but one of the Callable thread f

[jira] [Updated] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-04-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated MAPREDUCE-6639: - Attachment: MAPREDUCE-6639.2.patch Adding a better patch. The problem was in the error handlin

[jira] [Updated] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6684: -- Description: HistoryFileManager.scanIntermediateDirectory() in JHS acquires a lock on each

[jira] [Commented] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250827#comment-15250827 ] Haibo Chen commented on MAPREDUCE-6684: --- Most web API calls tend to invoke Histo

[jira] [Updated] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-04-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated MAPREDUCE-6639: - Attachment: (was: MAPREDUCE-6639.1.patch) > Process hangs in LocatedFileStatusFetcher if F

[jira] [Updated] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6684: -- Attachment: jhs-jstacks-service-monitor-stopped.tar.gz jhs-jstacks-service-mo

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250774#comment-15250774 ] Ray Chiang commented on MAPREDUCE-6657: --- Reviewed the latest patch. Looks good.

[jira] [Created] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6684: - Summary: High contention on scanning of user directory under immediate_done in Job History Server Key: MAPREDUCE-6684 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6684

[jira] [Updated] (MAPREDUCE-6684) High contention on scanning of user directory under immediate_done in Job History Server

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6684: -- Description: HistoryFileManager.scanIntermediateDirectory() in JHS acquires a lock on each

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250546#comment-15250546 ] Hadoop QA commented on MAPREDUCE-6657: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Commented] (MAPREDUCE-6683) Execute hadoop 1.0.1 application in hadoop 2.6.0 cause Output directory not set execption

2016-04-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250509#comment-15250509 ] Ravi Prakash commented on MAPREDUCE-6683: - Han! Please send an email to u...@h

[jira] [Resolved] (MAPREDUCE-6683) Execute hadoop 1.0.1 application in hadoop 2.6.0 cause Output directory not set execption

2016-04-20 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved MAPREDUCE-6683. - Resolution: Invalid > Execute hadoop 1.0.1 application in hadoop 2.6.0 cause Output di

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250484#comment-15250484 ] Daniel Templeton commented on MAPREDUCE-6657: - Thanks, [~haibochen]. Some

[jira] [Updated] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6657: -- Attachment: (was: mapreduce6677.003.patch) > job history server can fail on startup when

[jira] [Updated] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6657: -- Attachment: mapreduce6657.003.patch > job history server can fail on startup when NameNode i

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250435#comment-15250435 ] Daniel Templeton commented on MAPREDUCE-6657: - I think you uploaded the wr

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-04-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15250356#comment-15250356 ] Haibo Chen commented on MAPREDUCE-6657: --- Unit test failures are unrelated to thi