[jira] [Commented] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435790#comment-13435790 ] Hadoop QA commented on HDFS-2745: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3788: - Attachment: h3788_20120815.patch h3788_20120815.patch: use Long for file length.

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435777#comment-13435777 ] Tsz Wo (Nicholas), SZE commented on HDFS-3788: -- Eli, thanks for reviewing the

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435759#comment-13435759 ] Hadoop QA commented on HDFS-2421: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435740#comment-13435740 ] Hadoop QA commented on HDFS-2963: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435735#comment-13435735 ] Hadoop QA commented on HDFS-3804: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2421: -- Status: Patch Available (was: Open) > Improve the concurrency of SerialNumberMap in NameNo

[jira] [Assigned] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas reassigned HDFS-2421: - Assignee: Jing Zhao (was: Weiyan Wang) > Improve the concurrency of SerialNumberMap

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2421: Attachment: HDFS-2421.patch Upload the patch for Weiyan's code. > Improve the concurrency o

[jira] [Commented] (HDFS-3774) NPE in DFSInputStream.read() when called on non-existing block

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435719#comment-13435719 ] Andrew Wang commented on HDFS-3774: --- I cleaned up what looked like duplicates of this iss

[jira] [Commented] (HDFS-3807) hadoop.http.filter.initializers not applied to webhdfs urls

2012-08-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435715#comment-13435715 ] Thomas Graves commented on HDFS-3807: - I agree its very difficult to understand what is

[jira] [Resolved] (HDFS-3775) NPE in DFSInputStream.read() when called on non-existing block

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3775. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() when called on

[jira] [Resolved] (HDFS-3778) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3778. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3781) NPE in DFSInputStream

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3781. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream >

[jira] [Resolved] (HDFS-3779) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3779. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3777) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3777. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3780) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3780. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3776) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3776. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3783) NPE in DFSInputStream

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3783. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream >

[jira] [Resolved] (HDFS-3782) NPE in DFSInputStream

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3782. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream >

[jira] [Resolved] (HDFS-3784) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3784. --- Resolution: Duplicate Dup of HDFS-3774 > NPE in DFSInputStream.read() > -

[jira] [Resolved] (HDFS-3786) NPE in DFSInputStream.read()

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3786. --- Resolution: Duplicate Duplicate of HDFS-3774 > NPE in DFSInputStream.read() > ---

[jira] [Resolved] (HDFS-3785) NPE in DFSInputStream.read

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-3785. --- Resolution: Duplicate > NPE in DFSInputStream.read > -- > >

[jira] [Commented] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435700#comment-13435700 ] Andrew Wang commented on HDFS-2745: --- Err, I think I meant branch-1 patch. It'd be what El

[jira] [Updated] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-2745: -- Affects Version/s: 2.2.0-alpha 1.2.0 Status: Patch Available (was:

[jira] [Assigned] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-2745: - Assignee: Andrew Wang > unclear to users which command to use to access the filesystem > -

[jira] [Updated] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-2745: -- Attachment: hdfs-2745-1.patch Attached patch for trunk. Did Eli's suggestions. * "hdfs dfs" is removed

[jira] [Assigned] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-2963: - Assignee: Andrew Wang > Console Output is confusing while executing metasave (dfsadmin command

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435680#comment-13435680 ] Suresh Srinivas commented on HDFS-2421: --- Jing, can you attach a patch based on code t

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435673#comment-13435673 ] Colin Patrick McCabe commented on HDFS-2963: looks good to me.

[jira] [Updated] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-2963: -- Affects Version/s: 2.2.0-alpha Status: Patch Available (was: Open) > Console Output

[jira] [Updated] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-2963: -- Attachment: hdfs-2963-1.patch I tweaked the output to be more informative. I didn't have it print the a

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435663#comment-13435663 ] Hadoop QA commented on HDFS-3808: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3731) 2.0 release upgrade must handle blocks being written from 1.0

2012-08-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435657#comment-13435657 ] Colin Patrick McCabe commented on HDFS-3731: I ran another experiment where I t

[jira] [Commented] (HDFS-2554) Add separate metrics for missing blocks with desired replication level 1

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435653#comment-13435653 ] Eli Collins commented on HDFS-2554: --- Wrt CorruptBlocksRN as long as we can distinguish be

[jira] [Commented] (HDFS-487) HDFS should expose a fileid to uniquely identify a file

2012-08-15 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435637#comment-13435637 ] dhruba borthakur commented on HDFS-487: --- as far as i know, nobody is working on this o

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435633#comment-13435633 ] Eli Collins commented on HDFS-3788: --- Forgot to mention that I tested your patch and the 3

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435632#comment-13435632 ] Eli Collins commented on HDFS-3788: --- - Where are we setting chunked encoding on the read

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435628#comment-13435628 ] Jing Zhao commented on HDFS-2421: - Nicholas, my previous patch was just for a simple perfor

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Robinson updated HDFS-3804: -- Attachment: HDFS-3804-2.patch > TestHftpFileSystem fails intermittently with JDK7 >

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435626#comment-13435626 ] Trevor Robinson commented on HDFS-3804: --- I understand what you're suggesting, and was

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435623#comment-13435623 ] Tsz Wo (Nicholas), SZE commented on HDFS-2421: -- Hi Jing, there is a race condi

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435622#comment-13435622 ] Daryn Sharp commented on HDFS-3804: --- The 2nd half of the tests need to ensure they get a

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435619#comment-13435619 ] Hudson commented on HDFS-3048: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2611 (See [https

[jira] [Resolved] (HDFS-3670) WebHDFS have a "not-enabled" return code instead of using file not found

2012-08-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-3670. -- Resolution: Not A Problem Let's close this as not-a-problem. >

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435600#comment-13435600 ] Trevor Robinson commented on HDFS-3804: --- Isn't the problem that the 2nd half tests (t

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Attachment: HDFS-3808.001.patch > fuse_dfs: postpone libhdfs intialization until a

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Status: Patch Available (was: Open) > fuse_dfs: postpone libhdfs intialization un

[jira] [Created] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-15 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-3808: -- Summary: fuse_dfs: postpone libhdfs intialization until after fork Key: HDFS-3808 URL: https://issues.apache.org/jira/browse/HDFS-3808 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435593#comment-13435593 ] Hudson commented on HDFS-3048: -- Integrated in Hadoop-Hdfs-trunk-Commit #2647 (See [https://bu

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435590#comment-13435590 ] Hudson commented on HDFS-3048: -- Integrated in Hadoop-Common-trunk-Commit #2582 (See [https://

[jira] [Updated] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3048: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha Target Version/s: (was: 2.2.0-alpha)

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435585#comment-13435585 ] Hadoop QA commented on HDFS-3194: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435578#comment-13435578 ] Eli Collins commented on HDFS-3048: --- Forgot to mention, per Todd's comment above ("I seem

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435574#comment-13435574 ] Eli Collins commented on HDFS-3048: --- +1 lgtm > Small race in BlockMana

[jira] [Commented] (HDFS-2554) Add separate metrics for missing blocks with desired replication level 1

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435571#comment-13435571 ] Andy Isaacson commented on HDFS-2554: - Eli, You make a good point that c can be greate

[jira] [Commented] (HDFS-3807) hadoop.http.filter.initializers not applied to webhdfs urls

2012-08-15 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435560#comment-13435560 ] Alejandro Abdelnur commented on HDFS-3807: -- If I'm not mistaken this is by design.

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1343#comment-1343 ] Andy Isaacson commented on HDFS-3048: - bq. Please justify why no new tests are needed f

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435551#comment-13435551 ] Hadoop QA commented on HDFS-3048: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3807) hadoop.http.filter.initializers not applied to webhdfs urls

2012-08-15 Thread Thomas Graves (JIRA)
Thomas Graves created HDFS-3807: --- Summary: hadoop.http.filter.initializers not applied to webhdfs urls Key: HDFS-3807 URL: https://issues.apache.org/jira/browse/HDFS-3807 Project: Hadoop HDFS

[jira] [Commented] (HDFS-487) HDFS should expose a fileid to uniquely identify a file

2012-08-15 Thread Aleksandr Levchuk (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435544#comment-13435544 ] Aleksandr Levchuk commented on HDFS-487: Is fileid in the foreseeable future?

[jira] [Resolved] (HDFS-3787) BlockManager#close races with ReplicationMonitor#run

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson resolved HDFS-3787. - Resolution: Duplicate > BlockManager#close races with ReplicationMonitor#run > ---

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435541#comment-13435541 ] Eli Collins commented on HDFS-3194: --- +1 pending jenkins > DataNode block

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435539#comment-13435539 ] Daryn Sharp commented on HDFS-3804: --- A simpler approach is probably to instantiate the hf

[jira] [Updated] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3194: Attachment: hdfs-3194-1.txt Attaching patch to revert HDFS-3803 and avoid starting a new period ever

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3804: -- Labels: java7 (was: ) > TestHftpFileSystem fails intermittently with JDK7 > ---

[jira] [Assigned] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3194: - Assignee: Andy Isaacson (was: amith) Andy, want to post a patch for trunk? Per my earlier comment

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435518#comment-13435518 ] Aaron T. Myers commented on HDFS-3672: -- Cool. Sounds like we're on the same page then.

[jira] [Commented] (HDFS-3670) WebHDFS have a "not-enabled" return code instead of using file not found

2012-08-15 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435509#comment-13435509 ] Eli Collins commented on HDFS-3670: --- After seeing Nicholas' comment (that we do distingui

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Weiyan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435507#comment-13435507 ] Weiyan Wang commented on HDFS-2421: --- I think most of operations are just permission check

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2421: Attachment: performance_1_op.png also attach the performance measurement for 10,000 operation version (i

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2421: Attachment: (was: HDFS-2421.patch) > Improve the concurrency of SerialNumberMap in NameNode > -

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2421: Attachment: performance_10_op.png Measure the time performance with the same test code, but run 100,000

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435472#comment-13435472 ] Hudson commented on HDFS-3796: -- Integrated in Hadoop-Common-trunk-Commit #2581 (See [https://

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435468#comment-13435468 ] Hudson commented on HDFS-3796: -- Integrated in Hadoop-Hdfs-trunk-Commit #2646 (See [https://bu

[jira] [Commented] (HDFS-3805) A small improvement of SerialNumberManager$SerialNumberMap.get

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435464#comment-13435464 ] Hadoop QA commented on HDFS-3805: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435451#comment-13435451 ] Hudson commented on HDFS-3796: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2608 (See [https

[jira] [Resolved] (HDFS-3800) QJM: improvements to QJM fault testing

2012-08-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3800. --- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Reviewed

[jira] [Resolved] (HDFS-3797) QJM: add segment txid as a parameter to journal() RPC

2012-08-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3797. --- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435417#comment-13435417 ] Andy Isaacson commented on HDFS-3048: - I looped TestWebHdfsWithMultipleNameNodes 1014 t

[jira] [Updated] (HDFS-3048) Small race in BlockManager#close

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3048: Attachment: hdfs-3048.txt Reattaching same patch to retrigger Jenkins. > Small race

[jira] [Commented] (HDFS-3797) QJM: add segment txid as a parameter to journal() RPC

2012-08-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435410#comment-13435410 ] Todd Lipcon commented on HDFS-3797: --- bq. have you considered adding a test case that ensu

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435409#comment-13435409 ] Suresh Srinivas commented on HDFS-3672: --- bq. but the user API will remain. There will

[jira] [Updated] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3796: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435399#comment-13435399 ] Aaron T. Myers commented on HDFS-3672: -- bq. @Aaron, want to make sure we are on the sa

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435388#comment-13435388 ] Suresh Srinivas commented on HDFS-3672: --- @Aaron, want to make sure we are on the same

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435382#comment-13435382 ] Suresh Srinivas commented on HDFS-3672: --- Thanks Andrew. HDFS-2832 can benefit a lot o

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435369#comment-13435369 ] Jing Zhao commented on HDFS-2421: - And Weiyan's patch should be fine with the synchronizati

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435365#comment-13435365 ] Jing Zhao commented on HDFS-2421: - Hi Nicholas, I agree. So I said there would be a synchro

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435363#comment-13435363 ] Andrew Purtell commented on HDFS-3672: -- @Suresh, thanks for linking HBASE-6572 to HDFS

[jira] [Updated] (HDFS-3805) A small improvement of SerialNumberManager$SerialNumberMap.get

2012-08-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3805: Attachment: HDFS-3805.patch handle the 0-null pair. > A small improvement of SerialNumberMa

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435321#comment-13435321 ] Konstantin Shvachko commented on HDFS-3772: --- And you can use {code}hadoop dfsadm

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435310#comment-13435310 ] Suresh Srinivas commented on HDFS-3672: --- bq. I put up some ramblings on HBASE-6572. T

[jira] [Commented] (HDFS-3772) HDFS NN will hang in safe mode and never come out if we change the dfs.namenode.replication.min bigger.

2012-08-15 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435307#comment-13435307 ] Konstantin Shvachko commented on HDFS-3772: --- It is not the hang. It works as desi

[jira] [Commented] (HDFS-3805) A small improvement of SerialNumberManager$SerialNumberMap.get

2012-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435303#comment-13435303 ] Hadoop QA commented on HDFS-3805: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3670) WebHDFS have a "not-enabled" return code instead of using file not found

2012-08-15 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435266#comment-13435266 ] Alejandro Abdelnur commented on HDFS-3670: -- this does not apply to HttpFS, if Http

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2012-08-15 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435259#comment-13435259 ] Alejandro Abdelnur commented on HDFS-3598: -- WebHDFS API currently supports FileSys

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435238#comment-13435238 ] Aaron T. Myers commented on HDFS-3672: -- The latest patch looks good to me, and I belie

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-15 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435234#comment-13435234 ] Trevor Robinson commented on HDFS-3804: --- Precommit test failure is unrelated; opened

[jira] [Created] (HDFS-3806) Assertion failed in TestStandbyCheckpoints.testBothNodesInStandbyState

2012-08-15 Thread Trevor Robinson (JIRA)
Trevor Robinson created HDFS-3806: - Summary: Assertion failed in TestStandbyCheckpoints.testBothNodesInStandbyState Key: HDFS-3806 URL: https://issues.apache.org/jira/browse/HDFS-3806 Project: Hadoop

  1   2   >