[jira] [Commented] (HDFS-3347) NullPointerException When trying to log to editstreams

2012-09-25 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462489#comment-13462489 ] Vinay commented on HDFS-3347: - IMO, I have following options with less code changes. 1.

[jira] [Commented] (HDFS-3969) Small bug fixes and improvements for disk locations API

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462496#comment-13462496 ] Hadoop QA commented on HDFS-3969: - +1 overall. Here are the results of testing the latest

[jira] [Resolved] (HDFS-3347) NullPointerException When trying to log to editstreams

2012-09-25 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HDFS-3347. - Resolution: Duplicate Already fixed in HDFS-3026, NullPointerException When trying to log to

[jira] [Commented] (HDFS-3347) NullPointerException When trying to log to editstreams

2012-09-25 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462595#comment-13462595 ] Vinay commented on HDFS-3347: - Oops, Just now I saw the fix done by Aaron in HDFS-3026, So this

[jira] [Commented] (HDFS-234) Integration with BookKeeper logging system

2012-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462716#comment-13462716 ] Hudson commented on HDFS-234: - Integrated in Hadoop-Hdfs-trunk #1176 (See

[jira] [Updated] (HDFS-3461) HFTP should use the same port protocol for getting the delegation token

2012-09-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3461: - Attachment: h3461_20120925.patch h3461_20120925.patch: updates

[jira] [Created] (HDFS-3970) BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file.

2012-09-25 Thread Vinay (JIRA)
Vinay created HDFS-3970: --- Summary: BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file. Key: HDFS-3970 URL: https://issues.apache.org/jira/browse/HDFS-3970

[jira] [Commented] (HDFS-234) Integration with BookKeeper logging system

2012-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462748#comment-13462748 ] Hudson commented on HDFS-234: - Integrated in Hadoop-Mapreduce-trunk #1207 (See

[jira] [Commented] (HDFS-3461) HFTP should use the same port protocol for getting the delegation token

2012-09-25 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462761#comment-13462761 ] Daryn Sharp commented on HDFS-3461: --- To follow on with Owen's comments, we can't remove

[jira] [Commented] (HDFS-3461) HFTP should use the same port protocol for getting the delegation token

2012-09-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462773#comment-13462773 ] Tsz Wo (Nicholas), SZE commented on HDFS-3461: -- Thanks Daryn. Will leave this

[jira] [Commented] (HDFS-3373) FileContext HDFS implementation can leak socket caches

2012-09-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462787#comment-13462787 ] Tsz Wo (Nicholas), SZE commented on HDFS-3373: -- {code} + private synchronized

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462855#comment-13462855 ] Lars Hofhansl commented on HDFS-744: You are right Luke. I implemented this in the

[jira] [Updated] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-09-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3540: - Attachment: h3540_20120925.patch Hi Colin, thanks for posting a patch. As you

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462869#comment-13462869 ] Lars Hofhansl commented on HDFS-744: In any case, hsync and hflush should be fixed

[jira] [Commented] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-09-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462879#comment-13462879 ] Arun C Murthy commented on HDFS-3871: - Matt - if you don't mind, I'd like to merge this

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462880#comment-13462880 ] Hadoop QA commented on HDFS-3540: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Steve Hoffman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462916#comment-13462916 ] Steve Hoffman commented on HDFS-1312: - Wow, I can't believe this is still lingering out

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462927#comment-13462927 ] Allen Wittenauer commented on HDFS-1312: bq. The only way we have found to move

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462951#comment-13462951 ] Andrew Purtell commented on HDFS-1312: -- It might be worth adding to the manual a note

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Steve Hoffman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462960#comment-13462960 ] Steve Hoffman commented on HDFS-1312: - {quote} The other thing is that as you grow a

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13462973#comment-13462973 ] Allen Wittenauer commented on HDFS-1312: bq. We typically run at 70-80% full as we

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463005#comment-13463005 ] Allen Wittenauer commented on HDFS-1312: Since someone (off-jira) asked: * Yes, I

[jira] [Updated] (HDFS-496) Use PureJavaCrc32 in HDFS

2012-09-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-496: --- Fix Version/s: (was: 1.2.0) 1.1.0 I just merged this to branch-1.1 too.

[jira] [Updated] (HDFS-3667) Add retry support to WebHdfsFileSystem

2012-09-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-3667: Fix Version/s: (was: 1.2.0) 1.1.0 I've merged this to branch-1.1 too.

[jira] [Updated] (HDFS-3871) Change NameNodeProxies to use HADOOP-8748

2012-09-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-3871: Fix Version/s: (was: 1.2.0) 1.1.0 I just merged this to branch-1.1 after

[jira] [Created] (HDFS-3971) Add a resume feature to the copyFromLocal and put commands

2012-09-25 Thread Adam Muise (JIRA)
Adam Muise created HDFS-3971: Summary: Add a resume feature to the copyFromLocal and put commands Key: HDFS-3971 URL: https://issues.apache.org/jira/browse/HDFS-3971 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-3972) Trash emptier fails in secure cluster

2012-09-25 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3972: - Summary: Trash emptier fails in secure cluster Key: HDFS-3972 URL: https://issues.apache.org/jira/browse/HDFS-3972 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3429) DataNode reads checksums even if client does not need them

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463148#comment-13463148 ] Todd Lipcon commented on HDFS-3429: --- The failed test seems like it might be legit. I will

[jira] [Updated] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3972: -- Description: In a secure HA cluster, we're seeing the following issue on the NN when the trash emptier

[jira] [Updated] (HDFS-3373) FileContext HDFS implementation can leak socket caches

2012-09-25 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-3373: -- Status: Open (was: Patch Available) FileContext HDFS implementation can leak socket caches

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2012-09-25 Thread Steve Hoffman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463168#comment-13463168 ] Steve Hoffman commented on HDFS-1312: - bq. Yes, I think this should be fixed. This was

[jira] [Updated] (HDFS-3373) FileContext HDFS implementation can leak socket caches

2012-09-25 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-3373: -- Attachment: HDFS-3373.trunk.patch.4 Thanks Nicholas and sorry for overlooking that review comment in

[jira] [Updated] (HDFS-3373) FileContext HDFS implementation can leak socket caches

2012-09-25 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-3373: -- Status: Patch Available (was: Open) FileContext HDFS implementation can leak socket caches

[jira] [Updated] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3972: -- Attachment: hdfs-3972.txt The root cause of the issue is that, in HA, the TrashEmptier is started from

[jira] [Updated] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3972: -- Status: Patch Available (was: Open) Trash emptier fails in secure HA cluster

[jira] [Created] (HDFS-3973) Old trash directories are never deleted on upgrade from 1.x

2012-09-25 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created HDFS-3973: - Summary: Old trash directories are never deleted on upgrade from 1.x Key: HDFS-3973 URL: https://issues.apache.org/jira/browse/HDFS-3973 Project: Hadoop

[jira] [Updated] (HDFS-3973) Old trash directories are never deleted on upgrade from 1.x

2012-09-25 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3973: -- Priority: Critical (was: Major) Marking the bug as critical. Old trash

[jira] [Commented] (HDFS-3971) Add a resume feature to the copyFromLocal and put commands

2012-09-25 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463192#comment-13463192 ] Robert Joseph Evans commented on HDFS-3971: --- It almost sounds like you want to

[jira] [Commented] (HDFS-225) Expose HDFS as a WebDAV store

2012-09-25 Thread Moritz Moeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463215#comment-13463215 ] Moritz Moeller commented on HDFS-225: - HDFS-2178 exposes a different interface, not

[jira] [Created] (HDFS-3974) dfsadmin -metasave throws NPE when under-replicated blocks are recently deleted

2012-09-25 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-3974: - Summary: dfsadmin -metasave throws NPE when under-replicated blocks are recently deleted Key: HDFS-3974 URL: https://issues.apache.org/jira/browse/HDFS-3974 Project:

[jira] [Resolved] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-1322. Resolution: Invalid As Suresh commented, this is working as designed. If you don't

[jira] [Created] (HDFS-3975) Add a test for umask in webhdfs

2012-09-25 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-3975: -- Summary: Add a test for umask in webhdfs Key: HDFS-3975 URL: https://issues.apache.org/jira/browse/HDFS-3975 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-3975) Add a test for umask in webhdfs

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3975: --- Attachment: HDFS-3975.001.patch Add a test for umask in webhdfs

[jira] [Updated] (HDFS-3975) Add a test for umask in webhdfs

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3975: --- Status: Patch Available (was: Open) Add a test for umask in webhdfs

[jira] [Updated] (HDFS-3576) create a configuration key for NameNode default RPC port

2012-09-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3576: - Attachment: HDFS-3576.patch create a configuration key for NameNode default RPC port

[jira] [Commented] (HDFS-3576) create a configuration key for NameNode default RPC port

2012-09-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463284#comment-13463284 ] Brandon Li commented on HDFS-3576: -- {quote}Found a few changes required after a

[jira] [Commented] (HDFS-3975) Add a test for umask in webhdfs

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463290#comment-13463290 ] Todd Lipcon commented on HDFS-3975: --- +1 pending jenkins Add a test for

[jira] [Commented] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463291#comment-13463291 ] Todd Lipcon commented on HDFS-1322: --- Shouldn't we update the javadoc to be clearer, as

[jira] [Created] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-3976: - Summary: SampleQuantiles#query is O(N^2) instead of O(N) Key: HDFS-3976 URL: https://issues.apache.org/jira/browse/HDFS-3976 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3976: -- Attachment: hdfs-3976-1.patch Small patch. TestMutableMetrics still passes, so I think correctness is

[jira] [Created] (HDFS-3977) Incompatible change between hadoop-1 and hadoop-2 when the dfs.hosts and dfs.hosts.exclude files are not present

2012-09-25 Thread Arpit Gupta (JIRA)
Arpit Gupta created HDFS-3977: - Summary: Incompatible change between hadoop-1 and hadoop-2 when the dfs.hosts and dfs.hosts.exclude files are not present Key: HDFS-3977 URL:

[jira] [Updated] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3976: -- Target Version/s: 2.0.3-alpha Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Attachment: HDFS-3753.001.patch This patch adds the hadoop-common native library

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Status: Patch Available (was: Open) Tests don't run with native libraries

[jira] [Moved] (HDFS-3978) Document backward incompatible changes introduced by HADOOP-8551

2012-09-25 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta moved HADOOP-8846 to HDFS-3978: --- Affects Version/s: (was: 2.0.2-alpha) (was:

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Attachment: (was: HDFS-3753.001.patch) Tests don't run with native libraries

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Attachment: HDFS-3975.001.patch Tests don't run with native libraries

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Attachment: (was: HDFS-3975.001.patch) Tests don't run with native libraries

[jira] [Updated] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3753: --- Attachment: HDFS-3753.001.patch Tests don't run with native libraries

[jira] [Commented] (HDFS-3957) Change MutableQuantiles to use a shared thread for rolling over metrics

2012-09-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463320#comment-13463320 ] Andrew Wang commented on HDFS-3957: --- No tests as per prior reasoning. The latest patch

[jira] [Commented] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463330#comment-13463330 ] Todd Lipcon commented on HDFS-3976: --- While you're at it, why not get rid of size() and

[jira] [Commented] (HDFS-3977) Incompatible change between hadoop-1 and hadoop-2 when the dfs.hosts and dfs.hosts.exclude files are not present

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1346#comment-1346 ] Todd Lipcon commented on HDFS-3977: --- Hi Arpit. This was explicitly changed in HDFS-3446

[jira] [Commented] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463335#comment-13463335 ] Eli Collins commented on HDFS-3972: --- +1 pending jenkins, looks great

[jira] [Commented] (HDFS-3957) Change MutableQuantiles to use a shared thread for rolling over metrics

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463336#comment-13463336 ] Todd Lipcon commented on HDFS-3957: --- Looks good to me. Sorry for being MIA. I'll commit

[jira] [Updated] (HDFS-3957) Change MutableQuantiles to use a shared thread for rolling over metrics

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3957: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463349#comment-13463349 ] Andrew Wang commented on HDFS-3976: --- I suppose, though I think we need to keep a counter

[jira] [Commented] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463358#comment-13463358 ] Todd Lipcon commented on HDFS-3976: --- I guess what you're doing now makes more sense then,

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-09-25 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912.002.patch Some cleanup for the patch. Detecting and avoiding stale

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463373#comment-13463373 ] Kan Zhang commented on HDFS-744: bq. As long as the syncs (or flushes) are not serialized

[jira] [Updated] (HDFS-2798) Append may race with datanode block scanner, causing replica to be incorrectly marked corrupt

2012-09-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-2798: - Assignee: Brandon Li Append may race with datanode block scanner, causing replica to be

[jira] [Commented] (HDFS-2798) Append may race with datanode block scanner, causing replica to be incorrectly marked corrupt

2012-09-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463380#comment-13463380 ] Brandon Li commented on HDFS-2798: -- I think this problem has been fixed by HDFS-2525.

[jira] [Resolved] (HDFS-2798) Append may race with datanode block scanner, causing replica to be incorrectly marked corrupt

2012-09-25 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-2798. -- Resolution: Duplicate Target Version/s: 2.0.0-alpha, 0.23.3, 3.0.0 (was: 0.23.3, 2.0.0-alpha,

[jira] [Commented] (HDFS-3373) FileContext HDFS implementation can leak socket caches

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463385#comment-13463385 ] Hadoop QA commented on HDFS-3373: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3975) Add a test for umask in webhdfs

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463396#comment-13463396 ] Hadoop QA commented on HDFS-3975: - {color:green}+1 overall{color}. Here are the results of

[jira] [Reopened] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-1322: Assignee: Colin Patrick McCabe (was: Anwar Abdus-Samad) reopening as a doc

[jira] [Updated] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1322: --- Description: The javadoc of DFSClient.mkdirs() says that the permissions of created

[jira] [Updated] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1322: --- Attachment: HDFS-1322.001.patch * update documentation for

[jira] [Updated] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1322: --- Status: Patch Available (was: Reopened) DistributedFileSystem.mkdirs(dir,

[jira] [Commented] (HDFS-3972) Trash emptier fails in secure HA cluster

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463422#comment-13463422 ] Hadoop QA commented on HDFS-3972: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463455#comment-13463455 ] Colin Patrick McCabe commented on HDFS-3540: bq. Hi Colin, thanks for posting a

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-09-25 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463454#comment-13463454 ] Colin Patrick McCabe commented on HDFS-3540: bq. Hi Colin, thanks for posting a

[jira] [Assigned] (HDFS-3974) dfsadmin -metasave throws NPE when under-replicated blocks are recently deleted

2012-09-25 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reassigned HDFS-3974: --- Assignee: Andy Isaacson dfsadmin -metasave throws NPE when under-replicated blocks are

[jira] [Commented] (HDFS-3976) SampleQuantiles#query is O(N^2) instead of O(N)

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463460#comment-13463460 ] Hadoop QA commented on HDFS-3976: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3910) DFSTestUtil#waitReplication should timeout

2012-09-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463469#comment-13463469 ] Arun C Murthy commented on HDFS-3910: - Eli - this broke MR tests' compilation:

[jira] [Commented] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463482#comment-13463482 ] Hadoop QA commented on HDFS-1322: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3576) create a configuration key for NameNode default RPC port

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463487#comment-13463487 ] Hadoop QA commented on HDFS-3576: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463505#comment-13463505 ] Lars Hofhansl commented on HDFS-744: I think the problem is that we have to enqueue the

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463512#comment-13463512 ] Lars Hofhansl commented on HDFS-744: Another approach would be to wait in the responder

[jira] [Created] (HDFS-3979) Fix hsync and hflush semantics.

2012-09-25 Thread Lars Hofhansl (JIRA)
Lars Hofhansl created HDFS-3979: --- Summary: Fix hsync and hflush semantics. Key: HDFS-3979 URL: https://issues.apache.org/jira/browse/HDFS-3979 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3979) Fix hsync and hflush semantics.

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463515#comment-13463515 ] Lars Hofhansl commented on HDFS-3979: - Also see my comment here:

[jira] [Assigned] (HDFS-3979) Fix hsync and hflush semantics.

2012-09-25 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reassigned HDFS-3979: --- Assignee: Lars Hofhansl Fix hsync and hflush semantics. ---

[jira] [Commented] (HDFS-3753) Tests don't run with native libraries

2012-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13463522#comment-13463522 ] Hadoop QA commented on HDFS-3753: - {color:red}-1 overall{color}. Here are the results of