[jira] [Updated] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4139: --- Status: Patch Available (was: Open) > fuse-dfs RO mode still allows file truncati

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492826#comment-13492826 ] Colin Patrick McCabe commented on HDFS-4139: Yes, currently we're implementing

[jira] [Created] (HDFS-4164) fuse_dfs: add -ltr to the compiler command line on Linux

2012-11-07 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4164: -- Summary: fuse_dfs: add -ltr to the compiler command line on Linux Key: HDFS-4164 URL: https://issues.apache.org/jira/browse/HDFS-4164 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4164) fuse_dfs: add -lrt to the compiler command line on Linux

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4164: --- Summary: fuse_dfs: add -lrt to the compiler command line on Linux (was: fuse_dfs: add

[jira] [Updated] (HDFS-4164) fuse_dfs: add -lrt to the compiler command line on Linux

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4164: --- Status: Patch Available (was: Open) > fuse_dfs: add -lrt to the compiler command

[jira] [Updated] (HDFS-4164) fuse_dfs: add -lrt to the compiler command line on Linux

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4164: --- Attachment: HDFS-4164.001.patch > fuse_dfs: add -lrt to the compiler command line

[jira] [Commented] (HDFS-4164) fuse_dfs: add -lrt to the compiler command line on Linux

2012-11-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492905#comment-13492905 ] Colin Patrick McCabe commented on HDFS-4164: The build failure looks like this:

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493429#comment-13493429 ] Colin Patrick McCabe commented on HDFS-4140: I will add a reference to the JIRA

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493501#comment-13493501 ] Colin Patrick McCabe commented on HDFS-4140: Using {{flags |= O_APPEND}} provid

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13493668#comment-13493668 ] Colin Patrick McCabe commented on HDFS-4140: OK, I misinterpreted your comment

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-11-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.004.patch add references to this jira > fuse-df

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.022.patch fix warnings > DFS read performance subop

[jira] [Created] (HDFS-4173) If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup

2012-11-09 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4173: -- Summary: If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup Key: HDFS-4173 URL: https://issues.apache.org/jira/browse/H

[jira] [Updated] (HDFS-4173) If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup

2012-11-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4173: --- Status: Patch Available (was: Open) > If the NameNode has already been formatted,

[jira] [Updated] (HDFS-4173) If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup

2012-11-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4173: --- Attachment: HDFS-4173.001.patch > If the NameNode has already been formatted, but

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495456#comment-13495456 ] Colin Patrick McCabe commented on HDFS-4139: I tested this manually with some a

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495551#comment-13495551 ] Colin Patrick McCabe commented on HDFS-4139: {code} cmccabe@keter:~/hadoop3> CL

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495711#comment-13495711 ] Colin Patrick McCabe commented on HDFS-4139: Hi Eli, I can't remove the read_o

[jira] [Updated] (HDFS-3975) Add a test for umask in FileSystemContractBaseTest

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3975: --- Attachment: HDFS-3975.004.patch use "assume" as Eli suggested > Add a

[jira] [Updated] (HDFS-1322) DistributedFileSystem.mkdirs(dir, dirPermission) doesn't set the permissions of created dir to dirPermission

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-1322: --- Attachment: HDFS-1322.002.patch address nits > DistributedFileSystem.

[jira] [Updated] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4139: --- Attachment: HDFS-4139.002.patch yeah, you're right-- we can get rid of the entry in df

[jira] [Commented] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496395#comment-13496395 ] Colin Patrick McCabe commented on HDFS-4139: test failure is unrelated-- this h

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496492#comment-13496492 ] Colin Patrick McCabe commented on HDFS-347: --- I will see if I can reuse the old Blo

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.024.patch * Use the previous BlockReaderLocal code, with a few updat

[jira] [Updated] (HDFS-3975) Add a test for umask in FileSystemContractBaseTest

2012-11-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3975: --- Attachment: HDFS-3975.005.patch it looks like Assume doesn't work with junit3. So use

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496767#comment-13496767 ] Colin Patrick McCabe commented on HDFS-347: --- The speed issue with short-circuit re

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.025.patch It looks like junit needs some prodding not to try to dire

[jira] [Commented] (HDFS-4104) dfs -test -d prints inappropriate error on nonexistent directory

2012-11-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13497553#comment-13497553 ] Colin Patrick McCabe commented on HDFS-4104: looks reasonable to me

[jira] [Updated] (HDFS-3975) Add a test for umask in FileSystemContractBaseTest

2012-11-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3975: --- Attachment: HDFS-3975.006.patch remove 'import assume' > Add a test f

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498266#comment-13498266 ] Colin Patrick McCabe commented on HDFS-347: --- test failure is unrelated (this chang

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-11-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498420#comment-13498420 ] Colin Patrick McCabe commented on HDFS-347: --- Here are some benchmarks I did locall

[jira] [Commented] (HDFS-4196) Support renaming of snapshots

2012-11-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498497#comment-13498497 ] Colin Patrick McCabe commented on HDFS-4196: Hi Jing, This looks good to me.

[jira] [Commented] (HDFS-4196) Support renaming of snapshots

2012-11-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498539#comment-13498539 ] Colin Patrick McCabe commented on HDFS-4196: Sure. It can wait. I was just cu

[jira] [Commented] (HDFS-4175) Extend existing TestSnapshot to support more complicated directory structure and more modifications on current files/direcotories

2012-11-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499150#comment-13499150 ] Colin Patrick McCabe commented on HDFS-4175: Hi Jing, This one doesn't apply f

[jira] [Commented] (HDFS-4175) Extend existing TestSnapshot to support more complicated directory structure and more modifications on current files/direcotories

2012-11-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13499158#comment-13499158 ] Colin Patrick McCabe commented on HDFS-4175: {code} > /** > * The number of it

[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2012-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500475#comment-13500475 ] Colin Patrick McCabe commented on HDFS-4210: It should definitely throw a more

[jira] [Commented] (HDFS-4209) Clean up FSDirectory and INode

2012-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13500498#comment-13500498 ] Colin Patrick McCabe commented on HDFS-4209: This looks good. I especially lik

[jira] [Commented] (HDFS-4173) If the NameNode has already been formatted, but a QuroumJournal has not, auto-format it on startup

2012-11-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501379#comment-13501379 ] Colin Patrick McCabe commented on HDFS-4173: bq. so this would cause the NN to

[jira] [Created] (HDFS-4214) OfflineEditsViewer should print out the offset at which it encountered an error

2012-11-20 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4214: -- Summary: OfflineEditsViewer should print out the offset at which it encountered an error Key: HDFS-4214 URL: https://issues.apache.org/jira/browse/HDFS-4214

[jira] [Updated] (HDFS-4214) OfflineEditsViewer should print out the offset at which it encountered an error

2012-11-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4214: --- Attachment: HDFS-4214.001.patch > OfflineEditsViewer should print out the offset a

[jira] [Updated] (HDFS-4214) OfflineEditsViewer should print out the offset at which it encountered an error

2012-11-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4214: --- Status: Patch Available (was: Open) > OfflineEditsViewer should print out the off

[jira] [Commented] (HDFS-4214) OfflineEditsViewer should print out the offset at which it encountered an error

2012-11-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13501505#comment-13501505 ] Colin Patrick McCabe commented on HDFS-4214: It's already logged by this code i

[jira] [Commented] (HDFS-4214) OfflineEditsViewer should print out the offset at which it encountered an error

2012-11-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505178#comment-13505178 ] Colin Patrick McCabe commented on HDFS-4214: I doubt that {{EditLogInputStream#

[jira] [Commented] (HDFS-3307) when save FSImage ,HDFS( or SecondaryNameNode or FSImage)can't handle some file whose file name has some special messy code(乱码)

2012-11-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506105#comment-13506105 ] Colin Patrick McCabe commented on HDFS-3307: I ran TestUTF8AndStringGetBytes.ja

[jira] [Created] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-11-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4235: -- Summary: when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings Key: HDFS-4235 URL: https://issues.apache.org/jira/browse/HDFS-42

[jira] [Commented] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-11-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13506846#comment-13506846 ] Colin Patrick McCabe commented on HDFS-4235: I can't attach the file where this

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13508993#comment-13508993 ] Colin Patrick McCabe commented on HDFS-4045: I think that Todd's idea of simply

[jira] [Commented] (HDFS-4246) The exclude node list should be more forgiving, for each output stream

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509089#comment-13509089 ] Colin Patrick McCabe commented on HDFS-4246: This change makes a lot of sense t

[jira] [Commented] (HDFS-4249) Add status NameNode startup to webUI

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509109#comment-13509109 ] Colin Patrick McCabe commented on HDFS-4249: Seems like a good idea to me. It

[jira] [Commented] (HDFS-4251) NN connections can use up all fds leaving none for rolling journal files

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509135#comment-13509135 ] Colin Patrick McCabe commented on HDFS-4251: This is a good find, Sanjay. One

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509281#comment-13509281 ] Colin Patrick McCabe commented on HDFS-4253: Good find, Andy! This issue could

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509310#comment-13509310 ] Colin Patrick McCabe commented on HDFS-4253: More about that {{compare}} method

[jira] [Updated] (HDFS-4157) libhdfs: hdfsTell could be implemented a smarter than it is

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4157: --- Description: In libhdfs, {{hdfsTell}} currently makes a JNI call into {{DFSClient}} to

[jira] [Updated] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4235: --- Attachment: HDFS-4235.001.patch here's a patch which contains unit tests which demonst

[jira] [Updated] (HDFS-4235) when outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings

2012-12-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4235: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) > when o

[jira] [Commented] (HDFS-4045) SecondaryNameNode cannot read from QuorumJournal URI

2012-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509948#comment-13509948 ] Colin Patrick McCabe commented on HDFS-4045: Here's a proposal that might make

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.005.patch * refactor the 'POSIX flag to libhdfs flag' translatio

[jira] [Commented] (HDFS-4103) Support O(1) snapshot creation

2012-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13510231#comment-13510231 ] Colin Patrick McCabe commented on HDFS-4103: * If objects of type {{INodeDirect

[jira] [Commented] (HDFS-3049) During the normal loading NN startup process, fall back on a different EditLog if we see one that is corrupt

2012-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13510235#comment-13510235 ] Colin Patrick McCabe commented on HDFS-3049: In {{RedundantEditLogInputStream}}

[jira] [Commented] (HDFS-2095) org.apache.hadoop.hdfs.server.datanode.DataNode#checkDiskError produces check storm making data node unavailable

2012-12-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13510717#comment-13510717 ] Colin Patrick McCabe commented on HDFS-2095: bq. Another approach would be to d

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.006.patch * address Andy's suggestions > fuse-d

[jira] [Created] (HDFS-4279) NameNode does not initialize generic conf keys when started with -recover

2012-12-05 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4279: -- Summary: NameNode does not initialize generic conf keys when started with -recover Key: HDFS-4279 URL: https://issues.apache.org/jira/browse/HDFS-4279 Pro

[jira] [Updated] (HDFS-4279) NameNode does not initialize generic conf keys when started with -recover

2012-12-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4279: --- Attachment: HDFS-3236.002.patch > NameNode does not initialize generic conf keys w

[jira] [Created] (HDFS-4283) Spurious Test failures in TestEditLog.testFuzzSequences

2012-12-05 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4283: -- Summary: Spurious Test failures in TestEditLog.testFuzzSequences Key: HDFS-4283 URL: https://issues.apache.org/jira/browse/HDFS-4283 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13511161#comment-13511161 ] Colin Patrick McCabe commented on HDFS-4140: The test failure is bogus; we didn

[jira] [Resolved] (HDFS-4283) Spurious Test failures in TestEditLog.testFuzzSequences

2012-12-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-4283. Resolution: Duplicate > Spurious Test failures in TestEditLog.testFuzzSequences

[jira] [Commented] (HDFS-4282) TestEditLog.testFuzzSequences FAILED in all pre-commit test

2012-12-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13512013#comment-13512013 ] Colin Patrick McCabe commented on HDFS-4282: There's another option which you m

[jira] [Updated] (HDFS-4279) NameNode does not initialize generic conf keys when started with -recover

2012-12-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4279: --- Status: Patch Available (was: Open) > NameNode does not initialize generic conf k

[jira] [Commented] (HDFS-4279) NameNode does not initialize generic conf keys when started with -recover

2012-12-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13526885#comment-13526885 ] Colin Patrick McCabe commented on HDFS-4279: To test this manually, I set up a

[jira] [Created] (HDFS-4291) edit log unit tests leave stray test_edit_log_file around

2012-12-07 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4291: -- Summary: edit log unit tests leave stray test_edit_log_file around Key: HDFS-4291 URL: https://issues.apache.org/jira/browse/HDFS-4291 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4291) edit log unit tests leave stray test_edit_log_file around

2012-12-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4291: --- Attachment: HDFS-4291.001.patch > edit log unit tests leave stray test_edit_log_fi

[jira] [Updated] (HDFS-4291) edit log unit tests leave stray test_edit_log_file around

2012-12-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4291: --- Status: Patch Available (was: Open) > edit log unit tests leave stray test_edit_l

[jira] [Commented] (HDFS-4103) Support O(1) snapshot creation

2012-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13528595#comment-13528595 ] Colin Patrick McCabe commented on HDFS-4103: The new patch looks better. Did y

[jira] [Commented] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529342#comment-13529342 ] Colin Patrick McCabe commented on HDFS-4304: I don't think it should be configu

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: HDFS-4304.001.patch > Make FSEditLogOp.MAX_OP_SIZE configurable >

[jira] [Commented] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529465#comment-13529465 ] Colin Patrick McCabe commented on HDFS-4304: Here's a patch which makes it conf

[jira] [Commented] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529472#comment-13529472 ] Colin Patrick McCabe commented on HDFS-4304: In addition to the unit test, I al

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Status: Patch Available (was: Open) > Make FSEditLogOp.MAX_OP_SIZE configurable >

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: HDFS-4304.002.patch > Make FSEditLogOp.MAX_OP_SIZE configurable >

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: (was: HDFS-4304.002.patch) > Make FSEditLogOp.MAX_OP_SIZE configur

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: HDFS-4304.002.patch > Make FSEditLogOp.MAX_OP_SIZE configurable >

[jira] [Created] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4307: -- Summary: SocketCache should use monotonic time Key: HDFS-4307 URL: https://issues.apache.org/jira/browse/HDFS-4307 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4307: --- Attachment: HDFS-4307.001.patch > SocketCache should use monotonic time >

[jira] [Updated] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4307: --- Status: Patch Available (was: Open) > SocketCache should use monotonic time > ---

[jira] [Updated] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4307: --- Attachment: HDFS-4307.002.patch > SocketCache should use monotonic time >

[jira] [Commented] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13530408#comment-13530408 ] Colin Patrick McCabe commented on HDFS-4304: bq. Would you elaborate on the rea

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.007.patch * refactor for clarity * don't check length > 0; it s

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: HDFS-4304.003.patch I updated the comment to reflect the fact that opcode

[jira] [Commented] (HDFS-4307) SocketCache should use monotonic time

2012-12-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13530552#comment-13530552 ] Colin Patrick McCabe commented on HDFS-4307: yeah, sadly changing the system cl

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.026.patch address todd's comments (see reviewboard)

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.008.patch add special case for using WRONLY on 0-length files

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: (was: HDFS-4140.008.patch) > fuse-dfs handles open(O_TRUNC) poorly

[jira] [Updated] (HDFS-4140) fuse-dfs handles open(O_TRUNC) poorly

2012-12-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4140: --- Attachment: HDFS-4140.008.patch > fuse-dfs handles open(O_TRUNC) poorly >

[jira] [Updated] (HDFS-4304) Make FSEditLogOp.MAX_OP_SIZE configurable

2012-12-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4304: --- Attachment: HDFS-4304.004.patch address aaron's suggestions > Make FS

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13532864#comment-13532864 ] Colin Patrick McCabe commented on HDFS-4253: Thanks for clarifying that. I sti

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.027.patch This doesn't address all the points in the reviewboard (st

[jira] [Commented] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-12-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533132#comment-13533132 ] Colin Patrick McCabe commented on HDFS-4253: bq. It would be possible to remove

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.029.patch fixes: * put DomainSockets back in the cache right after

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534295#comment-13534295 ] Colin Patrick McCabe commented on HDFS-347: --- I did some manual testing and found t

[jira] [Created] (HDFS-4319) FSShell copyToLocal creates files with the executable bit set

2012-12-17 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-4319: -- Summary: FSShell copyToLocal creates files with the executable bit set Key: HDFS-4319 URL: https://issues.apache.org/jira/browse/HDFS-4319 Project: Hadoop

<    1   2   3   4   5   6   7   8   9   10   >