[jira] [Commented] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198791#comment-14198791 ] Colin Patrick McCabe commented on HDFS-7017: bq. Unfortunately we are the

[jira] [Updated] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7199: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Resolved] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7199. Resolution: Fixed Fix Version/s: (was: 2.7.0) 2.6.0

[jira] [Reopened] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7199: DFSOutputStream should not silently drop data if DataStreamer crashes with an

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196496#comment-14196496 ] Colin Patrick McCabe commented on HDFS-7199: Can you post a new patch with the

[jira] [Commented] (HDFS-7017) Implement OutputStream for libhdfs3

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196585#comment-14196585 ] Colin Patrick McCabe commented on HDFS-7017: Thanks, this looks better. bq. I

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196603#comment-14196603 ] Colin Patrick McCabe commented on HDFS-7314: Thanks, [~mingma]. It's

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196619#comment-14196619 ] Colin Patrick McCabe commented on HDFS-3107: bq. There is the option to treat

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-11-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1419#comment-1419 ] Colin Patrick McCabe commented on HDFS-7199: +1 pending jenkins

[jira] [Commented] (HDFS-1362) Provide volume management functionality for DataNode

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194787#comment-14194787 ] Colin Patrick McCabe commented on HDFS-1362: Great job, [~eddyxu]! Provide

[jira] [Commented] (HDFS-7314) Aborted DFSClient's impact on long running service like YARN

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194790#comment-14194790 ] Colin Patrick McCabe commented on HDFS-7314: bq. I think DFSClient#abort() can

[jira] [Created] (HDFS-7325) Prevent thundering herd problem in ByteArrayManager by using notify not notifyAll

2014-11-03 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7325: -- Summary: Prevent thundering herd problem in ByteArrayManager by using notify not notifyAll Key: HDFS-7325 URL: https://issues.apache.org/jira/browse/HDFS-7325

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194803#comment-14194803 ] Colin Patrick McCabe commented on HDFS-7276: Re: deadlock discussion. It's

[jira] [Commented] (HDFS-7316) DistCp cannot handle : colon in filename

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194791#comment-14194791 ] Colin Patrick McCabe commented on HDFS-7316: Is this a duplicate of

[jira] [Updated] (HDFS-7325) Prevent thundering herd problem in ByteArrayManager by using notify not notifyAll

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7325: --- Attachment: HDFS-7325.001.patch Prevent thundering herd problem in ByteArrayManager

[jira] [Updated] (HDFS-7325) Prevent thundering herd problem in ByteArrayManager by using notify not notifyAll

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7325: --- Assignee: Colin Patrick McCabe Target Version/s: 2.6.0 Affects

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194846#comment-14194846 ] Colin Patrick McCabe commented on HDFS-3107: Great. If there are no

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194902#comment-14194902 ] Colin Patrick McCabe commented on HDFS-6698: Thanks, Lars. Sorry for the

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194904#comment-14194904 ] Colin Patrick McCabe commented on HDFS-6735: Hi Lars, Thanks for working on

[jira] [Created] (HDFS-7326) Add documentation for hdfs debug commands

2014-11-03 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7326: -- Summary: Add documentation for hdfs debug commands Key: HDFS-7326 URL: https://issues.apache.org/jira/browse/HDFS-7326 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194916#comment-14194916 ] Colin Patrick McCabe commented on HDFS-6917: Thanks for the reminder. I filed

[jira] [Created] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7341: -- Summary: Add initial snapshot support based on pipeline recovery Key: HDFS-7341 URL: https://issues.apache.org/jira/browse/HDFS-7341 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: editsStored_Nov3 Add initial snapshot support based on pipeline recovery

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: editsStored_Nov3.xml Add initial snapshot support based on pipeline

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7341: --- Attachment: HDFS-3107_Nov3.patch This is the patch originally posted by [~zero45] on

[jira] [Commented] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195598#comment-14195598 ] Colin Patrick McCabe commented on HDFS-7341: As discussed on the parent subtask

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195607#comment-14195607 ] Colin Patrick McCabe commented on HDFS-3107: Hi Konstantin, Yes, I was aware

[jira] [Commented] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192134#comment-14192134 ] Colin Patrick McCabe commented on HDFS-7278: Hi [~dlmarion], The

[jira] [Commented] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192166#comment-14192166 ] Colin Patrick McCabe commented on HDFS-7309: Thanks for the review, Ravi. bq.

[jira] [Updated] (HDFS-7125) Report failures during adding or removing volumes

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7125: --- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-1362) Report failures

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192373#comment-14192373 ] Colin Patrick McCabe commented on HDFS-7276: Looks better, thanks. bq.

[jira] [Commented] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192376#comment-14192376 ] Colin Patrick McCabe commented on HDFS-7309: I'm not that familiar with

[jira] [Commented] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192381#comment-14192381 ] Colin Patrick McCabe commented on HDFS-6917: Thanks for the review, Andrew.

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192430#comment-14192430 ] Colin Patrick McCabe commented on HDFS-3107: Thanks for the clarification. I

[jira] [Updated] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6917: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192487#comment-14192487 ] Colin Patrick McCabe commented on HDFS-7276: bq. This is a simple concurrent

[jira] [Commented] (HDFS-7017) Implement OutputStream for libhdfs3

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190689#comment-14190689 ] Colin Patrick McCabe commented on HDFS-7017: Thanks for posting this, Zhanwei.

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190706#comment-14190706 ] Colin Patrick McCabe commented on HDFS-3107: bq. And it needs to be atomic e.g.

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190712#comment-14190712 ] Colin Patrick McCabe commented on HDFS-7199: The else should be on the same

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190727#comment-14190727 ] Colin Patrick McCabe commented on HDFS-7276: bq. The manager is going to be

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190742#comment-14190742 ] Colin Patrick McCabe commented on HDFS-7276: So, if we're managing powers of 2,

[jira] [Commented] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190773#comment-14190773 ] Colin Patrick McCabe commented on HDFS-7309: So, the intention when writing

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190785#comment-14190785 ] Colin Patrick McCabe commented on HDFS-3107: The point is that the original

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190942#comment-14190942 ] Colin Patrick McCabe commented on HDFS-3107: bq. So, but the new patch from

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190993#comment-14190993 ] Colin Patrick McCabe commented on HDFS-7035: +1 pending jenkins. Thanks, Eddy.

[jira] [Updated] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6917: --- Attachment: HDFS-6917.004.patch Add an hdfs debug command to validate blocks, call

[jira] [Updated] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7309: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7309: --- Attachment: HDFS-7309.001.patch Implement entity refs in XMLUtils.

[jira] [Updated] (HDFS-7035) Make adding a new data directory to the DataNode an atomic operation and improve error handling

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7035: --- Summary: Make adding a new data directory to the DataNode an atomic operation and

[jira] [Updated] (HDFS-7035) Make adding a new data directory to the DataNode an atomic operation and improve error handling

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7035: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7309: --- Attachment: HDFS-7309.002.patch Fix one more call site to have the boolean

[jira] [Issue Comment Deleted] (HDFS-7309) XMLUtils.mangleXmlString doesn't seem to handle less than sign

2014-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7309: --- Comment: was deleted (was: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188828#comment-14188828 ] Colin Patrick McCabe commented on HDFS-6994: bq. Hi, I've been porting libhdfs3

[jira] [Commented] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188841#comment-14188841 ] Colin Patrick McCabe commented on HDFS-7287: bq. Here's the patch without the

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188861#comment-14188861 ] Colin Patrick McCabe commented on HDFS-7199: I'm having trouble understanding

[jira] [Updated] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7287: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1416#comment-1416 ] Colin Patrick McCabe commented on HDFS-3107: Good point, Nicholas. Note that

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189148#comment-14189148 ] Colin Patrick McCabe commented on HDFS-7035: This looks good. Thanks, Eddy.

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189165#comment-14189165 ] Colin Patrick McCabe commented on HDFS-7035: P.S. I like the VolumeBuilder

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189469#comment-14189469 ] Colin Patrick McCabe commented on HDFS-7035: {{Storage.java}}: remove

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7235: --- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Commented] (HDFS-7173) Only keep successfully loaded volumes in the configuration.

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187849#comment-14187849 ] Colin Patrick McCabe commented on HDFS-7173: Can we roll this into HDFS-6727?

[jira] [Comment Edited] (HDFS-7173) Only keep successfully loaded volumes in the configuration.

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187849#comment-14187849 ] Colin Patrick McCabe edited comment on HDFS-7173 at 10/29/14 1:13 AM:

[jira] [Comment Edited] (HDFS-7173) Only keep successfully loaded volumes in the configuration.

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187849#comment-14187849 ] Colin Patrick McCabe edited comment on HDFS-7173 at 10/29/14 1:13 AM:

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187857#comment-14187857 ] Colin Patrick McCabe commented on HDFS-7035: I think it would be easier to

[jira] [Comment Edited] (HDFS-7035) Make adding volume an atomic operation.

2014-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187857#comment-14187857 ] Colin Patrick McCabe edited comment on HDFS-7035 at 10/29/14 1:25 AM:

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185421#comment-14185421 ] Colin Patrick McCabe commented on HDFS-7276: Are {{Packet}} objects long-lived?

[jira] [Updated] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7278: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7282) TestShortCircuitCache and TestBlockReaderFactory have failures caused by TemporarySocketDirectory getting garbage collected before Datanode starts up accessing the dir c

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185440#comment-14185440 ] Colin Patrick McCabe commented on HDFS-7282: I like the patch... we should

[jira] [Commented] (HDFS-7291) Persist in-memory replicas using unbuffered IO should only applies to supported Linux version

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185459#comment-14185459 ] Colin Patrick McCabe commented on HDFS-7291: Thanks for working on this, guys.

[jira] [Commented] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185460#comment-14185460 ] Colin Patrick McCabe commented on HDFS-7287: [~raviprak], it looks like you

[jira] [Commented] (HDFS-7235) Can not decommission DN which has invalid block due to bad disk

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185484#comment-14185484 ] Colin Patrick McCabe commented on HDFS-7235: Thanks, Yongjun. +1. I will

[jira] [Commented] (HDFS-7235) Can not decommission DN which has invalid block due to bad disk

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185488#comment-14185488 ] Colin Patrick McCabe commented on HDFS-7235: Yongjun, the patch doesn't apply

[jira] [Commented] (HDFS-7282) TestShortCircuitCache and TestBlockReaderFactory have failures caused by TemporarySocketDirectory getting garbage collected before Datanode starts up accessing the dir c

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185499#comment-14185499 ] Colin Patrick McCabe commented on HDFS-7282: bq. Not having the closes is not

[jira] [Comment Edited] (HDFS-7282) TestShortCircuitCache and TestBlockReaderFactory have failures caused by TemporarySocketDirectory getting garbage collected before Datanode starts up accessing the

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185499#comment-14185499 ] Colin Patrick McCabe edited comment on HDFS-7282 at 10/27/14 5:53 PM:

[jira] [Commented] (HDFS-7282) TestShortCircuitCache and TestBlockReaderFactory have failures caused by TemporarySocketDirectory getting garbage collected before Datanode starts up accessing the dir c

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186131#comment-14186131 ] Colin Patrick McCabe commented on HDFS-7282: +1. Thanks, Jinghui.

[jira] [Updated] (HDFS-7282) Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7282: --- Summary: Fix intermittent TestShortCircuitCache and TestBlockReaderFactory

[jira] [Updated] (HDFS-7282) Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7282: --- Summary: Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures

[jira] [Updated] (HDFS-7282) Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7282: --- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Updated] (HDFS-7235) DataNode#transferBlock should report blocks that don't exist using reportBadBlock

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7235: --- Summary: DataNode#transferBlock should report blocks that don't exist using

[jira] [Updated] (HDFS-7235) transferBlock should report blocks that don't exist using reportBadBlock

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7235: --- Summary: transferBlock should report blocks that don't exist using reportBadBlock

[jira] [Commented] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186168#comment-14186168 ] Colin Patrick McCabe commented on HDFS-7287: bq. Hi Colin! Thanks for writing

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186195#comment-14186195 ] Colin Patrick McCabe commented on HDFS-7276: Thanks for doing the benchmarks.

[jira] [Commented] (HDFS-7014) Implement input streams and file system functionality

2014-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186198#comment-14186198 ] Colin Patrick McCabe commented on HDFS-7014: Thanks, [~wheat9]. Please do file

[jira] [Updated] (HDFS-6988) Improve HDFS-6581 eviction configuration

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6988: --- Summary: Improve HDFS-6581 eviction configuration (was: Add configurable limit for

[jira] [Updated] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7278: --- Attachment: HDFS-7278.004.patch Add escaping to reconfig part of .apt.vm Add a

[jira] [Updated] (HDFS-6988) Improve HDFS-6581 eviction configuration

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6988: --- Resolution: Fixed Fix Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-7235) Can not decommission DN which has invalid block due to bad disk

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183444#comment-14183444 ] Colin Patrick McCabe commented on HDFS-7235: {code} 1791try { 1792

[jira] [Commented] (HDFS-7258) CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183449#comment-14183449 ] Colin Patrick McCabe commented on HDFS-7258: Thanks, [~xyao] and [~wheat9].

[jira] [Commented] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183462#comment-14183462 ] Colin Patrick McCabe commented on HDFS-7287: Please do not add another

[jira] [Commented] (HDFS-7287) The OfflineImageViewer (OIV) can output invalid XML depending on the filename

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183515#comment-14183515 ] Colin Patrick McCabe commented on HDFS-7287: Thanks, Ravi. +1 from me. I will

[jira] [Updated] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7278: --- Attachment: HDFS-7278.005.patch [~atm]: Good call. Doing this right is a bit tricky.

[jira] [Commented] (HDFS-7173) Only keep successfully loaded volumes in the configuration.

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183585#comment-14183585 ] Colin Patrick McCabe commented on HDFS-7173: {code} /** The unchanged

[jira] [Commented] (HDFS-7014) Implement input streams and file system functionality

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183701#comment-14183701 ] Colin Patrick McCabe commented on HDFS-7014: Thanks, Zhanwei. +1. Implement

[jira] [Resolved] (HDFS-7014) Implement input streams and file system functionality

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7014. Resolution: Fixed Fix Version/s: HDFS-6994 Implement input streams and file

[jira] [Commented] (HDFS-7014) Implement input streams and file system functionality

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183716#comment-14183716 ] Colin Patrick McCabe commented on HDFS-7014: Sorry, [~wheat9]. It looks like

[jira] [Comment Edited] (HDFS-7014) Implement input streams and file system functionality

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183716#comment-14183716 ] Colin Patrick McCabe edited comment on HDFS-7014 at 10/24/14 11:26 PM:

[jira] [Commented] (HDFS-7200) Rename libhdfs3 to libndfs++

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183780#comment-14183780 ] Colin Patrick McCabe commented on HDFS-7200: [~aw], can you comment on this? I

[jira] [Commented] (HDFS-7278) Add a command that allows sysadmins to manually trigger full block reports from a DN

2014-10-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183811#comment-14183811 ] Colin Patrick McCabe commented on HDFS-7278: It's really odd that the test run

[jira] [Commented] (HDFS-7235) Can not decommission DN which has invalid block due to bad disk

2014-10-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181750#comment-14181750 ] Colin Patrick McCabe commented on HDFS-7235: Thanks, Yongjun. This looks good

<    12   13   14   15   16   17   18   19   20   21   >