[jira] [Commented] (HDFS-8113) NullPointerException in BlockInfoContiguous causes block report failure

2015-04-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492577#comment-14492577 ] Colin Patrick McCabe commented on HDFS-8113: It seems like BlockCollection will

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487949#comment-14487949 ] Colin Patrick McCabe commented on HDFS-7993: Thanks for taking a look at this,

[jira] [Updated] (HDFS-8063) Fix intermittent test failures in TestTracing

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8063: --- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Resolved] (HDFS-7188) support build libhdfs3 on windows

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7188. Resolution: Fixed Fix Version/s: HDFS-6994 committed to HDFS-6994 > support b

[jira] [Updated] (HDFS-8063) Fix intermittent test failures in TestTracing

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8063: --- Summary: Fix intermittent test failures in TestTracing (was: Fix test failure in TestT

[jira] [Commented] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487857#comment-14487857 ] Colin Patrick McCabe commented on HDFS-8099: +1. Committed to 2.8. Thanks, Ch

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8099: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487757#comment-14487757 ] Colin Patrick McCabe commented on HDFS-8088: Thanks for looking at this. bq. C

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2015-04-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8099: --- Summary: Change "DFSInputStream has been closed already" message to debug log level (w

[jira] [Commented] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486600#comment-14486600 ] Colin Patrick McCabe commented on HDFS-8088: I have to look at this a bit more,

[jira] [Commented] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486519#comment-14486519 ] Colin Patrick McCabe commented on HDFS-8088: * Shorten the method names we're t

[jira] [Updated] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8088: --- Status: Patch Available (was: Open) > Reduce the number of HTrace spans generated by H

[jira] [Updated] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8088: --- Attachment: HDFS-8088.001.patch > Reduce the number of HTrace spans generated by HDFS r

[jira] [Commented] (HDFS-8063) Fix test failure in TestTracing

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486351#comment-14486351 ] Colin Patrick McCabe commented on HDFS-8063: +1 > Fix test failure in TestTrac

[jira] [Commented] (HDFS-8063) Fix test failure in TestTracing

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486344#comment-14486344 ] Colin Patrick McCabe commented on HDFS-8063: Thanks for the explanation. Yes,

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486320#comment-14486320 ] Colin Patrick McCabe commented on HDFS-7979: Thanks. +1 pending jenkins bq. I

[jira] [Commented] (HDFS-8099) Remove extraneous warning from DFSInputStream.close()

2015-04-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486009#comment-14486009 ] Colin Patrick McCabe commented on HDFS-8099: Can we make it a DEBUG? +1 once t

[jira] [Created] (HDFS-8088) Reduce the number of HTrace spans generated by HDFS reads

2015-04-07 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-8088: -- Summary: Reduce the number of HTrace spans generated by HDFS reads Key: HDFS-8088 URL: https://issues.apache.org/jira/browse/HDFS-8088 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8069) Tracing implementation on DFSInputStream seriously degrades performance

2015-04-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484542#comment-14484542 ] Colin Patrick McCabe commented on HDFS-8069: bq. Josh wrote: As Billie said, we

[jira] [Commented] (HDFS-8063) Fix test failure in TestTracing

2015-04-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484520#comment-14484520 ] Colin Patrick McCabe commented on HDFS-8063: Thanks for looking at this, [~iwas

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-04-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484480#comment-14484480 ] Colin Patrick McCabe commented on HDFS-7980: +1 for adding a unit test. > Incr

[jira] [Comment Edited] (HDFS-8069) Tracing implementation on DFSInputStream seriously degrades performance

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482120#comment-14482120 ] Colin Patrick McCabe edited comment on HDFS-8069 at 4/6/15 10:48 PM:

[jira] [Commented] (HDFS-8069) Tracing implementation on DFSInputStream seriously degrades performance

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482120#comment-14482120 ] Colin Patrick McCabe commented on HDFS-8069: I can think of a few ways to solve

[jira] [Comment Edited] (HDFS-8069) Tracing implementation on DFSInputStream seriously degrades performance

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482094#comment-14482094 ] Colin Patrick McCabe edited comment on HDFS-8069 at 4/6/15 10:32 PM:

[jira] [Commented] (HDFS-8069) Tracing implementation on DFSInputStream seriously degrades performance

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482094#comment-14482094 ] Colin Patrick McCabe commented on HDFS-8069: Hi [~elserj], I'm not familiar wi

[jira] [Updated] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7999: --- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481346#comment-14481346 ] Colin Patrick McCabe commented on HDFS-7999: +1. Thnaks, [~sinago]. > FsDatas

[jira] [Updated] (HDFS-8051) FsVolumeList#addVolume should release volume reference if not put it into BlockScanner.

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8051: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Updated] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7996: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14395105#comment-14395105 ] Colin Patrick McCabe commented on HDFS-7999: {code} 1458LOG.warn("F

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14395095#comment-14395095 ] Colin Patrick McCabe commented on HDFS-7996: bq. As shown in the existing code

[jira] [Comment Edited] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387466#comment-14387466 ] Colin Patrick McCabe edited comment on HDFS-7996 at 4/3/15 9:13 PM: -

[jira] [Commented] (HDFS-8051) FsVolumeList#addVolume should release volume reference if not put it into BlockScanner.

2015-04-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394980#comment-14394980 ] Colin Patrick McCabe commented on HDFS-8051: +1. Thanks, Eddy. > FsVolumeList

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391820#comment-14391820 ] Colin Patrick McCabe commented on HDFS-8026: I'm not sure if there is an open j

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391810#comment-14391810 ] Colin Patrick McCabe commented on HDFS-7979: Unfortunately, this latest patch a

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391733#comment-14391733 ] Colin Patrick McCabe commented on HDFS-6634: Hi [~bperroud], HDFS-7446 changed

[jira] [Updated] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7922: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8026: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391707#comment-14391707 ] Colin Patrick McCabe commented on HDFS-7922: Hi [~rakeshr], I agree that the te

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391538#comment-14391538 ] Colin Patrick McCabe commented on HDFS-7060: [~Xinwei Qin], [~brahmareddy], do

[jira] [Comment Edited] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391504#comment-14391504 ] Colin Patrick McCabe edited comment on HDFS-7999 at 4/1/15 9:45 PM: -

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Priority: Major (was: Minor) > Avoid taking locks when sending heartbeats from the Dat

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391504#comment-14391504 ] Colin Patrick McCabe commented on HDFS-7999: bq. Make the heartbeat lockless ca

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Priority: Minor (was: Critical) Issue Type: Improvement (was: Bug) > Avoid taki

[jira] [Comment Edited] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391501#comment-14391501 ] Colin Patrick McCabe edited comment on HDFS-7060 at 4/1/15 9:31 PM: -

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7060: --- Summary: Avoid taking locks when sending heartbeats from the DataNode (was: Contention

[jira] [Commented] (HDFS-7060) Contentions of the monitor of FsDatasetImpl block DN's heartbeat

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391501#comment-14391501 ] Colin Patrick McCabe commented on HDFS-7060: While I agree that making the Data

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391458#comment-14391458 ] Colin Patrick McCabe commented on HDFS-7993: I agree that this is confusing cur

[jira] [Commented] (HDFS-8012) Updatable HAR Filesystem

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391138#comment-14391138 ] Colin Patrick McCabe commented on HDFS-8012: Please ask questions like these on

[jira] [Commented] (HDFS-8000) Potential deadlock #HeartbeatManager

2015-04-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391120#comment-14391120 ] Colin Patrick McCabe commented on HDFS-8000: Have you tried benchmarking load t

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-03-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389768#comment-14389768 ] Colin Patrick McCabe commented on HDFS-8026: I think the previous test timeout

[jira] [Commented] (HDFS-6634) inotify in HDFS

2015-03-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389312#comment-14389312 ] Colin Patrick McCabe commented on HDFS-6634: Hi [~bperroud], You can get the t

[jira] [Commented] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-03-31 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389184#comment-14389184 ] Colin Patrick McCabe commented on HDFS-8026: TestTracing succeeds locally for m

[jira] [Commented] (HDFS-6805) NPE is thrown at Namenode , for every block report sent from DN

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387893#comment-14387893 ] Colin Patrick McCabe commented on HDFS-6805: I also saw this null pointer excep

[jira] [Resolved] (HDFS-6805) NPE is thrown at Namenode , for every block report sent from DN

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-6805. Resolution: Duplicate > NPE is thrown at Namenode , for every block report sent from

[jira] [Updated] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8026: --- Attachment: HDFS-8026.001.patch > Trace FSOutputSummer#writeChecksumChunks rather than

[jira] [Updated] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8026: --- Status: Patch Available (was: Open) > Trace FSOutputSummer#writeChecksumChunks rather

[jira] [Created] (HDFS-8026) Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk

2015-03-30 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-8026: -- Summary: Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk Key: HDFS-8026 URL: https://issues.apache.org/jira/browse/HDFS-8026

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387466#comment-14387466 ] Colin Patrick McCabe commented on HDFS-7996: The {{BlockReceiver}} should eithe

[jira] [Comment Edited] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387466#comment-14387466 ] Colin Patrick McCabe edited comment on HDFS-7996 at 3/30/15 9:42 PM:

[jira] [Commented] (HDFS-7397) The conf key "dfs.client.read.shortcircuit.streams.cache.size" is misleading

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387366#comment-14387366 ] Colin Patrick McCabe commented on HDFS-7397: +1 for a better description in the

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387346#comment-14387346 ] Colin Patrick McCabe commented on HDFS-7922: Thanks for looking at this, [~rake

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387320#comment-14387320 ] Colin Patrick McCabe commented on HDFS-7979: bq. I don't think there's anything

[jira] [Commented] (HDFS-7996) After swapping a volume, BlockReceiver reports ReplicaNotFoundException

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387316#comment-14387316 ] Colin Patrick McCabe commented on HDFS-7996: Good find. However, I don't like

[jira] [Commented] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387312#comment-14387312 ] Colin Patrick McCabe commented on HDFS-7999: [~xinwei], even if we made the hea

[jira] [Updated] (HDFS-7999) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7999: --- Summary: FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a ver

[jira] [Updated] (HDFS-7212) FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7212: --- Summary: FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a ver

[jira] [Updated] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7261: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-03-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14387078#comment-14387078 ] Colin Patrick McCabe commented on HDFS-7261: +1. Thanks, [~brahmareddy]. > st

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-03-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384858#comment-14384858 ] Colin Patrick McCabe commented on HDFS-7979: The boxed {{Long}} is immutable, s

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382682#comment-14382682 ] Colin Patrick McCabe commented on HDFS-6450: bq. Would be a (small) shame thoug

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382622#comment-14382622 ] Colin Patrick McCabe commented on HDFS-7979: I think it's pretty unlikely that

[jira] [Updated] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7410: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-7410) Support CreateFlags with append() to support hsync() for appending streams

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382578#comment-14382578 ] Colin Patrick McCabe commented on HDFS-7410: +1. TestTracing failure is unrela

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382570#comment-14382570 ] Colin Patrick McCabe commented on HDFS-7878: I agree with [~jingzhao] that havi

[jira] [Resolved] (HDFS-7965) TestTracing#testWriteTraceHooks is flaky

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7965. Resolution: Duplicate > TestTracing#testWriteTraceHooks is flaky > --

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382434#comment-14382434 ] Colin Patrick McCabe commented on HDFS-7054: Thanks again for fixing {{TestTrac

[jira] [Commented] (HDFS-7963) Fix expected tracing spans in TestTracing along with HDFS-7054

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382430#comment-14382430 ] Colin Patrick McCabe commented on HDFS-7963: Sorry, guys, I had to fight some f

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382425#comment-14382425 ] Colin Patrick McCabe commented on HDFS-7758: Thanks, Eddy. Sorry that reviews

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-03-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14382395#comment-14382395 ] Colin Patrick McCabe commented on HDFS-7922: We need to do {{shutdown}} and {{a

[jira] [Comment Edited] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378418#comment-14378418 ] Colin Patrick McCabe edited comment on HDFS-7960 at 3/24/15 7:25 PM:

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378418#comment-14378418 ] Colin Patrick McCabe commented on HDFS-7960: Thanks [~awang], [~eddyxu], and [~

[jira] [Commented] (HDFS-7979) Initialize block report IDs with a random number

2015-03-24 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378415#comment-14378415 ] Colin Patrick McCabe commented on HDFS-7979: I am not sure about this patch for

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376878#comment-14376878 ] Colin Patrick McCabe commented on HDFS-7960: bq. Yi wrote: In the patch, rpcsSe

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372508#comment-14372508 ] Colin Patrick McCabe commented on HDFS-6658: Daryn, I apologize for not being m

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.006.patch rebase on trunk > The full block report should prune z

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372485#comment-14372485 ] Colin Patrick McCabe commented on HDFS-7960: ok, this version adds a good unit

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: (was: HDFS-7960.004.patch) > The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.005.patch > The full block report should prune zombie storages ev

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Patch Available (was: Open) > The full block report should prune zombie storag

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Open (was: Patch Available) > The full block report should prune zombie storag

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.004.patch > The full block report should prune zombie storages ev

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372404#comment-14372404 ] Colin Patrick McCabe commented on HDFS-7960: bq. there's a TODO: FIXME, we aren

[jira] [Commented] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372191#comment-14372191 ] Colin Patrick McCabe commented on HDFS-7960: bq. EMPTY_STORAGE_INFO_LIST is a l

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: HDFS-7960.003.patch > The full block report should prune zombie storages ev

[jira] [Commented] (HDFS-7961) Trigger full block report after hot swapping disk

2015-03-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14372182#comment-14372182 ] Colin Patrick McCabe commented on HDFS-7961: TestTracing failure is unrelated,

[jira] [Created] (HDFS-7965) TestTracing#testWriteTraceHooks is flaky

2015-03-20 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7965: -- Summary: TestTracing#testWriteTraceHooks is flaky Key: HDFS-7965 URL: https://issues.apache.org/jira/browse/HDFS-7965 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Open (was: Patch Available) > The full block report should prune zombie storag

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Attachment: (was: HDFS-7960.001.patch) > The full block report should prune zombie

[jira] [Updated] (HDFS-7960) The full block report should prune zombie storages even if they're not empty

2015-03-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7960: --- Status: Patch Available (was: Open) > The full block report should prune zombie storag

<    5   6   7   8   9   10   11   12   13   14   >