[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9198: Attachment: HDFS-9198-branch-2.7.patch Here is the branch-2.7 patch, resolved some conflicts and comp

[jira] [Updated] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9697: Attachment: HDFS0-9697-test.patch Attaching one more test, with fix to previous stack trace. With th

[jira] [Updated] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9697: Attachment: HDFS0-9697-test.patch Still I am able to reproduce on latest trunk. 09d831c95ba18e2892cd

[jira] [Comment Edited] (HDFS-9718) NameNode#initializeGenericKeys don't unset the property while it is not assign on special nnId

[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121507#comment-15121507 ] Vinayakumar B edited comment on HDFS-9718 at 1/28/16 2:03 PM: --

[jira] [Commented] (HDFS-9718) NameNode#initializeGenericKeys don't unset the property while it is not assign on special nnId

[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121507#comment-15121507 ] Vinayakumar B commented on HDFS-9718: - Good find [~Deng FEI]. But IMO, best place to un

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121337#comment-15121337 ] Vinayakumar B commented on HDFS-8578: - +1. Latest patch looks excellent [~ctrezzo], do

[jira] [Commented] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121324#comment-15121324 ] Vinayakumar B commented on HDFS-9697: - I followed the same steps and written one test a

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121147#comment-15121147 ] Vinayakumar B commented on HDFS-9198: - [~daryn], Is it worth merging this to 2.7.3? >

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15121070#comment-15121070 ] Vinayakumar B commented on HDFS-8578: - patch looks great. Simple nits. 1. typo,{{doUgr

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119255#comment-15119255 ] Vinayakumar B commented on HDFS-9701: - One issue I am seeing here is in {{FSVolumeList#

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118820#comment-15118820 ] Vinayakumar B commented on HDFS-9503: - bq. If not specified, the default file system UR

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118758#comment-15118758 ] Vinayakumar B commented on HDFS-9668: - bq. I am +1 on the concept of fixing the lockin

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118752#comment-15118752 ] Vinayakumar B commented on HDFS-9677: - I feel current change is fine. {{legacyGeneratio

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9690: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15117469#comment-15117469 ] Vinayakumar B commented on HDFS-9690: - +1 for the patch for branch-2.7 Committed to br

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9690: Summary: ClientProtocol.addBlock is not idempotent after HDFS-8071 (was: addBlock is not idempotent)

[jira] [Commented] (HDFS-9690) addBlock is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115568#comment-15115568 ] Vinayakumar B commented on HDFS-9690: - Tried committing, patch doesnt apply to branch-2

[jira] [Comment Edited] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115072#comment-15115072 ] Vinayakumar B edited comment on HDFS-9689 at 1/25/16 1:22 PM: --

[jira] [Commented] (HDFS-9689) Test o.a.h.hdfs.TestRenameWhileOpen fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115072#comment-15115072 ] Vinayakumar B commented on HDFS-9689: - One possible solution to Namenode restart tests,

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115050#comment-15115050 ] Vinayakumar B commented on HDFS-9503: - Since {{NNThroughputBenchmark}} is an implementa

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114948#comment-15114948 ] Vinayakumar B commented on HDFS-9677: - Change looks good. +1 > Rename generationStamp

[jira] [Commented] (HDFS-9690) addBlock is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15114844#comment-15114844 ] Vinayakumar B commented on HDFS-9690: - +1, Patch looks good. > addBlock is not idempot

[jira] [Comment Edited] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111958#comment-15111958 ] Vinayakumar B edited comment on HDFS-9676 at 1/22/16 5:39 AM: --

[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111958#comment-15111958 ] Vinayakumar B commented on HDFS-9676: - Can you check namenode logs? > “hdfs dfs -put”,

[jira] [Updated] (HDFS-9629) Update the footer of Web UI to show year 2016

[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9629: Attachment: HDFS-9629.04.patch Attached the patch to change footer during build. > Update the foote

[jira] [Commented] (HDFS-9676) “hdfs dfs -put”,the return value is 0, but the size of $hdfsPath is 0.

[ https://issues.apache.org/jira/browse/HDFS-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111009#comment-15111009 ] Vinayakumar B commented on HDFS-9676: - Hi [~drlhome], Can you please give some more det

[jira] [Commented] (HDFS-6973) DFSClient does not closing a closed socket resulting in thousand of CLOSE_WAIT sockets

[ https://issues.apache.org/jira/browse/HDFS-6973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110999#comment-15110999 ] Vinayakumar B commented on HDFS-6973: - HBASE-9393, is due to unclosed streams maintaine

[jira] [Commented] (HDFS-9542) Move BlockIdManager from FSNamesystem to BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110985#comment-15110985 ] Vinayakumar B commented on HDFS-9542: - bq. Just wonder if it's a good idea to rename: g

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9625: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110288#comment-15110288 ] Vinayakumar B commented on HDFS-9534: - 1. {code} /** + * Remove the storage polic

[jira] [Commented] (HDFS-9668) Many long-time BLOCKED threads on FsDatasetImpl in a tiered storage test

[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110202#comment-15110202 ] Vinayakumar B commented on HDFS-9668: - Yes, Idea seems really nice. Do you have same k

[jira] [Commented] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15110039#comment-15110039 ] Vinayakumar B commented on HDFS-6830: - Hi [~xingfengshen], According to case 2, block

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109068#comment-15109068 ] Vinayakumar B commented on HDFS-9608: - bq. Inconsistent synchronization of org.apache.

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9661: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108695#comment-15108695 ] Vinayakumar B commented on HDFS-9661: - +1 for the latest patch. Will commit shortly >

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108683#comment-15108683 ] Vinayakumar B commented on HDFS-9608: - +1 for the latest update. thanks [~zhouwei] [~an

[jira] [Comment Edited] (HDFS-9629) Update the footer of Web UI to show year 2016

[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108355#comment-15108355 ] Vinayakumar B edited comment on HDFS-9629 at 1/20/16 10:46 AM: --

[jira] [Commented] (HDFS-9629) Update the footer of Web UI to show year 2016

[ https://issues.apache.org/jira/browse/HDFS-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108355#comment-15108355 ] Vinayakumar B commented on HDFS-9629: - How about keeping 'year' as a variable in each h

[jira] [Commented] (HDFS-9651) All web UIs should include a robots.txt file

[ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108344#comment-15108344 ] Vinayakumar B commented on HDFS-9651: - bq. Do these files need a license header? If so

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9661: Fix Version/s: (was: 2.7.2) > Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and cre

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9661: Assignee: ade (was: Vinayakumar B) > Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and

[jira] [Commented] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108333#comment-15108333 ] Vinayakumar B commented on HDFS-9659: - {code} - int rpcTimeout = conf.getInt( -

[jira] [Commented] (HDFS-9662) Wrong checking penultimate block replicated in FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108304#comment-15108304 ] Vinayakumar B commented on HDFS-9662: - Avoid calling {{checkFileProgress}} incase penul

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108197#comment-15108197 ] Vinayakumar B commented on HDFS-9608: - Changes looks good. I have some comments, 1. T

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108168#comment-15108168 ] Vinayakumar B commented on HDFS-9654: - Thanks for the refactor [~szetszwo]. Changes lo

[jira] [Commented] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108071#comment-15108071 ] Vinayakumar B commented on HDFS-9661: - [~aderen], Can you update the patch with checkst

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106488#comment-15106488 ] Vinayakumar B commented on HDFS-9625: - For the test, I think simple and direct test cod

[jira] [Commented] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106483#comment-15106483 ] Vinayakumar B commented on HDFS-9661: - +1 for the patch. Pending Jenkins > Deadlock i

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105072#comment-15105072 ] Vinayakumar B commented on HDFS-9425: - patch looks good. Have some comments. 1. Need

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105047#comment-15105047 ] Vinayakumar B commented on HDFS-9038: - Ping. Any update on this guys? > DFS reserved

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097894#comment-15097894 ] Vinayakumar B commented on HDFS-9648: - +1 for patch. TestStartup stil failed, but with

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088802#comment-15088802 ] Vinayakumar B commented on HDFS-9625: - [~Deng FEI], Thanks for the good find and patch

[jira] [Updated] (HDFS-9619) SimulatedFSDataset sometimes can not find blockpool for the correct namenode

[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9619: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9619) SimulatedFSDataset sometimes can not find blockpool for the correct namenode

[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9619: Summary: SimulatedFSDataset sometimes can not find blockpool for the correct namenode (was: DataNode

[jira] [Commented] (HDFS-9619) DataNode sometimes can not find blockpool for the correct namenode

[ https://issues.apache.org/jira/browse/HDFS-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087071#comment-15087071 ] Vinayakumar B commented on HDFS-9619: - +1, committing shortly > DataNode sometimes can

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086927#comment-15086927 ] Vinayakumar B commented on HDFS-9600: - Merged to branch-2.8 as well. > do not check re

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086911#comment-15086911 ] Vinayakumar B commented on HDFS-9600: - Committed to trunk, branch-2, branch-2.7 and bra

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086858#comment-15086858 ] Vinayakumar B commented on HDFS-9600: - bq. The native build fails when libwebhdfs in co

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075109#comment-15075109 ] Vinayakumar B commented on HDFS-9600: - bq. It failed on native code? I think, its the p

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074696#comment-15074696 ] Vinayakumar B commented on HDFS-9600: - Latest patch looks good. +1. I tried committing

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073904#comment-15073904 ] Vinayakumar B commented on HDFS-8578: - For h8578_20151213.patch 1. I think executor se

[jira] [Commented] (HDFS-9600) do not check replication if the block is under construction

[ https://issues.apache.org/jira/browse/HDFS-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073824#comment-15073824 ] Vinayakumar B commented on HDFS-9600: - Thanks for the great find and patch [~yangzhe199

[jira] [Updated] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9393: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061642#comment-15061642 ] Vinayakumar B commented on HDFS-9393: - Thanks [~andreina] for the patch. Changes looks

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059597#comment-15059597 ] Vinayakumar B commented on HDFS-9038: - Hi [~umamaheswararao]/[~hitliuyi]/[~szetszwo]/[~

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15058171#comment-15058171 ] Vinayakumar B commented on HDFS-7661: - bq Vinayakumar B are you still working on it? Pl

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057367#comment-15057367 ] Vinayakumar B commented on HDFS-9038: - [~arpitagarwal], thanks for jumping in for calcu

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054421#comment-15054421 ] Vinayakumar B edited comment on HDFS-8578 at 12/12/15 5:08 PM: --

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054421#comment-15054421 ] Vinayakumar B edited comment on HDFS-8578 at 12/12/15 5:07 PM: --

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054421#comment-15054421 ] Vinayakumar B commented on HDFS-8578: - [~szetszwo], thanks for taking this up and for s

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-17.patch > On upgrade, Datanode should process all storage/data dirs in paralle

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053989#comment-15053989 ] Vinayakumar B commented on HDFS-8578: - bq. One possible synchronization bug in the patc

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15053971#comment-15053971 ] Vinayakumar B commented on HDFS-9038: - bq. dfs.datanode.du.reserved means that the admi

[jira] [Commented] (HDFS-9540) Handle SafeModeException in ReportBadBlockAction#reportTo

[ https://issues.apache.org/jira/browse/HDFS-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052944#comment-15052944 ] Vinayakumar B commented on HDFS-9540: - {code} /** * Client is reporting some bad bl

[jira] [Comment Edited] (HDFS-9540) Handle SafeModeException in ReportBadBlockAction#reportTo

[ https://issues.apache.org/jira/browse/HDFS-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052944#comment-15052944 ] Vinayakumar B edited comment on HDFS-9540 at 12/11/15 4:12 PM: --

[jira] [Commented] (HDFS-9445) Deadlock in datanode

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052173#comment-15052173 ] Vinayakumar B commented on HDFS-9445: - You are right [~cnauroth]. [~kihwal], Latest p

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052152#comment-15052152 ] Vinayakumar B edited comment on HDFS-8578 at 12/11/15 4:36 AM: --

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052152#comment-15052152 ] Vinayakumar B commented on HDFS-8578: - Synchronization on {{DataStorage}} will affect o

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-16.patch Attaching the updated patch, restoring the synchronization on {{addSt

[jira] [Comment Edited] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052109#comment-15052109 ] Vinayakumar B edited comment on HDFS-8578 at 12/11/15 3:47 AM: --

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052109#comment-15052109 ] Vinayakumar B commented on HDFS-8578: - I think its a good idea to run all {{linkBlocks}

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052049#comment-15052049 ] Vinayakumar B commented on HDFS-9038: - Meanwhile, [~brahmareddy], forgot to update the

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052039#comment-15052039 ] Vinayakumar B commented on HDFS-9038: - Thanks [~cnauroth] for the explanation. Lets go

[jira] [Commented] (HDFS-9411) HDFS ZoneLabel support

[ https://issues.apache.org/jira/browse/HDFS-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050090#comment-15050090 ] Vinayakumar B commented on HDFS-9411: - Thanks [~zhz] for taking look here. bq. Are the

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050084#comment-15050084 ] Vinayakumar B commented on HDFS-7916: - {quote}This patch simply ignores the block when

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050067#comment-15050067 ] Vinayakumar B commented on HDFS-8578: - HDFS-9536 has been created to follow-up #2, OOM

[jira] [Created] (HDFS-9536) OOM errors during parallel upgrade to Block-ID based layout

Vinayakumar B created HDFS-9536: --- Summary: OOM errors during parallel upgrade to Block-ID based layout Key: HDFS-9536 URL: https://issues.apache.org/jira/browse/HDFS-9536 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-15.patch HDFS-8578-branch-2.7-003.patch Updated patch as sugges

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050038#comment-15050038 ] Vinayakumar B commented on HDFS-8578: - bq. I suggest that we fix #1 first and then fix

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048659#comment-15048659 ] Vinayakumar B commented on HDFS-8578: - I mean. Its falling back to jenkins mode due to

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048644#comment-15048644 ] Vinayakumar B commented on HDFS-8578: - [~aw], yetus is not actually running in docker.

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-14.patch HDFS-8578-branch-2.7-002.patch Fixed findbugs and chec

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-13.patch HDFS-8578-branch-2.7-001.patch Attaching the patches f

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042081#comment-15042081 ] Vinayakumar B commented on HDFS-8578: - bq. One big spot where I see the memory footprin

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041997#comment-15041997 ] Vinayakumar B commented on HDFS-8578: - bq. Hard-linking is also parallelized within eac

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041970#comment-15041970 ] Vinayakumar B commented on HDFS-9314: - branch-2.6 compilation is broken. Please update

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-12.patch Patch with re-interrupt. Please review. > On upgrade, Datanode should

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041929#comment-15041929 ] Vinayakumar B commented on HDFS-8578: - Thanks [~jrottinghuis] for review. bq. With 12 d

[jira] [Resolved] (HDFS-9127) Re-replication for files with enough replicas in single rack

[ https://issues.apache.org/jira/browse/HDFS-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-9127. - Resolution: Invalid This problem doesnt exist on latest code. Feel free to re-open if found again.

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041403#comment-15041403 ] Vinayakumar B commented on HDFS-8647: - bq. Hi Brahma Reddy Battula, does this mean we h

<    5   6   7   8   9   10   11   12   13   14   >