[ https://issues.apache.org/jira/browse/HDFS-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wei-Chiu Chuang reassigned HDFS-12204: -------------------------------------- Assignee: HanRyong,Jung > Dfsclient Do not close file descriptor when using shortcircuit > -------------------------------------------------------------- > > Key: HDFS-12204 > URL: https://issues.apache.org/jira/browse/HDFS-12204 > Project: Hadoop HDFS > Issue Type: Bug > Components: hdfs-client > Affects Versions: 2.7.3, 3.1.4 > Environment: HDFS 2.7.3, HBASE 1.2.6, centOS 6.8 > Reporter: HanRyong,Jung > Assignee: HanRyong,Jung > Priority: Major > Attachments: HDFS-12204.branch-2.7.001.patch, > HDFS-12204.branch-2.7.002.patch, HDFS-12204.branch-3.1.001.patch, > HDFS-12204.branch-3.1.002.patch, HDFS-12204.branch-3.1.003.patch, > HDFS-12204.branch-3.1.004.patch > > > I am a user using HDFS 2.7.3, HBASE 1.2.6, centOS 6.8. > The regionserver uses 11 hard disks(jbod) and uses the hbase short circuit. > At this time, when one disk fails in HDFS, I found a phenomenon that I did a > hotswap but did not close file descriptor in hbase. > And the fd path on the umount disk is changed to an incorrect path. > If I check /proc/regionserver_pid/fd, if I used /data1/volumn and umounted > data1, the path changed to /volumn. > And many file descriptors used in shortcircuit are in the delete state. > example ) > ls -al /proc/regionserver_pid/fd > lr-x------ 1 dragonboy dragonboy 64 2017-07-26 20:54 946 -> > /data8/volumn/hdfs/datanode/current/BP-199986352-10.114.243.73-1490077615453/current/finalized/subdir111/subdir21/blk_1215239490 > (deleted) > lr-x------ 1 dragonboy dragonboy 64 2017-07-26 20:54 947 -> > /data8/volumn/hdfs/datanode/current/BP-199986352-10.114.243.73-1490077615453/current/finalized/subdir111/subdir21/blk_1215239490_141511919.meta > (deleted) > lr-x------ 1 dragonboy dragonboy 64 2017-07-26 20:54 948 -> > /data7/volumn/hdfs/datanode/current/BP-199986352-10.114.243.73-1490077615453/current/finalized/subdir111/subdir27/blk_1215241080 > (deleted) > lr-x------ 1 dragonboy dragonboy 64 2017-07-26 20:54 949 -> > /data7/volumn/hdfs/datanode/current/BP-199986352-10.114.243.73-1490077615453/current/finalized/subdir111/subdir27/blk_1215241080_141513509.meta > (deleted) > lr-x------ 1 dragonboy dragonboy 64 2017-07-26 20:54 *192 -> > /volumn/hdfs/datanode/current/BP-199986352-10.114.243.73-1490077615453/current/finalized/subdir244/subdir160/blk_1257545757 > (deleted)* > . > . > . > . > > when data4 fails, execute fuser) > /sbin/fuser -cu /data4 > Cannot stat file /proc/regionserver_pid/fd/*192*: input/output error > Cannot stat file /proc/regionserver_pid/fd/1282: input/output error > Cannot stat file /proc/regionserver_pid/fd/1283: input/output error > . > . > . > . > . > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org