[jira] [Commented] (HDFS-420) Fuse-dfs should cache fs handles

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040860#comment-13040860 ] Brian Bockelman commented on HDFS-420: -- Hi, I added the ref-counting in there original

[jira] [Updated] (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: fuse_dfs_020_memleaks_v8.patch Ok, I tested this one for awhile prior to posting it. W

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: fuse_dfs_020_memleaks_v3.patch There seems to be threading issues in libhdfs when disco

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: fuse_dfs_020_memleaks.patch Attaching a new version of the memleaks patch; previous one

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Fix Version/s: 0.20.3 Assignee: Brian Bockelman Affects Version/s: 0.20.2

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: (was: HDFS-420.patch) > fuse_dfs is unable to connect to the dfs after a copying a

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: (was: fuse_dfs_020_memleaks.patch) > fuse_dfs is unable to connect to the dfs after

[jira] Commented: (HDFS-1667) Consider redesign of block report processing

[ https://issues.apache.org/jira/browse/HDFS-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13000262#comment-13000262 ] Brian Bockelman commented on HDFS-1667: --- Hi Matt, Just a small comment about (1). I

[jira] Updated: (HDFS-860) fuse-dfs truncate behavior causes issues with scp

[ https://issues.apache.org/jira/browse/HDFS-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-860: - Issue Type: Wish (was: Bug) > fuse-dfs truncate behavior causes issues with scp >

[jira] Updated: (HDFS-433) Move fuse_dfs_wrapper.sh and fuse_dfs into the hadoop/contrib/fuse_dfs deploy directory and use hadoop-env.sh to get env info

[ https://issues.apache.org/jira/browse/HDFS-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-433: - Description: include ../../bin/hadoop-config.sh and then hadoop-env to get JAVA_HOME, HADOOP_HOM

[jira] Updated: (HDFS-434) add fuse-dfs test for non sequential writes to ensure an error is returned

[ https://issues.apache.org/jira/browse/HDFS-434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-434: - Issue Type: Test (was: Bug) Mark as a Test, not a bug. > add fuse-dfs test for non sequential wri

[jira] Commented: (HDFS-426) fuse-dfs forrest doc

[ https://issues.apache.org/jira/browse/HDFS-426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998117#comment-12998117 ] Brian Bockelman commented on HDFS-426: -- Hi - I'd like to work on this. Anyone have a

[jira] Updated: (HDFS-425) Major performance drop on slower machines

[ https://issues.apache.org/jira/browse/HDFS-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-425: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Marking this as an improvem

[jira] Commented: (HDFS-425) Major performance drop on slower machines

[ https://issues.apache.org/jira/browse/HDFS-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12998114#comment-12998114 ] Brian Bockelman commented on HDFS-425: -- This is most likely due to the kernel's buffer

[jira] Updated: (HDFS-428) fuse-dfs implement posix access method

[ https://issues.apache.org/jira/browse/HDFS-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-428: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Marking this as a minor imp

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: fuse_dfs_020_memleaks.patch The attached patch changes all uses of hdfsConnect to hdfsC

[jira] Updated: (HDFS-432) fuse-dfs: call fsshell trash instead of c re-implementation

[ https://issues.apache.org/jira/browse/HDFS-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-432: - Priority: Minor (was: Major) Issue Type: Wish (was: Bug) Not sure how relevant this is. I

[jira] Updated: (HDFS-427) fuse-dfs should support symlinks

[ https://issues.apache.org/jira/browse/HDFS-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-427: - Issue Type: Improvement (was: Bug) Marking this as an Improvement rather than a Bug; keeping it op

[jira] Resolved: (HDFS-429) fuse-dfs implement posix truncate functionality

[ https://issues.apache.org/jira/browse/HDFS-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman resolved HDFS-429. -- Resolution: Fixed Looking at the current trunk, this is already implemented. Couldn't figure out

[jira] Resolved: (HDFS-430) create posix-like (as far as we can) layer for Linux on top of libhdfs

[ https://issues.apache.org/jira/browse/HDFS-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman resolved HDFS-430. -- Resolution: Later This Wish (not really a bug) appears to be abandoned. Closing - can reopen la

[jira] Updated: (HDFS-424) FUSE module chokes on directories with lots (10,000+ or so) files

[ https://issues.apache.org/jira/browse/HDFS-424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-424: - Issue Type: Improvement (was: Bug) Marking this as an improvement, not a bug. Seems to simply be

[jira] Commented: (HDFS-1619) Does libhdfs really need to depend on AC_TYPE_INT16_T, AC_TYPE_INT32_T, AC_TYPE_INT64_T and AC_TYPE_UINT16_T ?

[ https://issues.apache.org/jira/browse/HDFS-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12993524#comment-12993524 ] Brian Bockelman commented on HDFS-1619: --- Hi Allen, I'm sorry, but I come to the oppo

[jira] Commented: (HDFS-860) fuse-dfs truncate behavior causes issues with scp

[ https://issues.apache.org/jira/browse/HDFS-860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899258#action_12899258 ] Brian Bockelman commented on HDFS-860: -- Hi, Jakob - thanks for the reminder. Tom: 1) Y

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856271#action_12856271 ] Brian Bockelman commented on HDFS-1094: --- Hey Karthik, Why don't we take this to the e

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856223#action_12856223 ] Brian Bockelman commented on HDFS-1094: --- A funny related anecdote that I've heard thir

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856139#action_12856139 ] Brian Bockelman commented on HDFS-1094: --- Hey Karthik, Let me play dumb (it might not

[jira] Commented: (HDFS-1094) Intelligent block placement policy to decrease probability of block loss

[ https://issues.apache.org/jira/browse/HDFS-1094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855935#action_12855935 ] Brian Bockelman commented on HDFS-1094: --- Hey Dhruba, How does this change the probabi

[jira] Commented: (HDFS-988) saveNamespace can corrupt edits log

[ https://issues.apache.org/jira/browse/HDFS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12835402#action_12835402 ] Brian Bockelman commented on HDFS-988: -- How long can logSyncs be pending for? Is this c

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828849#action_12828849 ] Brian Bockelman commented on HDFS-941: -- >From a site which uses mostly random reads, I v

[jira] Updated: (HDFS-858) Incorrect return codes for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-858: - Attachment: HDFS-858.patch Fixed compilation issue for previously attached patch. > Incorrect retu

[jira] Updated: (HDFS-858) Incorrect return codes for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-858: - Attachment: (was: HDFS-858.patch) > Incorrect return codes for fuse-dfs > -

[jira] Updated: (HDFS-861) fuse-dfs does not support O_RDWR

[ https://issues.apache.org/jira/browse/HDFS-861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-861: - Attachment: HDFS-861.patch This patch implements the proposed change. O_RDWR will work in a few ca

[jira] Created: (HDFS-861) fuse-dfs does not support O_RDWR

fuse-dfs does not support O_RDWR Key: HDFS-861 URL: https://issues.apache.org/jira/browse/HDFS-861 Project: Hadoop HDFS Issue Type: Bug Components: contrib/fuse-dfs Reporter: Brian Bocke

[jira] Updated: (HDFS-860) fuse-dfs truncate behavior causes issues with scp

[ https://issues.apache.org/jira/browse/HDFS-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-860: - Attachment: HDFS-860.patch Attaching a simple patch to get around this problem - silently suppress

[jira] Created: (HDFS-860) fuse-dfs truncate behavior causes issues with scp

fuse-dfs truncate behavior causes issues with scp - Key: HDFS-860 URL: https://issues.apache.org/jira/browse/HDFS-860 Project: Hadoop HDFS Issue Type: Bug Reporter: Brian Bockelman

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: HDFS-420.patch Hey Dima, First, try applying HDFS-464 to alleviate some memory leaks p

[jira] Updated: (HDFS-859) fuse-dfs utime behavior causes issues with tar

[ https://issues.apache.org/jira/browse/HDFS-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-859: - Attachment: HDFS-859.patch > fuse-dfs utime behavior causes issues with tar > -

[jira] Created: (HDFS-859) fuse-dfs utime behavior causes issues with tar

fuse-dfs utime behavior causes issues with tar -- Key: HDFS-859 URL: https://issues.apache.org/jira/browse/HDFS-859 Project: Hadoop HDFS Issue Type: Bug Components: contrib/fuse-dfs

[jira] Updated: (HDFS-858) Incorrect return codes for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-858: - Component/s: contrib/fuse-dfs > Incorrect return codes for fuse-dfs > -

[jira] Updated: (HDFS-858) Incorrect return codes for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-858: - Attachment: HDFS-858.patch > Incorrect return codes for fuse-dfs >

[jira] Created: (HDFS-858) Incorrect return codes for fuse-dfs

Incorrect return codes for fuse-dfs --- Key: HDFS-858 URL: https://issues.apache.org/jira/browse/HDFS-858 Project: Hadoop HDFS Issue Type: Bug Reporter: Brian Bockelman Priority: Minor

[jira] Created: (HDFS-857) Incorrect type for fuse-dfs capacity can cause "df" to return negative values on 32-bit machines

Incorrect type for fuse-dfs capacity can cause "df" to return negative values on 32-bit machines Key: HDFS-857 URL: https://issues.apache.org/jira/browse/HDFS-857

[jira] Updated: (HDFS-857) Incorrect type for fuse-dfs capacity can cause "df" to return negative values on 32-bit machines

[ https://issues.apache.org/jira/browse/HDFS-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-857: - Attachment: HDFS-857.patch This patch fixes the issue by using tOffset instead of long. > Incorrec

[jira] Updated: (HDFS-856) Hardcoded replication level for new files in fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-856: - Status: Patch Available (was: Open) Submitting patch to Hudson. I do not believe a test case is n

[jira] Updated: (HDFS-856) Hardcoded replication level for new files in fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-856: - Attachment: HADOOP-856.patch This patch changes the # of replicas argument in hdfsOpenFile to 0, wh

[jira] Created: (HDFS-856) Hardcoded replication level for new files in fuse-dfs

Hardcoded replication level for new files in fuse-dfs - Key: HDFS-856 URL: https://issues.apache.org/jira/browse/HDFS-856 Project: Hadoop HDFS Issue Type: Bug Components: contrib/

[jira] Created: (HDFS-838) libhdfs causes a segfault due to race condition

libhdfs causes a segfault due to race condition --- Key: HDFS-838 URL: https://issues.apache.org/jira/browse/HDFS-838 Project: Hadoop HDFS Issue Type: Bug Components: contrib/libhdfs

[jira] Commented: (HDFS-758) Improve reporting of progress of decommissioning

[ https://issues.apache.org/jira/browse/HDFS-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775149#action_12775149 ] Brian Bockelman commented on HDFS-758: -- This would be incredibly useful for our site. W

[jira] Commented: (HDFS-343) Better Target selection for block replication

[ https://issues.apache.org/jira/browse/HDFS-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747717#action_12747717 ] Brian Bockelman commented on HDFS-343: -- Been there, done that - bad idea. The following