[jira] [Updated] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

2011-04-08 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1799: - Attachment: HDFS-1799-all.diff Added HDFS-1799-all.diff which is all 3 patches in one, so that Hudson can

[jira] [Commented] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017341#comment-13017341 ] Hadoop QA commented on HDFS-1799: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

2011-04-08 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1799: - Status: Patch Available (was: Open) Refactor log rolling and filename management out of FSEditLog

[jira] [Commented] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

2011-04-08 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017343#comment-13017343 ] Ivan Kelly commented on HDFS-1799: -- This is trying to build against trunk, which is

[jira] [Updated] (HDFS-1799) Refactor log rolling and filename management out of FSEditLog

2011-04-08 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1799: - Status: Open (was: Patch Available) Refactor log rolling and filename management out of FSEditLog

[jira] [Created] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

2011-04-08 Thread Sudharsan Sampath (JIRA)
FTPFileSystem attempts to close the outputstream even when it is not initialised Key: HDFS-1820 URL: https://issues.apache.org/jira/browse/HDFS-1820 Project: Hadoop HDFS

[jira] [Updated] (HDFS-664) Add a way to efficiently replace a disk in a live datanode

2011-04-08 Thread Tony Valderrama (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Valderrama updated HDFS-664: - Attachment: HDFS-664.patch This is a proof-of-concept patch against 0.20.3-rc2. You can add a

[jira] [Created] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread John George (JIRA)
FileContext.createSymlink with kerberos enabled sets wrong owner Key: HDFS-1821 URL: https://issues.apache.org/jira/browse/HDFS-1821 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: trunkLocalNameImage7.patch Thank Matt for reviewing the patch and performing the test.

[jira] [Updated] (HDFS-1630) Checksum fsedits

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1630: Status: Open (was: Patch Available) Checksum fsedits Key:

[jira] [Updated] (HDFS-1630) Checksum fsedits

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1630: Status: Patch Available (was: Open) Checksum fsedits Key:

[jira] [Updated] (HDFS-1630) Checksum fsedits

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1630: Attachment: editsChecksum1.patch This fixed the failed test. Checksum fsedits

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: trunkLocalNameImage7.patch Speedup NameNode image loading and saving by storing local

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Status: Open (was: Patch Available) Speedup NameNode image loading and saving by storing local

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Status: Patch Available (was: Open) Speedup NameNode image loading and saving by storing local

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: (was: trunkLocalNameImage7.patch) Speedup NameNode image loading and saving by

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: (was: trunkLocalNameImage7.patch) Speedup NameNode image loading and saving by

[jira] [Updated] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-1070: Attachment: trunkLocalNameImage7.patch Speedup NameNode image loading and saving by storing local

[jira] [Commented] (HDFS-1817) Split TestFiDataTransferProtocol.java into two files

2011-04-08 Thread Tanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017555#comment-13017555 ] Tanping Wang commented on HDFS-1817: +1. Patch looks good to me. Split

[jira] [Commented] (HDFS-1818) TestHDFSCLI is failing on trunk

2011-04-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017564#comment-13017564 ] Tsz Wo (Nicholas), SZE commented on HDFS-1818: -- Thanks Aaron and Todd for

[jira] [Updated] (HDFS-1817) Split TestFiDataTransferProtocol.java into two files

2011-04-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1817: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was:

[jira] [Commented] (HDFS-1630) Checksum fsedits

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017578#comment-13017578 ] Hadoop QA commented on HDFS-1630: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1630) Checksum fsedits

2011-04-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017592#comment-13017592 ] dhruba borthakur commented on HDFS-1630: +1, code looks good to me. Checksum

[jira] [Commented] (HDFS-1813) Hdfs Federation: Authentication using BlockToken in RPC to datanode fails.

2011-04-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017597#comment-13017597 ] Suresh Srinivas commented on HDFS-1813: --- +1 for the patch. Hdfs Federation:

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2011-04-08 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017598#comment-13017598 ] Hairong Kuang commented on HDFS-744: @Linyin, I am ok if we simply sync every packet to

[jira] [Updated] (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-04-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1606: - Attachment: h1606_20110408.patch I suspect that the failures of

[jira] [Created] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread Suresh Srinivas (JIRA)
Editlog opcodes overlap between 20 security and later releases -- Key: HDFS-1822 URL: https://issues.apache.org/jira/browse/HDFS-1822 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017624#comment-13017624 ] Hadoop QA commented on HDFS-1606: - -1 overall. Here are the results of testing the latest

[jira] [Resolved] (HDFS-1813) Hdfs Federation: Authentication using BlockToken in RPC to datanode fails.

2011-04-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-1813. Resolution: Fixed Committed the latest patch. Hdfs Federation: Authentication

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017628#comment-13017628 ] Suresh Srinivas commented on HDFS-1822: --- 20.security (LAYOUT_VERSION = -19) adds the

[jira] [Commented] (HDFS-744) Support hsync in HDFS

2011-04-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017633#comment-13017633 ] Tsz Wo (Nicholas), SZE commented on HDFS-744: - ... Could we do it in a separate

[jira] [Updated] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1821: -- Attachment: HDFS-1821.patch FileContext.createSymlink with kerberos enabled sets wrong owner

[jira] [Updated] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1821: -- Status: Patch Available (was: Open) FileContext.createSymlink with kerberos enabled sets wrong owner

[jira] [Commented] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017639#comment-13017639 ] John George commented on HDFS-1821: --- [exec] BUILD SUCCESSFUL [exec] Total time:

[jira] [Updated] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George updated HDFS-1821: -- Description: TEST SETUP Using attached sample hdfs java program that illustrates the issue. Using

[jira] [Commented] (HDFS-1814) HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent

2011-04-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017642#comment-13017642 ] Aaron T. Myers commented on HDFS-1814: -- Just finished running the full test suite. The

[jira] [Moved] (HDFS-1823) start-dfs.sh script fails if HADOOP_HOME is not set

2011-04-08 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White moved HADOOP-7217 to HDFS-1823: - Component/s: (was: scripts) scripts Fix

[jira] [Updated] (HDFS-1052) HDFS scalability with multiple namenodes

2011-04-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1052: -- Attachment: HDFS-1052.patch Consolidated patch for integrating from federation to trunk. HDFS

[jira] [Updated] (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

2011-04-08 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bc Wong updated HDFS-941: - Attachment: HDFS-941-6.patch Thanks for the feedback, Stack. The v6 patch: * Undid the whitespace changes. My IDE

[jira] [Commented] (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-04-08 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017675#comment-13017675 ] Jitendra Nath Pandey commented on HDFS-1606: 1. The method findNewDatanode

[jira] [Commented] (HDFS-1821) FileContext.createSymlink with kerberos enabled sets wrong owner

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017677#comment-13017677 ] Hadoop QA commented on HDFS-1821: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017685#comment-13017685 ] dhruba borthakur commented on HDFS-1822: We need to make sure, any op code added

[jira] [Updated] (HDFS-1823) start-dfs.sh script fails if HADOOP_HOME is not set

2011-04-08 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HDFS-1823: Attachment: HDFS-1823.patch Simple fix. I manually tested this by starting a pseudo-distributed cluster

[jira] [Updated] (HDFS-1823) start-dfs.sh script fails if HADOOP_HOME is not set

2011-04-08 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated HDFS-1823: Status: Patch Available (was: Open) start-dfs.sh script fails if HADOOP_HOME is not set

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017721#comment-13017721 ] Suresh Srinivas commented on HDFS-1822: --- Have we made any apache release off

[jira] [Updated] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1822: -- Attachment: HDFS-1822.patch Changes: # Implemented changes proposed in my previous comment #

[jira] [Commented] (HDFS-1823) start-dfs.sh script fails if HADOOP_HOME is not set

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017744#comment-13017744 ] Hadoop QA commented on HDFS-1823: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1814) HDFS portion of HADOOP-7214 - Hadoop /usr/bin/groups equivalent

2011-04-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017771#comment-13017771 ] Aaron T. Myers commented on HDFS-1814: -- I just re-ran TestDFSShell after the commit of

[jira] [Commented] (HDFS-1630) Checksum fsedits

2011-04-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017780#comment-13017780 ] Aaron T. Myers commented on HDFS-1630: -- Code looks solid to me as well. One nit: In

[jira] [Commented] (HDFS-1070) Speedup NameNode image loading and saving by storing local file names

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017786#comment-13017786 ] Hadoop QA commented on HDFS-1070: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-04-08 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1606: - Attachment: h1606_20110408b.patch Thanks Jitendra for the review.

[jira] [Created] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

2011-04-08 Thread Boris Shkolnik (JIRA)
delay instantiation of file system object until it is needed (linked to HADOOP-7207) Key: HDFS-1824 URL: https://issues.apache.org/jira/browse/HDFS-1824 Project:

[jira] [Updated] (HDFS-1824) delay instantiation of file system object until it is needed (linked to HADOOP-7207)

2011-04-08 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1824: - Attachment: HDFS-1824.patch delay instantiation of file system object until it is needed (linked

[jira] [Commented] (HDFS-1606) Provide a stronger data guarantee in the write pipeline

2011-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017793#comment-13017793 ] Hadoop QA commented on HDFS-1606: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1822) Editlog opcodes overlap between 20 security and later releases

2011-04-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13017798#comment-13017798 ] Allen Wittenauer commented on HDFS-1822: bq. Have we made any apache release off