[jira] [Commented] (HDFS-4210) NameNode Format should not fail for DNS resolution on minority of JournalNode

2016-08-25 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436339#comment-15436339 ] Charles Lamb commented on HDFS-4210: bq. I am taking over the jira in order to push it over the finish

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.004.patch [~cmccabe], I've rebased the patch. Modify NNThroughputBenchmark to

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: (was: HDFS-7847.004.patch) Modify NNThroughputBenchmark to be able to operate on a

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-05-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.005.patch Modify NNThroughputBenchmark to be able to operate on a remote

[jira] [Commented] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522637#comment-14522637 ] Charles Lamb commented on HDFS-8292: Yes, I tested it manually. Thanks Andrew. Move

[jira] [Updated] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8292: --- Attachment: HDFS-8292.000.patch [~andrew.wang], The attached patch moves the check for 0 from

[jira] [Updated] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8292: --- Status: Patch Available (was: Open) Move conditional in fmt_time from dfs-dust.js to status.html

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Status: Patch Available (was: Reopened) Modify NNThroughputBenchmark to be able to operate on a

[jira] [Reopened] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reopened HDFS-7847: Porting to trunk. .004 submitted. Modify NNThroughputBenchmark to be able to operate on a remote

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519304#comment-14519304 ] Charles Lamb commented on HDFS-8214: The test failure is unrelated. The checkstyle

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Target Version/s: 2.8.0 (was: HDFS-7836) Status: In Progress (was: Patch Available)

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7923: --- Attachment: HDFS-7923.002.patch Thanks for the review and comments [~cmccabe]. {code} public static

[jira] [Created] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-29 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-8292: -- Summary: Move conditional in fmt_time from dfs-dust.js to status.html Key: HDFS-8292 URL: https://issues.apache.org/jira/browse/HDFS-8292 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520613#comment-14520613 ] Charles Lamb commented on HDFS-8214: I created HDFS-8292 for this. Secondary NN Web

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520603#comment-14520603 ] Charles Lamb commented on HDFS-8214: [~wheat9], I'll make the change in a

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-04-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.004.patch .004 is rebased onto trunk. Modify NNThroughputBenchmark to be able

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-27 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8214: --- Attachment: HDFS-8214.003.patch [~andrew.wang], Thanks for the review. The .003 patch makes your

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-27 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514367#comment-14514367 ] Charles Lamb commented on HDFS-8214: The test failure is spurious. I ran the failed

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8214: --- Attachment: HDFS-8214.001.patch [~yzhang], could you please take a look at this? We could either try

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8214: --- Status: Patch Available (was: Open) Secondary NN Web UI shows wrong date for Last Checkpoint

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8214: --- Attachment: HDFS-8214.002.patch [~andrew.wang], Thanks for the review. Please check out the attached.

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-04-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7923: --- Attachment: HDFS-7923.001.patch [~cmccabe], attached is a patch that is rebased onto the trunk. The

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14511161#comment-14511161 ] Charles Lamb commented on HDFS-8214: No test is needed since it's just a change to a

[jira] [Created] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-21 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-8214: -- Summary: Secondary NN Web UI shows wrong date for Last Checkpoint Key: HDFS-8214 URL: https://issues.apache.org/jira/browse/HDFS-8214 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8099) Change DFSInputStream has been closed already message to debug log level

2015-04-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487805#comment-14487805 ] Charles Lamb commented on HDFS-8099: The test failure is unrelated. No new tests were

[jira] [Commented] (HDFS-7240) Object store in HDFS

2015-04-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14487558#comment-14487558 ] Charles Lamb commented on HDFS-7240: [~jnp] et al, This is very interesting. Thanks

[jira] [Created] (HDFS-8099) Remove extraneous warning from DFSInputStream.close()

2015-04-08 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-8099: -- Summary: Remove extraneous warning from DFSInputStream.close() Key: HDFS-8099 URL: https://issues.apache.org/jira/browse/HDFS-8099 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8099) Remove extraneous warning from DFSInputStream.close()

2015-04-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8099: --- Attachment: HDFS-8099.000.patch Remove extraneous warning from DFSInputStream.close()

[jira] [Updated] (HDFS-8099) Remove extraneous warning from DFSInputStream.close()

2015-04-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8099: --- Status: Patch Available (was: Open) Remove extraneous warning from DFSInputStream.close()

[jira] [Updated] (HDFS-8099) Remove extraneous warning from DFSInputStream.close()

2015-04-08 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-8099: --- Attachment: HDFS-8099.001.patch [~cmccabe], good idea. New patch attached. Tested manually: {code}

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-04-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14481715#comment-14481715 ] Charles Lamb commented on HDFS-7923: Here is a description of the heuristic that my

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-04-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7923: --- Attachment: HDFS-7923.000.patch Attached is a patch that implements the behavior I described. The

[jira] [Work started] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

2015-04-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7923 started by Charles Lamb. -- The DataNodes should rate-limit their full block reports by asking the NN on

[jira] [Resolved] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-8040. Resolution: Not a Problem Able to move encryption zone to Trash

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391411#comment-14391411 ] Charles Lamb commented on HDFS-8040: Hi [~ssath...@hortonworks.com], I tried

[jira] [Commented] (HDFS-8040) Able to move encryption zone to Trash

2015-04-01 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391656#comment-14391656 ] Charles Lamb commented on HDFS-8040: [~xyao], [~ssath...@hortonworks.com], This is

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14376532#comment-14376532 ] Charles Lamb commented on HDFS-6658: [~daryn], I spent a couple of hours making a

[jira] [Resolved] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-7847. Resolution: Fixed Fix Version/s: HDFS-7836 Committed to HDFS-7836 branch. Modify

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.003.patch Thanks for the review [~cmccabe]. I moved those two methods over to

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.002.patch @cmccabe, @stack, thanks for the review! bq. DFSClient.java: this

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355210#comment-14355210 ] Charles Lamb commented on HDFS-7846: Colin, this looks pretty good. A few questions and

[jira] [Commented] (HDFS-7846) Create off-heap BlocksMap and BlockData structures

2015-03-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355217#comment-14355217 ] Charles Lamb commented on HDFS-7846: Oh, I forgot to mention there are three places

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-03-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357672#comment-14357672 ] Charles Lamb commented on HDFS-6658: Hi [~daryn], Colin and I read over the design

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-11 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.001.patch @cmccabe, @stack, thanks for the review! bq. DFSClient.java: this

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353386#comment-14353386 ] Charles Lamb commented on HDFS-7836: JOIN WEBEX MEETING

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353455#comment-14353455 ] Charles Lamb commented on HDFS-7836: If you are planning on attending the meeting

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Description: Modify NNThroughputBenchmark to be able to operate on a NN that is not in process. A

[jira] [Created] (HDFS-7910) Modify NNThroughputBenchmark to be able to provide some metrics

2015-03-09 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7910: -- Summary: Modify NNThroughputBenchmark to be able to provide some metrics Key: HDFS-7910 URL: https://issues.apache.org/jira/browse/HDFS-7910 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7847) Write a junit test to simulate a heavy BlockManager load

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353850#comment-14353850 ] Charles Lamb commented on HDFS-7847: Thanks [~aagarwal]. I'll take a look at them.

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.000.patch Add a new -remoteNamenode option to the CLI which takes a URI of a

[jira] [Work started] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-09 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7847 started by Charles Lamb. -- Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351163#comment-14351163 ] Charles Lamb commented on HDFS-7844: I applied your latest patch and set breakpoints at

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351073#comment-14351073 ] Charles Lamb commented on HDFS-7844: [~cmccabe], This is a nice piece of work! Here

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-06 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351282#comment-14351282 ] Charles Lamb commented on HDFS-7844: Thanks Colin, +1, I'll file a follow up jira for

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349438#comment-14349438 ] Charles Lamb commented on HDFS-7836: We'll hold a design review meeting and discussion

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345012#comment-14345012 ] Charles Lamb commented on HDFS-7836: Yes, there would definitely be a webex available.

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-03-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345311#comment-14345311 ] Charles Lamb commented on HDFS-7435: Hi @daryn, The new patch looks pretty good to me.

[jira] [Commented] (HDFS-7845) Compress block reports

2015-03-03 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345372#comment-14345372 ] Charles Lamb commented on HDFS-7845: bq. Charles Lamb did some tests with a block

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338394#comment-14338394 ] Charles Lamb commented on HDFS-7836: Hi [~arpit99], Thanks for reading over the design

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338395#comment-14338395 ] Charles Lamb commented on HDFS-7836: Hi [~arpit99], Thanks for reading over the design

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338768#comment-14338768 ] Charles Lamb commented on HDFS-7435: @daryn, This looks really good. I like the new

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338901#comment-14338901 ] Charles Lamb commented on HDFS-7836: bq. Are you proposing that off-heaping is an

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339390#comment-14339390 ] Charles Lamb commented on HDFS-7435: bq. I mildly disagree will overly verbose message

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339385#comment-14339385 ] Charles Lamb commented on HDFS-7836: bq. it would be useful to see some perf comparison

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335747#comment-14335747 ] Charles Lamb commented on HDFS-7836: Problem Statement The number of blocks stored by

[jira] [Created] (HDFS-7836) BlockManager Scalability Improvements

2015-02-24 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7836: -- Summary: BlockManager Scalability Improvements Key: HDFS-7836 URL: https://issues.apache.org/jira/browse/HDFS-7836 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7836) BlockManager Scalability Improvements

2015-02-24 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7836: --- Attachment: BlockManagerScalabilityImprovementsDesign.pdf BlockManager Scalability Improvements

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-02-11 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.003.patch [~jingzhao], Thanks for the comments. I think the latest patch

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-02-05 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.002.patch Rebased. {{DistributedFileSystem#getFileChecksum}} of a snapshotted

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-04 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305452#comment-14305452 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], I only have a few nits on the

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-04 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305742#comment-14305742 ] Charles Lamb commented on HDFS-7704: Oh, sorry, one more comment. In the test, to be

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-02-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301835#comment-14301835 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], I don't understand why you create

[jira] [Commented] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-02-02 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301885#comment-14301885 ] Charles Lamb commented on HDFS-7682: [~jingzhao], Did you have any more comments on

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296801#comment-14296801 ] Charles Lamb commented on HDFS-7423: bq. Is it correct? Yes, it's ok because

[jira] [Commented] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297657#comment-14297657 ] Charles Lamb commented on HDFS-7702: Hi [~xiyunyue], I read over your proposal and

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

2015-01-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297887#comment-14297887 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], A couple of quick comments:

[jira] [Updated] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7423: --- Attachment: HDFS-7423.004.patch Hi [~hitliuyi], The .004 is rebased for the trunk. Let's wait for the

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295475#comment-14295475 ] Charles Lamb commented on HDFS-7423: Test failures unrelated. various typos and

[jira] [Updated] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-28 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7423: --- Attachment: HDFS-7423-branch-2.004.patch branch-2 diffs attached. various typos and message

[jira] [Commented] (HDFS-7423) various typos and message formatting fixes in nfs daemon and doc

2015-01-27 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293543#comment-14293543 ] Charles Lamb commented on HDFS-7423: Thank you for the review [~ste...@apache.org].

[jira] [Assigned] (HDFS-6571) NameNode should delete intermediate fsimage.ckpt when checkpoint fails

2015-01-27 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb reassigned HDFS-6571: -- Assignee: Charles Lamb NameNode should delete intermediate fsimage.ckpt when checkpoint fails

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-01-27 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.001.patch Hi [~jingzhao], Thanks for looking at this. isLastBlockComplete()

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-01-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Status: Patch Available (was: Open) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-01-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.000.patch Posting patch for a jenkins run.

[jira] [Created] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

2015-01-26 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7682: -- Summary: {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content Key: HDFS-7682 URL: https://issues.apache.org/jira/browse/HDFS-7682

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Attachment: HDFS-7667.001.patch [~aw], Thanks for looking it over. The .001 version makes those two

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Attachment: HDFS-7667.000.patch Diffs attached. Various typos and improvements to HDFS Federation

[jira] [Updated] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7667: --- Status: Patch Available (was: Open) Various typos and improvements to HDFS Federation doc

[jira] [Created] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7667: -- Summary: Various typos and improvements to HDFS Federation doc Key: HDFS-7667 URL: https://issues.apache.org/jira/browse/HDFS-7667 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290002#comment-14290002 ] Charles Lamb commented on HDFS-7667: [~aw], Thanks for the review. I started out

[jira] [Commented] (HDFS-7667) Various typos and improvements to HDFS Federation doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290032#comment-14290032 ] Charles Lamb commented on HDFS-7667: Thanks for the review and the commit [~aw]. If

[jira] [Commented] (HDFS-7644) minor typo in HttpFS doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290048#comment-14290048 ] Charles Lamb commented on HDFS-7644: Gee, here I am fixing all these typos and I can't

[jira] [Commented] (HDFS-7644) minor typo in HffpFS doc

2015-01-23 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289203#comment-14289203 ] Charles Lamb commented on HDFS-7644: The FB warnings are spurious. minor typo in

[jira] [Updated] (HDFS-7644) minor typo in HffpFS doc

2015-01-22 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7644: --- Status: Patch Available (was: Open) minor typo in HffpFS doc

[jira] [Commented] (HDFS-6874) Add GET_BLOCK_LOCATIONS operation to HttpFS

2015-01-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286613#comment-14286613 ] Charles Lamb commented on HDFS-6874: [~lianggz], Thanks for working on this. In

[jira] [Created] (HDFS-7644) minor typo in HffpFS doc

2015-01-20 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-7644: -- Summary: minor typo in HffpFS doc Key: HDFS-7644 URL: https://issues.apache.org/jira/browse/HDFS-7644 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Updated] (HDFS-7644) minor typo in HffpFS doc

2015-01-20 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7644: --- Attachment: HDFS-7644.000.patch minor typo in HffpFS doc

[jira] [Commented] (HDFS-7637) Fix the check condition for reserved path

2015-01-19 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282453#comment-14282453 ] Charles Lamb commented on HDFS-7637: LGTM [~hitliuyi]. Charles Fix the check

[jira] [Updated] (HDFS-7633) When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws IllegalArgumentException

2015-01-16 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7633: --- Summary: When Datanode has too many blocks, BlockPoolSliceScanner.getNewBlockScanTime throws

[jira] [Commented] (HDFS-7067) ClassCastException while using a key created by keytool to create encryption zone.

2015-01-14 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277619#comment-14277619 ] Charles Lamb commented on HDFS-7067: [~cmccabe], bq. Charles, is the

  1   2   3   4   5   6   7   8   >