[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508544#comment-14508544 ] Brahma Reddy Battula commented on HDFS-8213: Thanks [~billie.rinaldi] for raisi

[jira] [Commented] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508512#comment-14508512 ] Vinayakumar B commented on HDFS-8217: - Thanks [~zero45] for taking a look at the patch.

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508511#comment-14508511 ] Hadoop QA commented on HDFS-8033: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8033: Attachment: hdfs8033-HDFS-7285.04.patch Thanks Walter for the detailed comments! The new patch addresses the

[jira] [Updated] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8033: Affects Version/s: HDFS-7285 Status: Patch Available (was: In Progress) HADOOP-11746 should b

[jira] [Commented] (HDFS-8221) HDFS have two Standby NNs because ActiveStandbyElectorLock ephemeralOwner in ZK is different with the sessionId stored in ZKFC

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508501#comment-14508501 ] Brahma Reddy Battula commented on HDFS-8221: Yes,, Both are same...duplicating

[jira] [Resolved] (HDFS-8221) HDFS have two Standby NNs because ActiveStandbyElectorLock ephemeralOwner in ZK is different with the sessionId stored in ZKFC

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-8221. Resolution: Duplicate > HDFS have two Standby NNs because ActiveStandbyElectorLock ep

[jira] [Commented] (HDFS-8221) HDFS have two Standby NNs because ActiveStandbyElectorLock ephemeralOwner in ZK is different with the sessionId stored in ZKFC

2015-04-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508488#comment-14508488 ] Vinayakumar B commented on HDFS-8221: - I see HDFS-8161 with the same ActiveStandbyElect

[jira] [Commented] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508484#comment-14508484 ] Haohui Mai commented on HDFS-8227: -- The patch only changes the interface -- it casts the {

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Status: Patch Available (was: Open) > Storing block ids instead of BlockInfo object in INodeFile > ---

[jira] [Updated] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8206: --- Attachment: HDFS-8206-002.patch > Fix the typos in hadoop-hdfs-httpfs > ---

[jira] [Commented] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508483#comment-14508483 ] Brahma Reddy Battula commented on HDFS-8206: [~xyao] Thanks for taking a look i

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Status: Open (was: Patch Available) > Storing block ids instead of BlockInfo object in INodeFile > ---

[jira] [Updated] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8227: - Attachment: HDFS-8227.000.patch > BlockCollection should return Block instead of BlockInfoContiguous in the

[jira] [Updated] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8227: - Status: Patch Available (was: Open) > BlockCollection should return Block instead of BlockInfoContiguous i

[jira] [Updated] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8206: --- Attachment: HDFS-8206-branch2-002.patch > Fix the typos in hadoop-hdfs-httpfs > ---

[jira] [Created] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2015-04-22 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8227: Summary: BlockCollection should return Block instead of BlockInfoContiguous in the interfaces Key: HDFS-8227 URL: https://issues.apache.org/jira/browse/HDFS-8227 Project: Had

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508482#comment-14508482 ] Arpit Agarwal commented on HDFS-8211: - Hi [~anu], thank you for fixing this and adding

[jira] [Updated] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2015-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8204: Summary: Mover/Balancer should not schedule two replicas to the same DN (was: Mover should not schedule two

[jira] [Commented] (HDFS-8204) Mover should not schedule two replicas to the same DN

2015-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508475#comment-14508475 ] Walter Su commented on HDFS-8204: - Update: This issue is about "DN". HDFS-8147 is about "St

[jira] [Commented] (HDFS-8226) Non-HA rollback compatibility broken

2015-04-22 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508472#comment-14508472 ] J.Andreina commented on HDFS-8226: -- Observation: = Namenode Thread Dump {noformat}

[jira] [Created] (HDFS-8226) Non-HA rollback compatibility broken

2015-04-22 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8226: Summary: Non-HA rollback compatibility broken Key: HDFS-8226 URL: https://issues.apache.org/jira/browse/HDFS-8226 Project: Hadoop HDFS Issue Type: Bug Re

[jira] [Updated] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8211: Affects Version/s: (was: 2.7.1) 2.7.0 > DataNode UUID is always null in th

[jira] [Commented] (HDFS-8024) Erasure Coding: ECworker frame, basics, bootstraping and configuration

2015-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508463#comment-14508463 ] Uma Maheswara Rao G commented on HDFS-8024: --- {quote}I just submitted an addendum.

[jira] [Updated] (HDFS-8204) Mover should not schedule two replicas to the same DN

2015-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8204: Summary: Mover should not schedule two replicas to the same DN (was: Balancer: 2 replicas ends in same node

[jira] [Reopened] (HDFS-8204) Balancer: 2 replicas ends in same node after running balance.

2015-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su reopened HDFS-8204: - > Balancer: 2 replicas ends in same node after running balance. > -

[jira] [Commented] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508443#comment-14508443 ] Xiaoyu Yao commented on HDFS-8206: -- Thanks [~brahmareddy] for fixing these typos. The patc

[jira] [Commented] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508413#comment-14508413 ] Hadoop QA commented on HDFS-4448: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508410#comment-14508410 ] Walter Su commented on HDFS-8033: - 1. When I run testcase, {code} int cellRet = readBuffer(

[jira] [Commented] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508386#comment-14508386 ] Brahma Reddy Battula commented on HDFS-8206: Attached patch for branch-2 and tr

[jira] [Updated] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8206: --- Attachment: HDFS-8206-branch2.patch > Fix the typos in hadoop-hdfs-httpfs > ---

[jira] [Commented] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508383#comment-14508383 ] Hadoop QA commented on HDFS-8200: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8206: --- Attachment: HDFS-8206.patch > Fix the typos in hadoop-hdfs-httpfs > ---

[jira] [Commented] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508347#comment-14508347 ] Hadoop QA commented on HDFS-8178: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8206: -- Assignee: Brahma Reddy Battula > Fix the typos in hadoop-hdfs-httpfs > -

[jira] [Updated] (HDFS-8161) Both Namenodes are in standby State

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8161: --- Component/s: auto-failover > Both Namenodes are in standby State >

[jira] [Updated] (HDFS-8161) Both Namenodes are in standby State

2015-04-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8161: --- Affects Version/s: 2.6.0 > Both Namenodes are in standby State > --

[jira] [Updated] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8033: Attachment: HDFS-8033.003.patch The 003 patch addresses Jing's comments. # It keeps the {{blockSeekTo}} name

[jira] [Updated] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2015-04-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Attachment: HDFS-4448.2.patch Rebasing against trunk.. > HA NN does not start with wildcard address conf

[jira] [Updated] (HDFS-4448) HA NN does not start with wildcard address configured for other NN when security is enabled

2015-04-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-4448: -- Fix Version/s: 2.8.0 Status: Patch Available (was: Open) > HA NN does not start with wildcard

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Status: Open (was: Patch Available) > Storing block ids instead of BlockInfo object in INodeFile > ---

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Attachment: (was: HDFS-7437.009.patch) > Storing block ids instead of BlockInfo object in INodeFile > -

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Attachment: (was: HDFS-7437.010.patch) > Storing block ids instead of BlockInfo object in INodeFile > -

[jira] [Updated] (HDFS-7437) Storing block ids instead of BlockInfo object in INodeFile

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7437: - Attachment: HDFS-7437.010.patch > Storing block ids instead of BlockInfo object in INodeFile >

[jira] [Commented] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-22 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508198#comment-14508198 ] Kai Sasaki commented on HDFS-8136: -- [~vinayrpet] Thank you very much for your clear explan

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508196#comment-14508196 ] Zhe Zhang commented on HDFS-8033: - Thanks Jing for the review; it's very helpful. bq. Thus

[jira] [Updated] (HDFS-8136) Client gets and uses EC schema when reads and writes a stripping file

2015-04-22 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8136: - Attachment: HDFS-8136.7.patch > Client gets and uses EC schema when reads and writes a stripping file > ---

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508190#comment-14508190 ] Billie Rinaldi commented on HDFS-8213: -- I agree, having DFSClient use a separate confi

[jira] [Commented] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508177#comment-14508177 ] Jing Zhao commented on HDFS-8033: - Thanks for updating the patch, Zhe! Some comments on the

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8191: -- Affects Version/s: (was: 2.6.0) 2.7.0 > Fix byte to integer casting in Simulat

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8191: -- Target Version/s: 2.8.0 Affects Version/s: 2.6.0 > Fix byte to integer casting in SimulatedFSDataset

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508144#comment-14508144 ] Andrew Wang commented on HDFS-8191: --- Missed that injection change, +1 again. Thanks for w

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8191: Attachment: HDFS-8191.003.patch Thanks Andrew for the comment. Reordering sounds good. {{testInjectionNonEmp

[jira] [Updated] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Attachment: HDFS-8178.000.patch In this patch an in-progress edit file is considered stale if there's another

[jira] [Updated] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Status: Patch Available (was: Open) > QJM doesn't purge empty and corrupt inprogress edits files > -

[jira] [Commented] (HDFS-8070) Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode

2015-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508086#comment-14508086 ] Arpit Agarwal commented on HDFS-8070: - +1 for the patch. > Pre-HDFS-7915 DFSClient can

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508049#comment-14508049 ] Colin Patrick McCabe commented on HDFS-8213: bq. Yes, clients need tracing, and

[jira] [Updated] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-04-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated HDFS-6994: - Assignee: Zhanwei Wang (was: Wangda Tan) > libhdfs3 - A native C/C++ HDFS client > ---

[jira] [Assigned] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-04-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned HDFS-6994: Assignee: Wangda Tan (was: Zhanwei Wang) > libhdfs3 - A native C/C++ HDFS client >

[jira] [Commented] (HDFS-8204) Balancer: 2 replicas ends in same node after running balance.

2015-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508017#comment-14508017 ] Tsz Wo Nicholas Sze commented on HDFS-8204: --- The problem is actually that two rep

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508012#comment-14508012 ] Kai Zheng commented on HDFS-8156: - Yes I have to thanks Nicholas for sorting this out! Than

[jira] [Updated] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2015-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8147: -- Description: *Scenario:* 1. Three DN cluster. For DNs storage type is like this.

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-04-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508006#comment-14508006 ] Kai Zheng commented on HDFS-7337: - For Hitchhiker code, [~rashmikv] and [~jack_liuquan], fo

[jira] [Created] (HDFS-8225) EC client code should not print info log message

2015-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8225: - Summary: EC client code should not print info log message Key: HDFS-8225 URL: https://issues.apache.org/jira/browse/HDFS-8225 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

2015-04-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507994#comment-14507994 ] Kai Zheng commented on HDFS-7337: - For LRC code, for a typical example, 8+3+2: source (X1,

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507991#comment-14507991 ] Andrew Wang commented on HDFS-8191: --- testInjectionNonEmpty I think still is using the 3-a

[jira] [Resolved] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8156. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Kai for the contribution and Nicholas for the thoroug

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

2015-04-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507982#comment-14507982 ] Jason Lowe commented on HDFS-8182: -- Quota seems like it could be problematic for some of t

[jira] [Commented] (HDFS-8217) During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.

2015-04-22 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507983#comment-14507983 ] Plamen Jeliazkov commented on HDFS-8217: Hi [~vinayrpet], Just looked over the wor

[jira] [Updated] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8191: Attachment: HDFS-8191.002.patch Thanks Andrew for the review! A {{addSomeBlocks}} with default positive IDs

[jira] [Commented] (HDFS-8182) Implement topology-aware CDN-style caching

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507939#comment-14507939 ] Andrew Wang commented on HDFS-8182: --- Thanks for the explanation Gera. This sounds like au

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507900#comment-14507900 ] Kai Zheng commented on HDFS-8156: - bq.The code should enforce it. Let do it later. That's a

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507888#comment-14507888 ] Colin Patrick McCabe commented on HDFS-8213: bq. I think Billie Rinaldi is corr

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

2015-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507885#comment-14507885 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- +1 the latest patch looks great. Th

[jira] [Commented] (HDFS-8191) Fix byte to integer casting in SimulatedFSDataset#simulatedByte

2015-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507882#comment-14507882 ] Andrew Wang commented on HDFS-8191: --- Couple notes: * Rather than adding another argument

[jira] [Commented] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-22 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507879#comment-14507879 ] Aaron T. Myers commented on HDFS-8194: -- Those all seem like decent ideas to me, especi

[jira] [Commented] (HDFS-8147) Mover should not select the DN storage as target where already same replica exists.

2015-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507872#comment-14507872 ] Tsz Wo Nicholas Sze commented on HDFS-8147: --- - For StorageGroup, -* hashCode() sh

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507847#comment-14507847 ] Billie Rinaldi commented on HDFS-8213: -- Yes, clients need tracing, and when they do th

[jira] [Updated] (HDFS-8033) Erasure coding: stateful (non-positional) read from files in striped layout

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8033: Attachment: HDFS-8033.002.patch Thanks Yi for the discussion. This new patch makes the following main change

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507819#comment-14507819 ] Colin Patrick McCabe commented on HDFS-8213: bq. The hadoop.htrace.span.receive

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

2015-04-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507818#comment-14507818 ] stack commented on HDFS-8078: - So it is 'ok' if ipAddr is null in this statement? s = ipAddr +

[jira] [Commented] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507808#comment-14507808 ] Hadoop QA commented on HDFS-8052: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2015-04-22 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Description: This happened in our 2.6 cluster. One of the block and its metadata file were corrupte

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507771#comment-14507771 ] Billie Rinaldi commented on HDFS-8213: -- The hadoop.htrace.span.receiver.classes is not

[jira] [Updated] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2015-04-22 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8224: - Description: This happened in our 2.6 cluster. One of the block and its metadata file were corrupte

[jira] [Created] (HDFS-8224) Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error

2015-04-22 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-8224: Summary: Any IOException in DataTransfer#run() will run diskError thread even if it is not disk error Key: HDFS-8224 URL: https://issues.apache.org/jira/browse/HDFS-8224

[jira] [Commented] (HDFS-3135) Build a war file for HttpFS instead of packaging the server (tomcat) along with the application.

2015-04-22 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507663#comment-14507663 ] Ravi Prakash commented on HDFS-3135: I just read http://www.vitavonni.de/blog/201503/2

[jira] [Updated] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8218: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507645#comment-14507645 ] Hudson commented on HDFS-8218: -- FAILURE: Integrated in Hadoop-trunk-Commit #7638 (See [https:

[jira] [Commented] (HDFS-8213) DFSClient should not instantiate SpanReceiverHost

2015-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507643#comment-14507643 ] Colin Patrick McCabe commented on HDFS-8213: Thanks again for kicking the tires

[jira] [Commented] (HDFS-8197) [umbrella] System tests for EC feature

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507628#comment-14507628 ] Zhe Zhang commented on HDFS-8197: - Thanks Kai for clarifying! > [umbrella] System tests fo

[jira] [Commented] (HDFS-8024) Erasure Coding: ECworker frame, basics, bootstraping and configuration

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507609#comment-14507609 ] Zhe Zhang commented on HDFS-8024: - Great work Uma! And thanks Yi for the review. I will st

[jira] [Commented] (HDFS-8024) Erasure Coding: ECworker frame, basics, bootstraping and configuration

2015-04-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507599#comment-14507599 ] Zhe Zhang commented on HDFS-8024: - I just submitted an addendum. Will merge it to the main

[jira] [Commented] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507592#comment-14507592 ] Jing Zhao commented on HDFS-8218: - Looks like the patch only moves the classes, no internal

[jira] [Commented] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507574#comment-14507574 ] Hadoop QA commented on HDFS-8218: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8176) Provide information about the snapshots compared in audit log

2015-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507562#comment-14507562 ] Jing Zhao commented on HDFS-8176: - Thanks for working on this, [~andreina]! The patch looks

[jira] [Commented] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507457#comment-14507457 ] Anu Engineer commented on HDFS-8211: on my machine the test is passing. > DataNode U

[jira] [Updated] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8218: - Status: Patch Available (was: Open) > Move classes that used by ClientProtocol into hdfs-client >

[jira] [Updated] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8218: - Attachment: HDFS-8218.002.patch > Move classes that used by ClientProtocol into hdfs-client > -

[jira] [Updated] (HDFS-8052) Move WebHdfsFileSystem into hadoop-hdfs-client

2015-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8052: - Attachment: HDFS-8052.002.patch > Move WebHdfsFileSystem into hadoop-hdfs-client >

  1   2   >