[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2017-01-05 Thread Junping Du (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Junping Du updated HDFS-10319:
--
Fix Version/s: 2.8.0

> Balancer should not try to pair storages with different types
> -
>
> Key: HDFS-10319
> URL: https://issues.apache.org/jira/browse/HDFS-10319
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: balancer & mover
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
>Priority: Minor
> Fix For: 2.8.0, 2.7.3, 3.0.0-alpha1
>
> Attachments: h10319_20160420.patch
>
>
> This is a performance bug – Balancer may pair a source datanode and a target 
> datanode with different storage types. Fortunately, it will fail schedule any 
> blocks in such pair since it will find out that the storage types are not 
> matched later on.
> The bug won't lead to incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-21 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-10319:
---
   Resolution: Fixed
Fix Version/s: 2.7.3
   Status: Resolved  (was: Patch Available)

Thanks Chris for reviewing the patch.

I have committed this.

> Balancer should not try to pair storages with different types
> -
>
> Key: HDFS-10319
> URL: https://issues.apache.org/jira/browse/HDFS-10319
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: balancer & mover
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
>Priority: Minor
> Fix For: 2.7.3
>
> Attachments: h10319_20160420.patch
>
>
> This is a performance bug – Balancer may pair a source datanode and a target 
> datanode with different storage types. Fortunately, it will fail schedule any 
> blocks in such pair since it will find out that the storage types are not 
> matched later on.
> The bug won't lead to incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-21 Thread Chris Nauroth (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Chris Nauroth updated HDFS-10319:
-
Hadoop Flags: Reviewed

+1 for the patch.  The test failures look unrelated.  Thank you, [~szetszwo].

> Balancer should not try to pair storages with different types
> -
>
> Key: HDFS-10319
> URL: https://issues.apache.org/jira/browse/HDFS-10319
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: balancer & mover
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
>Priority: Minor
> Attachments: h10319_20160420.patch
>
>
> This is a performance bug – Balancer may pair a source datanode and a target 
> datanode with different storage types. Fortunately, it will fail schedule any 
> blocks in such pair since it will find out that the storage types are not 
> matched later on.
> The bug won't lead to incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-10319:
---
Status: Patch Available  (was: Open)

> Balancer should not try to pair storages with different types
> -
>
> Key: HDFS-10319
> URL: https://issues.apache.org/jira/browse/HDFS-10319
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: balancer & mover
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
>Priority: Minor
> Attachments: h10319_20160420.patch
>
>
> This is a performance bug – Balancer may pair a source datanode and a target 
> datanode with different storage types. Fortunately, it will fail schedule any 
> blocks in such pair since it will find out that the storage types are not 
> matched later on.
> The bug won't lead to incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2016-04-20 Thread Tsz Wo Nicholas Sze (JIRA)

 [ 
https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo Nicholas Sze updated HDFS-10319:
---
Attachment: h10319_20160420.patch

h10319_20160420.patch: matches storage types.

> Balancer should not try to pair storages with different types
> -
>
> Key: HDFS-10319
> URL: https://issues.apache.org/jira/browse/HDFS-10319
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: balancer & mover
>Reporter: Tsz Wo Nicholas Sze
>Assignee: Tsz Wo Nicholas Sze
>Priority: Minor
> Attachments: h10319_20160420.patch
>
>
> This is a performance bug – Balancer may pair a source datanode and a target 
> datanode with different storage types. Fortunately, it will fail schedule any 
> blocks in such pair since it will find out that the storage types are not 
> matched later on.
> The bug won't lead to incorrect results.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)