[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-10-01 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Attachment: HADOOP-12432-HADOOP-11890.1.patch

HADOOP-11890 based patch for includes/excludes with all comments.

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
>Affects Versions: 3.0.0
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Fix For: 3.0.0
>
> Attachments: HADOOP-12432-HADOOP-11890.1.patch, 
> HADOOP-12432-trunk.patch, HADOOP-12432.1.patch, HADOOP-12432.2.patch, 
> HADOOP-12432.3.patch, HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, 
> HDFS-9026-2.patch, HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-30 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Attachment: HADOOP-12432.3.patch

Ok, trying again, this thing "works on my machine" on latest trunk.

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
>Affects Versions: 3.0.0
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Fix For: 3.0.0
>
> Attachments: HADOOP-12432-trunk.patch, HADOOP-12432.1.patch, 
> HADOOP-12432.2.patch, HADOOP-12432.3.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-30 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Attachment: HADOOP-12432.2.patch

Same patch again.
Failures that happened are very weird and I cannot repro them using 
"./dev-support/test-patch.sh --run-tests ~/hdossPatches/HADOOP-12432.1.patch".
What error message was saying is below.
Why it makes no sense - getIPPortString is new method with signature (string, 
int) and it called that way from all 4 places.

Anyway, good old retry and see.


java.lang.NoSuchMethodError: 
org.apache.hadoop.net.NetUtils.getIPPortString(Ljava/lang/String;I)Ljava/lang/String;
at 
org.apache.hadoop.hdfs.protocol.DatanodeID.setIpAndXferPort(DatanodeID.java:113)
at org.apache.hadoop.hdfs.protocol.DatanodeID.(DatanodeID.java:95)
at 
org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor.(DecommissionManager.java:344)
at 
org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager.activate(DecommissionManager.java:164)
at 
org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.activate(DatanodeManager.java:310)
at 
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.activate(BlockManager.java:478)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startCommonServices(FSNamesystem.java:1041)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:697)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:648)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1213)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:976)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:887)
at 
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:819)
at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:478)
at 
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:437)
at 
org.apache.hadoop.hdfs.server.namenode.TestMetadataVersionOutput.testMetadataVersionOutput(TestMetadataVersionOutput.java:64)

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
>Affects Versions: 3.0.0
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Fix For: 3.0.0
>
> Attachments: HADOOP-12432-trunk.patch, HADOOP-12432.1.patch, 
> HADOOP-12432.2.patch, HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, 
> HDFS-9026-2.patch, HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Fix Version/s: 3.0.0
Affects Version/s: 3.0.0
   Status: Patch Available  (was: In Progress)

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
>Affects Versions: 3.0.0
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Fix For: 3.0.0
>
> Attachments: HADOOP-12432-trunk.patch, HADOOP-12432.1.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Attachment: HADOOP-12432.1.patch

Addressed comments, renamed since it became sub task, merged with 
HDFS-8078.15.patch to make it build on trunk

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HADOOP-12432-trunk.patch, HADOOP-12432.1.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Status: Open  (was: Patch Available)

Will upload new patch with addressed comments (removed some imports, added 
tests) and merged to make it run on trunk.

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HADOOP-12432-trunk.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nate Edel (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate Edel updated HADOOP-12432:
---
Status: Patch Available  (was: Open)

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HADOOP-12432-trunk.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nate Edel (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate Edel updated HADOOP-12432:
---
Attachment: HADOOP-12432-trunk.patch

Trying a rename and resubmit to get CI to run on this build on trunk (with 
HDFS-8078 included, as it's dependent.)

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HADOOP-12432-trunk.patch, 
> HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-28 Thread Nate Edel (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nate Edel updated HADOOP-12432:
---
Status: Open  (was: Patch Available)

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, 
> HDFS-9026-2.patch, HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-26 Thread Nemanja Matkovic (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nemanja Matkovic updated HADOOP-12432:
--
Attachment: HDFS-8078.15_plus_HDFS-9026.patch

Merged changes from HDFS-8078.15 and HDFS-9026 to get QABot opinion on trunk.

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HDFS-8078.15_plus_HDFS-9026.patch, HDFS-9026-1.patch, 
> HDFS-9026-2.patch, HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HADOOP-12432) Support for include/exclude lists on IPv6 setup

2015-09-22 Thread Colin Patrick McCabe (JIRA)

 [ 
https://issues.apache.org/jira/browse/HADOOP-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Colin Patrick McCabe updated HADOOP-12432:
--
Issue Type: Sub-task  (was: Improvement)
Parent: HADOOP-11890

> Support for include/exclude lists on IPv6 setup
> ---
>
> Key: HADOOP-12432
> URL: https://issues.apache.org/jira/browse/HADOOP-12432
> Project: Hadoop Common
>  Issue Type: Sub-task
> Environment: This affects only IPv6 cluster setup
>Reporter: Nemanja Matkovic
>Assignee: Nemanja Matkovic
>  Labels: ipv6
> Attachments: HDFS-9026-1.patch, HDFS-9026-2.patch, 
> HDFS-9026-HADOOP-11890.002.patch
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> This is a tracking item for  having e2e IPv6 support in HDFS.
> Nate did great ground work in HDFS-8078 but for having whole feature working 
> e2e this one of the items missing.
> Basically today NN won't be able to parse IPv6 addresses if they are present 
> in include or exclude list.
> Patch has a dependency (and has been tested on IPv6 only cluster) on top of 
> HDFS-8078.14.patch 
> This should be committed to HADOOP-11890 branch. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)