[ 
https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475086#comment-16475086
 ] 

Íñigo Goiri commented on HDFS-13098:
------------------------------------

bq. I hope you agree that 100+ patches for this feature is quite a lot; much 
smaller features are generally developed in its own branch.

Let's constrain the discussion to this particular feature and not mix it with 
HDFS-12615 (we have an open discussion there).
This feature is already separate from that JIRA and it has no dependencies on 
it, it can be fully implemented on top of HDFS-10467.

I'm fully on-board to start a separate branch just for this feature if there is 
enough interest on it.
My rough estimation is that this feature will be less than 10 subtasks.

> RBF: Datanodes interacting with Routers
> ---------------------------------------
>
>                 Key: HDFS-13098
>                 URL: https://issues.apache.org/jira/browse/HDFS-13098
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Íñigo Goiri
>            Priority: Major
>
> Datanodes talk to particular Namenodes. We could use the Router 
> infrastructure for the Datanodes to register/heartbeating into them and the 
> Routers would forward this to particular Namenodes. This would make the 
> assignment of Datanodes to subclusters potentially more dynamic.
> The implementation would potentially include:
> * Router to implement part of DatanodeProtocol
> * Forwarding DN messages into Routers
> * Policies to assign datanodes to subclusters
> * Datanodes to make blockpool configuration dynamic



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to