[
https://issues.apache.org/jira/browse/ACCUMULO-378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202760#comment-13202760
]
Sapan Shah commented on ACCUMULO-378:
-------------------------------------
John: I am currently adapting the WAL to append to a cloned copy in HDFS while
still being performant.
Keith:
I think collaborating would be a great idea. I'll work on getting design
document together. I will be at the meetup, so we can discuss there the
various tasks to work on for this. I see there being quite a bit.
For the questions you asked.
1) To begin with I was thinking about maybe doing just select tables so that
you did not have complete replicas. Then maybe working on a way to possibly do
total replicas.
2) I am still working out a good way to have ZooKeeper send the updates for the
user information. I am not sure about the table metadata yet, as if all we are
doing is calling the client API, I think that might be taken care of, shouldn't
it? As the slave table will maintain its own metadata.
3) What you described with cloning the table, copying the data, and replicating
the logs was my current plan.
4) I have not looked into FATE that much, but will check it out.
5) I am not sure about replicating the splits unless the user defined the
splits before hand.
Let me check into FATE, but from the skimming it seems really useful for this.
> Multi data center replication
> -----------------------------
>
> Key: ACCUMULO-378
> URL: https://issues.apache.org/jira/browse/ACCUMULO-378
> Project: Accumulo
> Issue Type: New Feature
> Reporter: Sapan Shah
> Assignee: Sapan Shah
> Priority: Minor
>
> The use case here is where people have multiple data centers and need to
> replicate the data in between them. Accumulo can model this replication
> after the way that HBase currently handles the replication as detailed here
> (http://hbase.apache.org/replication.html).
> There will be one master Cluster and multiple slave clusters. Accumulo will
> use the Master-Push model to replicate the statements from the master
> clusters WAL to the various slaves WALs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
