org]
Sent: Friday, July 14, 2017 2:55 PM
To: dev@accumulo.apache.org
Subject: Re: [DISCUSS] Periodic table exports
Jeff, that's exactly what the table export feature does today. This thing to
consider here, is whether we should automatically do that periodically.
To be clear, I'm not convin
Jeff, that's exactly what the table export feature does today. This thing
to consider here, is whether we should automatically do that periodically.
To be clear, I'm not convinced myself that it's a good idea to
automatically do it.
On Fri, Jul 14, 2017 at 2:45 PM Jeff Kubina wrote:
> Wouldn't
On Fri, Jul 14, 2017 at 2:27 PM Sean Busbey wrote:
> This could also be useful for botched upgrades
> (should we change stuff in meta again).
>
>
Good point. Hadn't thought of that.
> Don't we already default replication of the blocks for the meta tables
> to something very high? Aren't the exp
Wouldn't it be better to have a utility method that reads all the splits
from the table's rfiles that outputs them to a file? We could then use the
file to recreate the table with the pre-existing splits.
--
Jeff Kubina
410-988-4436
On Fri, Jul 14, 2017 at 2:26 PM, Sean Busbey wrote:
> This c
This could also be useful for botched upgrades
(should we change stuff in meta again).
Don't we already default replication of the blocks for the meta tables
to something very high? Aren't the exported-to-HDFS things just as
subject to block corruption, or more-so if they use default
replication?
The problem is HDFS corrupt blocks which affect the metadata tables. I
don't know that this window is all that narrow. I've seen corrupt blocks
far more often than HDFS outages. Some due to HDFS bugs, some due to
hardware failures and too few replicas, etc. We know how to recover corrupt
blocks in
What's the risk that we are trying to address?
Storing data locally won't help in case of a namenode failure. If you have
a failure that's severe enough to actually kill blocks but not severe
enough that your HDFS is still up, that's a pretty narrow window.
How do you test that your backups are g
