Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

Thnx, yes confirmed and thats the way we recovered all of the non calculated data. Thnx for the help. As to the reason why: It seems to be a combination of network congestion because of tcp ingress overflows leading to a lot of connections in the cluster failing of hdfs and hbase. This and too

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

HFile v2 would be saved in v3 format after major compaction in the 1.2 cluster. > On Aug 16, 2016, at 12:55 AM, Rob V wrote: > > The hfile tool shows the hfiles from the 0.94 cluster are indeed v2. Does > that allow a auto convert to v3 on the 1.2 cluster after a

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

The hfile tool shows the hfiles from the 0.94 cluster are indeed v2. Does that allow a auto convert to v3 on the 1.2 cluster after a compaction? The Masters are down on the 0.94 so I can't use the hbase shell. > On 15 Aug 2016, at 20:01, Ted Yu wrote: > > Please verify

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

Please verify that your 0.94 cluster is configured with hfile v2. Config hfile.format.version should have value of 2. To obtain region boundaries, you can use 'describe' hbase shell command. Cheers On Mon, Aug 15, 2016 at 9:48 AM, Rob Verkuylen wrote: > The 2nd cluster is

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

The 2nd cluster is an operational cluster, so option 2 seems to fit nicely. Will the LoadIncrementalHFiles on the Hbase1.2 cluster be able to process the 0.94 version Hfiles? Also is there a convenient way to get the region splits from the old hfiles, or is going though them the only option? On

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

On Sun, Aug 14, 2016 at 12:09 AM, Rob Verkuylen wrote: > We're recovering from a crash of hbase-0.94.6 where the master refuses to > come up, while hdfs is fine. Why this happened exactly is something we're > looking into. > > What does the log say? St.Ack > In the

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

If you distcp the raw hfiles, you have a couple of options to restore the data on the second cluster. 1. You an copy the entire hbase root.dir, you can set the hbase root.dir to this directory and bootstrap the new cluster from there. Before you start the new cluster, run the 'hbase upgrade'

Re: distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

For the Import tool, you can specify the following (quoted from usage): System.err.println("To import data exported from HBase 0.94, use"); System.err.println(" -Dhbase.import.version=0.94"); FYI On Sun, Aug 14, 2016 at 12:09 AM, Rob Verkuylen wrote: > We're

distcp hbase-0.94.6(CDH4.5) hfiles to hbase1.2(CDH5.8)?

We're recovering from a crash of hbase-0.94.6 where the master refuses to come up, while hdfs is fine. Why this happened exactly is something we're looking into. In the meantime we're looking to migrate as fast as possible to another cluster running hbase1.2. Since we cannot use the default