Re: snapshotexport to outside of cluster

HBASE-4618 is not related to snapshots. Lars did some work in HBASE-5509, a sub-task of HBASE-4618. FYI On Fri, Nov 29, 2013 at 9:31 PM, Yu Li wrote: > I guess this might be a use case of > HBASE-7912or > HBASE-4618

Re: snapshotexport to outside of cluster

I guess this might be a use case of HBASE-7912or HBASE-4618 ? Maybe some backup/restore tools taking use of snapshot would be nice to have? On 30 November 2013 12:58, Ted Yu wrote: > The remote s

Re: AsyncHBase 1.5.0-rc1 available for download and testing (HBase 0.96 compatibility inside)

Benoit: In HACKING, a sample command is given: $ HBASE_HOME=~/src/hbase make integration ARGS='test f' This means the integration tests need to be run on one of the servers where HBase is deployed, right ? Cheers On Tue, Nov 5, 2013 at 12:56 AM, tsuna wrote: > Hi all, > RC1 contained a few bu

Re: snapshotexport to outside of cluster

The remote server is in different cluster, right ? Looking at ExportSnapshot#ExportMapper#copyFile(), it directly copies data to outputPath which is in the other cluster. Can you clarify what 'without copying to local file system' means ? Cheers On Fri, Nov 29, 2013 at 8:49 PM, oc tsdb wrote:

Re: snapshotexport to outside of cluster

Hi, thanks for your replay. We are able to export snapshot to another cluster But this is not what we are looking for. We want to export snapshot to remote server without copying to local file system. Thanks OC On Fri, Nov 29, 2013 at 8:52 PM, Ted Yu wrote: > Here is a sample command exporting

Re: HBase and HDFS replication

Can you pastebin master log for this duration of 20 minutes and tell us the name of the region whose recovery took such long time ? Thanks On Fri, Nov 29, 2013 at 1:33 PM, Andrea wrote: > I tried to set in hbase-site.xml the property zookeeper.session.timeout at > 6, so 1 minute, but still

Re: Online/Realtime query with filter and join?

You might want to consider something like Impala or Phoenix, I presume you are trying to do some report query for dashboard or UI? MapReduce is certainly not adequate as there is too much latency on startup. If you want to give this a try, cdh4 and Impala are a good start. Mouradk On 29 Nov 201

Re: HBase and HDFS replication

I tried to set in hbase-site.xml the property zookeeper.session.timeout at 6, so 1 minute, but still the region come to one regionserver alive after about 18-20 minutesthere's no other way to set the recovery time? Maybe add more zookeeper server?

Re: snapshotexport to outside of cluster

Here is a sample command exporting to another cluster: hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot gs_1383068263 -copy-to hdfs://experiment-1d:8020/hbase -mappers 6 On Fri, Nov 29, 2013 at 4:02 AM, oc tsdb wrote: > Hi, > > can someone please let us know if we can export sna

snapshotexport to outside of cluster

Hi, can someone please let us know if we can export snapshots data directly to outside of cluster without copying to local. Please refer us if there are any blog with example. Below command is copying data to local file system under /tmp. hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -sn

Re: Online/Realtime query with filter and join?

whats the size of data are you looking at? 100ms for a join statement for having substancial data ...that would be tricky On 29 Nov 2013 16:03, "Ramon Wang" wrote: > The general performance requirement for each query is less than 100 ms, > that's the average level. Sounds crazy, but yes we need t

Re: Online/Realtime query with filter and join?

The general performance requirement for each query is less than 100 ms, that's the average level. Sounds crazy, but yes we need to find a way for it. Thanks Ramon On Fri, Nov 29, 2013 at 5:01 PM, yonghu wrote: > The question is what you mean of "real-time". What is your performance > request?

HBase bulk load usage

I am trying to import some HDFS data to an already existing HBase table. The table I have was created with 2 column families, and with all the default settings that HBase comes with when creating a new table. The table is already filled up with a large volume of data, and it has 98 online regions.

Re: HBase and HDFS replication

I'll try it!

Re: Online/Realtime query with filter and join?

The question is what you mean of "real-time". What is your performance request? In my opinion, I don't think the MapReduce is suitable for the real time data processing. On Fri, Nov 29, 2013 at 9:55 AM, Azuryy Yu wrote: > you can try phoniex. > On 2013-11-29 3:44 PM, "Ramon Wang" wrote: > > >

Re: Online/Realtime query with filter and join?

you can try phoniex. On 2013-11-29 3:44 PM, "Ramon Wang" wrote: > Hi Folks > > It seems to be impossible, but I still want to check if there is a way we > can do "complex" query on HBase with "Order By", "JOIN".. etc like we have > with normal RDBMS, we are asked to provided such a solution for