Re: Regions balancing

2015-04-29 Thread Dejan Menges
Using currently 0.98.0 (or Hortonworks 2.1.10, with bunch of patches that fixed all my questions in last two months here on the list :)) Thanks, going to take a look. On Wed, Apr 29, 2015 at 6:21 AM, Ted Yu wrote: > Which hbase release are you using ? > > Please take a look at StochasticLoadBal

Rebalancing after manual region move

2015-04-29 Thread Dejan Menges
Hi, During investigation of some issues during hotspoting we were moving some regions to different region servers. However, now I see that balancer is not affecting those regions anymore - they 'stick' to those servers. Is there a way to force rebalancing in case like this? Thanks!

Re: Rebalancing after manual region move

2015-04-29 Thread Jean-Marc Spaggiari
Hi Dejan, Most probably because the cluster is balanced enough? You can run the balancer from the shell and look in the logs to see what's the outcome. Simply type "hbase shell" and then "balancer". It will also return the state of the balancer (true for active, false of passive). JM 2015-04-2

Re: Rebalancing after manual region move

2015-04-29 Thread Dejan Menges
Hi Jean-Marc, Ok, that's what I thought too, just wasn't sure as I didn't see any error anywhere, neither something happening when I run balancer, so it's good then :) Thanks a lot! Dejan On Wed, Apr 29, 2015 at 12:52 PM Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Hi Dejan, > > Most

Re: HBase standalone connection refused error

2015-04-29 Thread Stack
Did you alter configuration defaults (Defaults write data to /tmp dir so a restart could cause loss if OS clears tmp). Shutdown all HBase-related services then restart. If still does not log, post link to complete log. Thanks, St.Ack On Tue, Apr 28, 2015 at 9:46 AM, Erdinç Bereketoğlu < erdinc.

Re: Rebalancing after manual region move

2015-04-29 Thread Ted Yu
In the upcoming 1.1.0 release, the following would make balancer state inspection more user-friendly: HBASE-13222 Provide means of non-destructive balancer inspection FYI On Wed, Apr 29, 2015 at 4:11 AM, Dejan Menges wrote: > Hi Jean-Marc, > > Ok, that's what I thought too, just wasn't sure as

Re: Regions balancing

2015-04-29 Thread Michael Segel
You need to upgrade. You hit a known bug. > On Apr 29, 2015, at 2:27 AM, Dejan Menges wrote: > > Using currently 0.98.0 (or Hortonworks 2.1.10, with bunch of patches that > fixed all my questions in last two months here on the list :)) > > Thanks, going to take a look. > > On Wed, Apr 29, 20

Re: Regions balancing

2015-04-29 Thread Dejan Menges
Hi Michael, Can you please point me to exact bug? Thanks a lot! On Apr 29, 2015 8:45 PM, "Michael Segel" wrote: > You need to upgrade. > You hit a known bug. > > > On Apr 29, 2015, at 2:27 AM, Dejan Menges > wrote: > > > > Using currently 0.98.0 (or Hortonworks 2.1.10, with bunch of patches th

Re: Rebalancing after manual region move

2015-04-29 Thread Dejan Menges
Thanks a lot, looking forward to it On Apr 29, 2015 8:36 PM, "Ted Yu" wrote: > In the upcoming 1.1.0 release, the following would make balancer state > inspection more user-friendly: > HBASE-13222 Provide means of non-destructive balancer inspection > > FYI > > On Wed, Apr 29, 2015 at 4:11 AM, De

[ANNOUNCE] Apache HBase 1.0.1 is now available for download

2015-04-29 Thread Enis Söztutar
The HBase Team is pleased to announce the immediate release of HBase 1.0.1. Download it from your favorite Apache mirror [1] or maven repository. HBase 1.0.1 is the next “patch” release in the 1.0.x release line and supersedes 1.0.0. According to the HBase’s semantic version guide (See [2]), the r

HBase snapshot custom directory

2015-04-29 Thread Akmal Abbasov
Hi all, Is it possible to specify the output HDFS directory for HBase snapshot? It could be very helpful to keep snapshots sorted according to a date. Thank you. Regards, Akmal Abbasov

Re: HBase snapshot custom directory

2015-04-29 Thread Matteo Bertozzi
on export you can specify any path $ hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot MySnapshot -copy-to hdfs://MY_SERVER:MY_PORT/MY_LOCATION so you can do: $ hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot MySnapshot -copy-to hdfs://localhost/backup/january-2015 M

Re: HBase snapshot custom directory

2015-04-29 Thread Akmal Abbasov
Hi Matteo, Thank you, for a quick reply. In this case, after exporting a snapshot to the location I want in my local machine, can I delete the same snapshot from the default location, /hbase/.hbase-snapshot ? Thank you. Regards, Akmal Abbasov > On 30 Apr 2015, at 00:17, Matteo Bertozzi wrote:

Re: HBase snapshot custom directory

2015-04-29 Thread Matteo Bertozzi
you should not access/modify the /hbase directory directly. but after export you can use the "delete_snapshot" command or Admin.deleteSnapshot() API to delete it. Matteo On Wed, Apr 29, 2015 at 11:27 PM, Akmal Abbasov wrote: > Hi Matteo, > Thank you, for a quick reply. > In this case, after ex

Re: HBase snapshot custom directory

2015-04-29 Thread Akmal Abbasov
Ok, thank you. Regards, Akmal Abbasov > On 30 Apr 2015, at 00:31, Matteo Bertozzi wrote: > > you should not access/modify the /hbase directory directly. > but after export you can use the "delete_snapshot" command or > Admin.deleteSnapshot() API to delete it. > > Matteo > > > On Wed, Apr 29,

Hbase row ingestion ..

2015-04-29 Thread Gautam
Hello, We'v been fighting some ingestion perf issues on hbase and I have been looking at the write path in particular. Trying to optimize on write path currently. We have around 40 column qualifiers (under single CF) for each row. So I understand that each put(row) written into hbase would

Re: Hbase row ingestion ..

2015-04-29 Thread Gautam
.. I'd like to add that we have a very fat rowkey. - Thanks. On Wed, Apr 29, 2015 at 5:30 PM, Gautam wrote: > Hello, >We'v been fighting some ingestion perf issues on hbase and I have > been looking at the write path in particular. Trying to optimize on write > path currently. > > We ha

Re: Hbase row ingestion ..

2015-04-29 Thread Esteban Gutierrez
Hi Gautam, Your reasoning is correct and that will improve the write performance, specially if you always need to write all the qualifiers in a row (sort of a rigid schema). However you should consider to use qualifiers at some extent if the read pattern might include some conditional search, e.g.

Re: Hbase row ingestion ..

2015-04-29 Thread Gautam
Thanks for the quick response! Our read path is fairly straightforward and very deterministic. We always push down predicates at the rowkey level and read the row's full payload ( never do projection/filtering over CQs ). So.. I could, in theory, expect a gain as much as the current overhead of

Re: [Announcement] DELI: Yet another secondary index on HBase

2015-04-29 Thread Stack
Thank you for posting this interesting study Yuzhe Tang, St.Ack On Mon, Apr 20, 2015 at 5:28 PM, Richard Tang wrote: > Hi, > > We would like to announce DELI, a research prototype for secondary index on > HBase. DELI is research work from Syracuse University with collaboration > from Georgia Tec

[VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-04-29 Thread Nick Dimiduk
I'm happy to announce the first release candidate of HBase 1.1.0 (HBase-1.1.0RC0) is available for download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.1RC2/ Maven artifacts are also available in the staging repository https://repository.apache.org/content/repositories/orgapachehbase

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-04-29 Thread Ashish Singhi
Hi Nick. bq. (HBase-1.1.0RC0) is available for download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.1RC2/ The above url is correct ? from the name it does not seems to be. -- Ashish On Thu, Apr 30, 2015 at 11:05 AM, Nick Dimiduk wrote: > I'm happy to announce the first release can

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-04-29 Thread Nick Dimiduk
Nope, you're right. That link should be https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.0RC0/ On Wed, Apr 29, 2015 at 10:39 PM, Ashish Singhi < ashish.singhi.apa...@gmail.com> wrote: > Hi Nick. > bq. (HBase-1.1.0RC0) is available for download at > https://dist.apache.org/repos/dist/dev/hba

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-04-29 Thread Jeetendra Gangele
How to include this is project code any sample? On 30 April 2015 at 11:32, Nick Dimiduk wrote: > Nope, you're right. That link should be > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.0RC0/ > > On Wed, Apr 29, 2015 at 10:39 PM, Ashish Singhi < > ashish.singhi.apa...@gmail.com> wrote: >

Re: [VOTE] First release candidate for HBase 1.1.0 (RC0) is available.

2015-04-29 Thread Jeetendra Gangele
I means how to include in pom.xml On 30 April 2015 at 11:36, Jeetendra Gangele wrote: > How to include this is project code any sample? > > On 30 April 2015 at 11:32, Nick Dimiduk wrote: > >> Nope, you're right. That link should be >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.1.0RC0/