Re: HBase Scan consumes high cpu

2019-09-16 Thread ramkrishna vasudevan
Hi Solvannan Currently there is no easy way to over come this case because deletes and its tracking takes precedence before the filter is even applied. I get your case where you really don't know the columns which could have been previously deleted and hence you specify the entire range of column

Re: ExportSnapshot to another cluster fails with: Error: java.io.FileNotFoundException: File does not exist: /hbase/archive/data/default/TABLE/...

2019-09-16 Thread Duo Zhang
Try disabling the hfile cleaner at the destination cluster when exporting the snapshot? Alexander Batyrshin <0x62...@gmail.com>于2019年9月16日 周一08:02写道: > Looks like snapshot files somehow disappear at destination cluster > > Complete stack trace: > > 2019-09-16 03:00:18,291 INFO [main] mapreduce.J

Re: Custom filter appears to just hang

2019-09-16 Thread Stack
On Sun, Sep 15, 2019 at 9:35 AM Mike Thomsen wrote: > So that's just it, I don't see any errors at all on either the client side > or the server side. I'm running this against HBase 2.0.5, and I didn't see > anything showing up. Granted, I'm running server in local mode with just > "bin/hbase mas

Re: Retrieving large rows from Hbase

2019-09-16 Thread Stack
On Sat, Sep 14, 2019 at 9:32 AM Gautham Acharya wrote: > The 3.5 seconds is the time taken to fetch data from Hbase > > Can you tell where the time is being spent (thread-dumping RS during query)? Is it assembling 75k items? IIRC, its single-threaded at this point but still... Otherwise, suggest

Re: [VOTE] The third HBase 2.2.1 release candidate (RC2) is available

2019-09-16 Thread Vadim Bobrov
unsubscribe On Tue, Sep 10, 2019 at 7:06 AM Guanghao Zhang wrote: > Please vote on this release candidate (RC2) for Apache HBase 2.2.1. > > As this RC only changed the tar ball revison, this VOTE will remain open > for 24 hours. > > [ ] +1 Release this package as Apache HBase 2.2.1 > [ ] -1 Do n

Re: HBase Scan consumes high cpu

2019-09-16 Thread Solvannan R M
Hi Ramkrishna, Thank you for your inputs! Unfortunately we would not be knowing the column names beforehand. We had generated the above scenario for illustration purposes. The intent of our query is that, given a single row key, a start column key and an end column key, scan for the columns

Re: ExportSnapshot to another cluster fails with: Error: java.io.FileNotFoundException: File does not exist: /hbase/archive/data/default/TABLE/...

2019-09-16 Thread Alexander Batyrshin
Any ideas how to export snapshot? Looks like -mapper 1 fixes this issue, but I can’t confirm 100% because it tales too long > On 16 Sep 2019, at 11:45, Alexander Batyrshin <0x62...@gmail.com> wrote: > > HBase version 1.4.10 > > Export command: sudo -u hadoop /opt/hbase/bin/hbase > org.apache.

Re: ExportSnapshot to another cluster fails with: Error: java.io.FileNotFoundException: File does not exist: /hbase/archive/data/default/TABLE/...

2019-09-16 Thread Alexander Batyrshin
HBase version 1.4.10 Export command: sudo -u hadoop /opt/hbase/bin/hbase org.apache.hadoop.hbase.snapshot.ExportSnapshot -snapshot snapshot-TABLE -copy-to hdfs://hbase-cluster-2.datahouse/hbase > On 16 Sep 2019, at 11:32, Alexander Batyrshin <0x62...@gmail.com> wrote: > > I can’t find any log

Re: ExportSnapshot to another cluster fails with: Error: java.io.FileNotFoundException: File does not exist: /hbase/archive/data/default/TABLE/...

2019-09-16 Thread Alexander Batyrshin
I can’t find any logs from HBase Master cleaner about deleting this archive files. > On 16 Sep 2019, at 03:02, Alexander Batyrshin <0x62...@gmail.com> wrote: > > Looks like snapshot files somehow disappear at destination cluster > > Complete stack trace: > > 2019-09-16 03:00:18,291 INFO [mai

Re: [VOTE] The third HBase 2.2.1 release candidate (RC2) is available

2019-09-16 Thread Guanghao Zhang
With 4 binding +1s, the vote passes. Let me push out the release and send a notice. Thanks all for verifying the release candidate. Stack 于2019年9月14日周六 上午6:46写道: > +1 > IMO, CHANGES and RELEASENOTES should accumulate all changes, not just show > what is in current release. > Compat report look