how to clean all data in hbase table without truncate

2013-08-05 Thread liushaohui
hi all: In our shared secure hbase cluster, users often wants to clean all tested data in their tables. Currently, hbase supports the truncate method , but its impl is based on disable table- delete table - create table. There are two drawbacks in this impl. 1, Region split info.

Re: how to clean all data in hbase table without truncate

2013-08-05 Thread Jean-Marc Spaggiari
truncate_preserve (from shell) will still do the disable, but it will not drop the regions split. Can you try and see if it keep he ACLs too? If not, might be a good idea to do something like truncate_preserve_acl too... JM 2013/8/5 liushaohui liushao...@xiaomi.com hi all: In our shared

Re: [UPDATE] Finishing up 0.96 -- WAS Re: 0.95 and 0.96 remaining issues

2013-08-05 Thread Stack
On Sat, Aug 3, 2013 at 3:10 PM, Andrew Purtell apurt...@apache.org wrote: JIRA says that was created August 3, ie today, is that right? Yes. (Elliott can clarify later when he gets in) My understanding is that it is an update to our bundled htrace jar -- pushing a new release -- and adding

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Stack
On Sun, Aug 4, 2013 at 7:56 PM, lars hofhansl la...@apache.org wrote: Let's do a little quiz: HTable t1 = new HTable(conf); t1.close(); // 1. Will the next line create a new HConnection behind the scenes (along with re-creating all the caches)? // (If so, it will be expensive, if not,

Re: [UPDATE] Finishing up 0.96 -- WAS Re: 0.95 and 0.96 remaining issues

2013-08-05 Thread Andrew Purtell
Clarification would be great. I read Elliot's veto of our work as based on both process and maturity concerns. Let's see how they stack up. HFileV3: * Showed up very late in the merge window Same * Still needs revisions Has not even been reviewed yet. Depends on code only existing in a

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Andrew Purtell
+1 Lars I think it makes sense to take your experience with using the client in app servers into API improvements. Love the quiz. +1 nice illustration On Mon, Aug 5, 2013 at 8:25 AM, Stack st...@duboce.net wrote: On Sun, Aug 4, 2013 at 7:56 PM, lars hofhansl la...@apache.org wrote: Let's

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Gary Helmling
+1 Nice work on this Lars! This will make the client connection code a lot simpler and a lot easier to reason about. While it's unfortunate that external client code will necessarily need to be reworked for the changes, I think the result will be much cleaner all around. It will be great to

[jira] [Created] (HBASE-9126) Make HFile MIN VERSION as 2

2013-08-05 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-9126: - Summary: Make HFile MIN VERSION as 2 Key: HBASE-9126 URL: https://issues.apache.org/jira/browse/HBASE-9126 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-9127) HFileContext

2013-08-05 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-9127: - Summary: HFileContext Key: HBASE-9127 URL: https://issues.apache.org/jira/browse/HBASE-9127 Project: HBase Issue Type: Improvement Reporter:

Having different codecs between Client and Server

2013-08-05 Thread ramkrishna vasudevan
Hi Currently in the RPC client we can configure the codec but the same codec would apply to the client and the server. If we could configure a different codec for the server to client communication it could help us in some cases. For example, if we need to remove the tags from sending it to the

0.94.11 this week

2013-08-05 Thread lars hofhansl
Any last wishes (for 0.94.11)? -- Lars

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Suraj Varma
Might this be a good time to _not_ throw IOException and perhaps throw something along the lines of retryable / non-retryable etc exceptions - similar to the hierarchy in asynchbase? Since clients have to change anyways ... perhaps it is a good time to introduce this change? --S On Mon, Aug 5,

Re: 0.94.11 this week

2013-08-05 Thread Nick Dimiduk
It'd be nice to see HBASE-8803 make the cut, but it's not critical. On Mon, Aug 5, 2013 at 1:21 PM, lars hofhansl la...@apache.org wrote: Any last wishes (for 0.94.11)? -- Lars

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Enis Söztutar
+1 on making the connection API explicit. We should start dog-fooding, and actively encouraging the new usage in 0.96 (can come after 0.96.0) Enis On Mon, Aug 5, 2013 at 1:21 PM, Suraj Varma svarma...@gmail.com wrote: Might this be a good time to _not_ throw IOException and perhaps throw

[jira] [Resolved] (HBASE-7980) TestZKInterProcessReadWriteLock fails occasionally in QA test run

2013-08-05 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-7980. -- Resolution: Fixed Fix Version/s: 0.98.0 TestZKInterProcessReadWriteLock fails

[jira] [Created] (HBASE-9128) Drop the '.' prefix from names under hbase.rootdir after namespaces goes in

2013-08-05 Thread stack (JIRA)
stack created HBASE-9128: Summary: Drop the '.' prefix from names under hbase.rootdir after namespaces goes in Key: HBASE-9128 URL: https://issues.apache.org/jira/browse/HBASE-9128 Project: HBase

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Ted Yu
+1 as well. On Mon, Aug 5, 2013 at 2:30 PM, Enis Söztutar enis@gmail.com wrote: +1 on making the connection API explicit. We should start dog-fooding, and actively encouraging the new usage in 0.96 (can come after 0.96.0) Enis On Mon, Aug 5, 2013 at 1:21 PM, Suraj Varma

[jira] [Created] (HBASE-9130) Invert the name of namespace commands to match the snapshots and replication form

2013-08-05 Thread stack (JIRA)
stack created HBASE-9130: Summary: Invert the name of namespace commands to match the snapshots and replication form Key: HBASE-9130 URL: https://issues.apache.org/jira/browse/HBASE-9130 Project: HBase

[jira] [Resolved] (HBASE-8718) shell balancer is broke in 0.95

2013-08-05 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8718. -- Resolution: Cannot Reproduce shell balancer is broke in 0.95 ---

[jira] [Created] (HBASE-9131) Add admin-level documention about configuration and usage of the Bucket Cache

2013-08-05 Thread Jonathan Hsieh (JIRA)
Jonathan Hsieh created HBASE-9131: - Summary: Add admin-level documention about configuration and usage of the Bucket Cache Key: HBASE-9131 URL: https://issues.apache.org/jira/browse/HBASE-9131

[jira] [Created] (HBASE-9132) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9132: -- Summary: Use table dir modtime to avoid scanning table dir to check cached table descriptor Key: HBASE-9132 URL: https://issues.apache.org/jira/browse/HBASE-9132

[jira] [Created] (HBASE-9133) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
Dave Latham created HBASE-9133: -- Summary: Use table dir modtime to avoid scanning table dir to check cached table descriptor Key: HBASE-9133 URL: https://issues.apache.org/jira/browse/HBASE-9133

[jira] [Resolved] (HBASE-9133) Use table dir modtime to avoid scanning table dir to check cached table descriptor

2013-08-05 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Latham resolved HBASE-9133. Resolution: Duplicate Use table dir modtime to avoid scanning table dir to check cached table

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread Andrew Purtell
On Mon, Aug 5, 2013 at 2:30 PM, Enis Söztutar enis@gmail.com wrote: We should start dog-fooding A small start there could be HBASE-7463 -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

[jira] [Created] (HBASE-9134) Run NamespaceUpgrade from hbase migration script

2013-08-05 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-9134: Summary: Run NamespaceUpgrade from hbase migration script Key: HBASE-9134 URL: https://issues.apache.org/jira/browse/HBASE-9134 Project: HBase Issue Type:

Re: Heads up, HTablePool will be deprecated in 0.94, 0.95/0.96, and removed in 0.98

2013-08-05 Thread lars hofhansl
Thanks Andy, as part of the patch I'll convert some of the unitests. There are some conveniences we will no longer have such as a method that can create a table and return and HTable to it (the connection would have to be explicit now) -- Lars - Original Message - From: Andrew

[jira] [Resolved] (HBASE-9124) _acl_ table should be migrated to system namespace

2013-08-05 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HBASE-9124. -- Resolution: Duplicate Duplicate of HBASE-8409 _acl_ table should be migrated

[jira] [Created] (HBASE-9135) Upgrade hadoop 1 version to 1.2.1 which is stable

2013-08-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-9135: - Summary: Upgrade hadoop 1 version to 1.2.1 which is stable Key: HBASE-9135 URL: https://issues.apache.org/jira/browse/HBASE-9135 Project: HBase Issue Type: Task

Re: Having different codecs between Client and Server

2013-08-05 Thread Anoop John
Could the codec itself figure its context and act appropriately? +1 for this. -Anoop- On Tue, Aug 6, 2013 at 3:52 AM, Stack st...@duboce.net wrote: On Mon, Aug 5, 2013 at 1:04 PM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: Hi Currently in the RPC client we can