Re: Please welcome our newest committer, Nick Dimiduk
+1, welcome aboard Nick! Congrats. On Sep 14, 2013, at 3:23 AM, Andrew Purtell apurt...@apache.org wrote: Welcome Nick, congratulations! On Tue, Sep 10, 2013 at 3:54 PM, Enis Söztutar e...@apache.org wrote: Hi, Please join me in welcoming Nick as our new addition to the list of committers. Nick is exceptionally good with user-facing issues, and has done major contributions in mapreduce related areas, hive support, as well as 0.96 issues and the new and shiny data types API. Nick, as tradition, feel free to do your first commit to add yourself to pom.xml. Cheers, Enis -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
[jira] [Resolved] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
[ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. BagherEsmaeily resolved HBASE-9537. -- Resolution: Fixed This problem was solved using absolute addressing with port number instead of relative addressing, in LoadIncrementalHFiles input path. completebulkload does 'copy' StoreFiles instead of 'cut' Key: HBASE-9537 URL: https://issues.apache.org/jira/browse/HBASE-9537 Project: HBase Issue Type: Bug Components: mapreduce Affects Versions: 0.94.11 Reporter: M. BagherEsmaeily Attachments: LoadIncrementalHFiles.log, region.log I was using HBase complete bulk load to transfer the output of ImportTsv to a table in HBase, and I noticed that it copies the output instead of cutting. This takes long time for my gigabytes of data. In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read that the files would be moved not copied. Can anyone help me with this? I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and hbase cluster are the same, too. I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles to move the output of my job to HBase table, it still copies instead of cut. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9543) Impl unique aggregation
Liu Shaohui created HBASE-9543: -- Summary: Impl unique aggregation Key: HBASE-9543 URL: https://issues.apache.org/jira/browse/HBASE-9543 Project: HBase Issue Type: New Feature Components: Coprocessors Reporter: Liu Shaohui Assignee: Liu Shaohui Priority: Minor Impl unique aggregation: return a set of all columns' values in a scan. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Anyone have access to hadoopqa boxes? 'device full'
Getting 'device full' when tests run: https://builds.apache.org/job/PreCommit-HBASE-Build/7237//console I added config to our build so we don't dump stats but maybe its not us responsible? St.Ack
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
On Wed, Sep 11, 2013 at 1:26 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 11:22 AM, Nick Dimiduk ndimi...@gmail.com wrote: Likewise, some subset of Jon's HBASE-9245 should be resolved before we cut the next RC. All sounds good by me. I've upped to blocker items raised here but it looks like I could still cut an RC tomorrow or perhaps the day after going by what is outstanding. I know I keep saying I'm going to cut a new RC and then the days go by, but it looks like all the asks are in (I will commit the outstanding this morning unless owners get to it), so RC this afternoon. Thanks for your patience, St.Ack
[jira] [Created] (HBASE-9544) Remove TestAdmin#testIsEnabledOnNonexistentTable()
Ted Yu created HBASE-9544: - Summary: Remove TestAdmin#testIsEnabledOnNonexistentTable() Key: HBASE-9544 URL: https://issues.apache.org/jira/browse/HBASE-9544 Project: HBase Issue Type: Test Reporter: Ted Yu Assignee: Ted Yu Priority: Minor TestAdmin#testIsEnabledOnNonexistentTable() is no longer needed TestAdmin#testIsEnabledOrDisabledOnUnknownTable() covers the above test -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HBASE-9537) completebulkload does 'copy' StoreFiles instead of 'cut'
[ https://issues.apache.org/jira/browse/HBASE-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl reopened HBASE-9537: -- It's not fixed as such. There is a workaround. Let me mark this as dup of HBASE-8304 instead. completebulkload does 'copy' StoreFiles instead of 'cut' Key: HBASE-9537 URL: https://issues.apache.org/jira/browse/HBASE-9537 Project: HBase Issue Type: Bug Components: HFile, mapreduce, regionserver Affects Versions: 0.94.11 Reporter: M. BagherEsmaeily Attachments: LoadIncrementalHFiles.log, region.log I was using HBase complete bulk load to transfer the output of ImportTsv to a table in HBase, and I noticed that it copies the output instead of cutting. This takes long time for my gigabytes of data. In HBase documentation (http://hbase.apache.org/book/ops_mgt.html#completebulkload) I read that the files would be moved not copied. Can anyone help me with this? I use Hbase 0.94.11 and Hadoop 1.2.1. The file system of bulkload output directory and hbase cluster are the same, too. I've also coded a MapReduce job using HFileOutputFormat. When I use LoadIncrementalHFiles to move the output of my job to HBase table, it still copies instead of cut. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Anyone have access to hadoopqa boxes? 'device full'
Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. -Giri On Mon, Sep 16, 2013 at 8:07 AM, Stack st...@duboce.net wrote: Getting 'device full' when tests run: https://builds.apache.org/job/PreCommit-HBASE-Build/7237//console I added config to our build so we don't dump stats but maybe its not us responsible? St.Ack -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Anyone have access to hadoopqa boxes? 'device full'
On Mon, Sep 16, 2013 at 10:26 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. Thank you Giri. You the man. Was it us responsible for the device filling? Were we dropping stuff there? If so, let us know and we'll clean up our act. Thanks. St.Ack
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
There is HBASE-9521 that I would like to see in the RC. The mvn site failed on hadoop qa. I restarted it this morning / night, but hadoop qa is down now. Tested locally, it works. Stack, do you mind if I commit it? Nicolas On Mon, Sep 16, 2013 at 5:38 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 1:26 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 11:22 AM, Nick Dimiduk ndimi...@gmail.com wrote: Likewise, some subset of Jon's HBASE-9245 should be resolved before we cut the next RC. All sounds good by me. I've upped to blocker items raised here but it looks like I could still cut an RC tomorrow or perhaps the day after going by what is outstanding. I know I keep saying I'm going to cut a new RC and then the days go by, but it looks like all the asks are in (I will commit the outstanding this morning unless owners get to it), so RC this afternoon. Thanks for your patience, St.Ack
Re: Anyone have access to hadoopqa boxes? 'device full'
Bookie is zk bookeeper, part of zk test suite? St.Ack On Mon, Sep 16, 2013 at 11:11 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: On this machine, most of the files were left by zookeeper and bookie. ( I don't know what bookie means) -Giri On Mon, Sep 16, 2013 at 11:09 AM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 10:26 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. Thank you Giri. You the man. Was it us responsible for the device filling? Were we dropping stuff there? If so, let us know and we'll clean up our act. Thanks. St.Ack CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Anyone have access to hadoopqa boxes? 'device full'
On this machine, most of the files were left by zookeeper and bookie. ( I don't know what bookie means) -Giri On Mon, Sep 16, 2013 at 11:09 AM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 10:26 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. Thank you Giri. You the man. Was it us responsible for the device filling? Were we dropping stuff there? If so, let us know and we'll clean up our act. Thanks. St.Ack -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Created] (HBASE-9546) HFileContext should adopt Builder pattern
Ted Yu created HBASE-9546: - Summary: HFileContext should adopt Builder pattern Key: HBASE-9546 URL: https://issues.apache.org/jira/browse/HBASE-9546 Project: HBase Issue Type: Sub-task Reporter: Ted Yu HFileContext is used in so many places for HFile v3, HFileContext should use the Builder pattern. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
On Mon, Sep 16, 2013 at 9:26 AM, Nicolas Liochon nkey...@gmail.com wrote: There is HBASE-9521 that I would like to see in the RC. The mvn site failed on hadoop qa. I restarted it this morning / night, but hadoop qa is down now. Tested locally, it works. Stack, do you mind if I commit it? Please commit. Its +1'd and had a good run just previous (the site fail is OOME unrelated usually). St.Ack
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
What about https://issues.apache.org/jira/browse/HBASE-9514. As I said in the jira, I think getting this fix is pretty important. Otherwise, there is a data loss possibility on balancer runs, merges and region assignments from client running concurrently with RS recovery. Enis On Mon, Sep 16, 2013 at 9:26 AM, Nicolas Liochon nkey...@gmail.com wrote: There is HBASE-9521 that I would like to see in the RC. The mvn site failed on hadoop qa. I restarted it this morning / night, but hadoop qa is down now. Tested locally, it works. Stack, do you mind if I commit it? Nicolas On Mon, Sep 16, 2013 at 5:38 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 1:26 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 11:22 AM, Nick Dimiduk ndimi...@gmail.com wrote: Likewise, some subset of Jon's HBASE-9245 should be resolved before we cut the next RC. All sounds good by me. I've upped to blocker items raised here but it looks like I could still cut an RC tomorrow or perhaps the day after going by what is outstanding. I know I keep saying I'm going to cut a new RC and then the days go by, but it looks like all the asks are in (I will commit the outstanding this morning unless owners get to it), so RC this afternoon. Thanks for your patience, St.Ack
[jira] [Created] (HBASE-9545) NPE when trying to get cluster status on an hbase cluster that isn't there
Steve Loughran created HBASE-9545:
-
Summary: NPE when trying to get cluster status on an hbase cluster
that isn't there
Key: HBASE-9545
URL: https://issues.apache.org/jira/browse/HBASE-9545
Project: HBase
Issue Type: Bug
Components: Client
Environment: 0-95.3 snapshot, commit 943bffc
Reporter: Steve Loughran
Priority: Minor
As part of some fault injection testing, I'm trying to talk to an HBaseCluster
that isn't there, opening a connection and expecting things to fail. It turns
out you can create an {{HBaseAdmin}} instance, but when you ask for its cluster
status the NPE surfaces
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9548) Cleanup SnapshotTestingUtils
Matteo Bertozzi created HBASE-9548: -- Summary: Cleanup SnapshotTestingUtils Key: HBASE-9548 URL: https://issues.apache.org/jira/browse/HBASE-9548 Project: HBase Issue Type: Bug Components: snapshots, test Affects Versions: 0.96.0 Reporter: Matteo Bertozzi Assignee: Matteo Bertozzi Priority: Trivial Fix For: 0.96.1 Attachments: HBASE-9548-v0.patch Remove some duplicated code in SnapshotTestingUtils, use existing helpers and fix some stuff -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Anyone have access to hadoopqa boxes? 'device full'
It filled again on hadoop2? Who do we go chase? https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/7252/console St.Ack On Mon, Sep 16, 2013 at 11:14 AM, Stack st...@duboce.net wrote: Bookie is zk bookeeper, part of zk test suite? St.Ack On Mon, Sep 16, 2013 at 11:11 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: On this machine, most of the files were left by zookeeper and bookie. ( I don't know what bookie means) -Giri On Mon, Sep 16, 2013 at 11:09 AM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 10:26 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. Thank you Giri. You the man. Was it us responsible for the device filling? Were we dropping stuff there? If so, let us know and we'll clean up our act. Thanks. St.Ack CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Branching for 0.98
What is the official message/purpose of 98? I was meaning to ask for some time, this thread might be as good a place as any. In a month after 96 release, people might not have even upgraded from 94 to 96 yet, now there's suddenly 98. On Mon, Sep 16, 2013 at 11:25 AM, Andrew Purtell apurt...@apache.orgwrote: Hi all, Unless there are concerns, I would like to set the date for branching 0.98 out from trunk at one month post the release date of 0.96.0. A RC can be expected to follow within days, depending on the state of unit tests, the availability of new 0.96 - 0.98 upgrade compatibility testing developed for the release, and the results of that compatibility testing. -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: Anyone have access to hadoopqa boxes? 'device full'
Configured tmpreaper to purge file and folder in tmp which are 6hrs old on hadoop2 -Giri On Mon, Sep 16, 2013 at 1:18 PM, Stack st...@duboce.net wrote: It filled again on hadoop2? Who do we go chase? https://builds.apache.org/view/H-L/view/HBase/job/PreCommit-HBASE-Build/7252/console St.Ack On Mon, Sep 16, 2013 at 11:14 AM, Stack st...@duboce.net wrote: Bookie is zk bookeeper, part of zk test suite? St.Ack On Mon, Sep 16, 2013 at 11:11 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: On this machine, most of the files were left by zookeeper and bookie. ( I don't know what bookie means) -Giri On Mon, Sep 16, 2013 at 11:09 AM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 10:26 AM, Giridharan Kesavan gkesa...@hortonworks.com wrote: Stack, I cleaned up /tmp on hadoop2, but if you see this happening on other machine, please let me know. Thank you Giri. You the man. Was it us responsible for the device filling? Were we dropping stuff there? If so, let us know and we'll clean up our act. Thanks. St.Ack CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Resolved] (HBASE-9547) Surefire steals focus on mac osx
[ https://issues.apache.org/jira/browse/HBASE-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-9547. -- Resolution: Fixed Fix Version/s: 0.96.0 0.98.0 Assignee: stack Committed small patch to 0.96 and trunk. Surefire steals focus on mac osx Key: HBASE-9547 URL: https://issues.apache.org/jira/browse/HBASE-9547 Project: HBase Issue Type: Bug Reporter: stack Assignee: stack Fix For: 0.98.0, 0.96.0 Attachments: 9547.txt When I run builds on mac osx, the focus is stolen as we go through tests; surefire is launching a little app named variously: forkedbooter is one, mapred.Child another. The little app goes away when the test is done but meantime it robs the focus making desktop unusable. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9549) shell get command does not distinguish between family scan and empty qualifier
Nick Dimiduk created HBASE-9549:
---
Summary: shell get command does not distinguish between family
scan and empty qualifier
Key: HBASE-9549
URL: https://issues.apache.org/jira/browse/HBASE-9549
Project: HBase
Issue Type: Bug
Components: shell
Reporter: Nick Dimiduk
Assignee: Nick Dimiduk
Priority: Minor
The shell is commonly used as a simple way to validate assumptions about the
hbase data model. In this particular case, the shell behaves slightly
differently from the HTable interface.
{noformat}
# shell interactions with KV with an empty qualifier
hbase(main):001:0 create 'foo', 'f1'
0 row(s) in 1.4130 seconds
= Hbase::Table - foo
hbase(main):002:0 put 'foo', 'rk1', 'f1:', 'empty?'
0 row(s) in 0.0750 seconds # = put works
hbase(main):003:0 put 'foo', 'rk1', 'f1:bar', 'value'
0 row(s) in 0.0070 seconds
# attempt to retrieve just the kv with empty qualifier
hbase(main):004:0 get 'foo', 'rk1', 'f1:'
COLUMN CELL
f1:timestamp=1379363480020,
value=empty?
f1:bar timestamp=1379363546360,
value=value
2 row(s) in 0.0360 seconds # = returns more than expected!
hbase(main):005:0 get 'foo', 'rk1', 'f1'
COLUMN CELL
f1:timestamp=1379363480020,
value=empty?
f1:bar timestamp=1379363546360,
value=value
2 row(s) in 0.0120 seconds
hbase(main):006:0 delete 'foo', 'rk1', 'f1:'
0 row(s) in 0.0290 seconds # = delete works
hbase(main):007:0 get 'foo', 'rk1', 'f1:'
COLUMN CELL
f1:bar timestamp=1379363546360,
value=value
1 row(s) in 0.0260 seconds
hbase(main):008:0 get 'foo', 'rk1', 'f1'
COLUMN CELL
f1:bar timestamp=1379363546360,
value=value
1 row(s) in 0.0080 seconds
# restore the empty qual kv for HTable test
hbase(main):011:0 put 'foo', 'rk1', 'f1:', 'empty?'
0 row(s) in 0.0950 seconds
hbase(main):010:0 get 'foo', 'rk1', 'f1:'
COLUMN CELL
f1:timestamp=1379365262555,
value=empty?
f1:bar timestamp=1379365134135,
value=value
2 row(s) in 0.0290 seconds
hbase(main):011:0 get 'foo', 'rk1', 'f1'
COLUMN CELL
f1:timestamp=1379365262555,
value=empty?
f1:bar timestamp=1379365134135,
value=value
2 row(s) in 0.0080 seconds
hbase(main):012:0 hconf = org.apache.hadoop.hbase.HBaseConfiguration.create()
= #Java::OrgApacheHadoopConf::Configuration:0x208e2fb5
hbase(main):013:0 t = org.apache.hadoop.hbase.client.HTable.new(hconf,'foo')
= #Java::OrgApacheHadoopHbaseClient::HTable:0x437d51a6
# create a Get requesting the empty qualifier only, works
hbase(main):014:0 g1 =
org.apache.hadoop.hbase.client.Get.new(org.apache.hadoop.hbase.util.Bytes.toBytes('rk1'))
= #Java::OrgApacheHadoopHbaseClient::Get:0x796523ab
hbase(main):015:0
g1.addColumn(org.apache.hadoop.hbase.util.Bytes.toBytes('f1'), nil)
= #Java::OrgApacheHadoopHbaseClient::Get:0x796523ab
hbase(main):016:0 t.get(g1).toString()
= keyvalues={rk1/f1:/1379365262555/Put/vlen=6/mvcc=0}
# create a Get requesting the whole family, works
hbase(main):017:0 g2 =
org.apache.hadoop.hbase.client.Get.new(org.apache.hadoop.hbase.util.Bytes.toBytes('rk1'))
= #Java::OrgApacheHadoopHbaseClient::Get:0x52e5376a
hbase(main):018:0
g2.addFamily(org.apache.hadoop.hbase.util.Bytes.toBytes('f1'))
= #Java::OrgApacheHadoopHbaseClient::Get:0x52e5376a
hbase(main):019:0 t.get(g2).toString()
= keyvalues={rk1/f1:/1379365262555/Put/vlen=6/mvcc=0,
rk1/f1:bar/1379365134135/Put/vlen=5/mvcc=0}
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
It seems like move in general has issues - HBASE-9525 and HBASE-9480 are other symptoms of the problem. Maybe, there are more... Maybe we should spend a little time to review code and fix such issues? On Mon, Sep 16, 2013 at 11:40 AM, Enis Söztutar enis@gmail.com wrote: What about https://issues.apache.org/jira/browse/HBASE-9514. As I said in the jira, I think getting this fix is pretty important. Otherwise, there is a data loss possibility on balancer runs, merges and region assignments from client running concurrently with RS recovery. Enis On Mon, Sep 16, 2013 at 9:26 AM, Nicolas Liochon nkey...@gmail.com wrote: There is HBASE-9521 that I would like to see in the RC. The mvn site failed on hadoop qa. I restarted it this morning / night, but hadoop qa is down now. Tested locally, it works. Stack, do you mind if I commit it? Nicolas On Mon, Sep 16, 2013 at 5:38 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 1:26 PM, Stack st...@duboce.net wrote: On Wed, Sep 11, 2013 at 11:22 AM, Nick Dimiduk ndimi...@gmail.com wrote: Likewise, some subset of Jon's HBASE-9245 should be resolved before we cut the next RC. All sounds good by me. I've upped to blocker items raised here but it looks like I could still cut an RC tomorrow or perhaps the day after going by what is outstanding. I know I keep saying I'm going to cut a new RC and then the days go by, but it looks like all the asks are in (I will commit the outstanding this morning unless owners get to it), so RC this afternoon. Thanks for your patience, St.Ack -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: src/test/ruby anyone?
Thanks. On Fri, Sep 13, 2013 at 1:45 PM, Jean-Daniel Cryans jdcry...@apache.orgwrote: See TestShell. J-D On Fri, Sep 13, 2013 at 1:26 PM, Nick Dimiduk ndimi...@gmail.com wrote: I see we have ruby tests. How do I run those? I don't seem them included the regular mvn runs. Taking a wild guess, it looks like they've suffered some bit-rot: $ ./bin/hbase shell hbase-server/src/test/ruby/tests_runner.rb Class.java:-2:in `getDeclaredMethods0': java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/MiniDFSCluster from Class.java:2427:in `privateGetDeclaredMethods' from Class.java:1791:in `getDeclaredMethods' from JavaClass.java:2110:in `getMethods' from JavaClass.java:955:in `setupClassMethods' from JavaClass.java:99:in `access$700' from JavaClass.java:650:in `initialize' from JavaClass.java:689:in `setupProxy' from Java.java:526:in `createProxyClass' ... Thanks, Nick
[jira] [Created] (HBASE-9550) IntegrationTestBigLinkedList used to be able to run on pseudo-distributed clusters
Enis Soztutar created HBASE-9550: Summary: IntegrationTestBigLinkedList used to be able to run on pseudo-distributed clusters Key: HBASE-9550 URL: https://issues.apache.org/jira/browse/HBASE-9550 Project: HBase Issue Type: Bug Components: test Reporter: Enis Soztutar Assignee: Enis Soztutar Fix For: 0.98.0, 0.96.0 Attachments: hbase-9550_v1.patch IntegrationTestBigLinkedList was able to run on clusters with 1 node (in single node deployments). We should bring that. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9551) HBaseTestingUtility#createPreSplitLoadTestTable double close HBaseAdmin
Jeffrey Zhong created HBASE-9551: Summary: HBaseTestingUtility#createPreSplitLoadTestTable double close HBaseAdmin Key: HBASE-9551 URL: https://issues.apache.org/jira/browse/HBASE-9551 Project: HBase Issue Type: Bug Affects Versions: 0.96.0 Reporter: Jeffrey Zhong Assignee: Jeffrey Zhong Priority: Minor The code close admin twice which cause a LoadTest tool fail when loading multiple tables at one time. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9552) NPE while updating RegionServers with the favored nodes assignments from the client tool
Devaraj Das created HBASE-9552: -- Summary: NPE while updating RegionServers with the favored nodes assignments from the client tool Key: HBASE-9552 URL: https://issues.apache.org/jira/browse/HBASE-9552 Project: HBase Issue Type: Bug Reporter: Devaraj Das A null check was missed. This leads to NPEs in the client tool when the tool generates the favored nodes assignment and tries to update the RegionServers with the information. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
On Mon, Sep 16, 2013 at 1:34 PM, Devaraj Das d...@hortonworks.com wrote: It seems like move in general has issues - HBASE-9525 and HBASE-9480 are other symptoms of the problem. Maybe, there are more... Maybe we should spend a little time to review code and fix such issues? HBASE-9525 has been resolved already as has HBASE-9480. Jimmy is on HBASE-9514. He has a patch up for review. You thinking we NOT cut an RC before spending a little time to reivew code and fix such issues? Thanks, St.Ack
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
On Mon, Sep 16, 2013 at 5:10 PM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 1:34 PM, Devaraj Das d...@hortonworks.com wrote: It seems like move in general has issues - HBASE-9525 and HBASE-9480 are other symptoms of the problem. Maybe, there are more... Maybe we should spend a little time to review code and fix such issues? HBASE-9525 has been resolved already as has HBASE-9480. Jimmy is on HBASE-9514. He has a patch up for review. You thinking we NOT cut an RC before spending a little time to reivew code and fix such issues? Now that Jimmy has fixed the issues (thanks, Jimmy!), I am personally okay to let an RC happen now. Thanks, St.Ack -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[jira] [Created] (HBASE-9553) Pad HFile blocks to a fixed size before placing them into the blockcache
Lars Hofhansl created HBASE-9553: Summary: Pad HFile blocks to a fixed size before placing them into the blockcache Key: HBASE-9553 URL: https://issues.apache.org/jira/browse/HBASE-9553 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl In order to make it easy on the garbage collector and to avoid full compaction phases we should make sure that all (or at least a large percentage) of the HFile blocks as cached in the block cache are exactly the same size. Currently an HFile block is typically slightly larger than the declared block size, as the block will accommodate that last KV on the block. The padding would be a ColumnFamily option. In many cases 100 bytes would probably be a good value to make all blocks exactly the same size (but of course it depends on the max size of the KVs). This does not have to be perfect. The more blocks evicted and replaced in the block cache are of the exact same size the easier it should be on the GC. Thoughts? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: [VOTE] The 1st hbase-0.96.0 release candidate is available for download
On Mon, Sep 16, 2013 at 5:13 PM, Devaraj Das d...@hortonworks.com wrote: On Mon, Sep 16, 2013 at 5:10 PM, Stack st...@duboce.net wrote: On Mon, Sep 16, 2013 at 1:34 PM, Devaraj Das d...@hortonworks.com wrote: It seems like move in general has issues - HBASE-9525 and HBASE-9480 are other symptoms of the problem. Maybe, there are more... Maybe we should spend a little time to review code and fix such issues? HBASE-9525 has been resolved already as has HBASE-9480. Jimmy is on HBASE-9514. He has a patch up for review. You thinking we NOT cut an RC before spending a little time to reivew code and fix such issues? Now that Jimmy has fixed the issues (thanks, Jimmy!), I am personally okay to let an RC happen now. OK. There are still some issues to go in. Trying to verify they don't break stuff w/ local machine and navigating hadoopqa. HBASE-9538 Handle post namespace snapshot files when checking for HFile V1 -- I'll do this one. HBASE-9510 Namespace operations should throw clean exceptions -- Enis to commit Sergey has a commit for 0.96 that he is on. HBASE-9514 might make it too. St.Ack
[jira] [Created] (HBASE-9554) TestOfflineMetaRebuildOverlap#testMetaRebuildOverlapFail fails due to NPE
Ted Yu created HBASE-9554:
-
Summary: TestOfflineMetaRebuildOverlap#testMetaRebuildOverlapFail
fails due to NPE
Key: HBASE-9554
URL: https://issues.apache.org/jira/browse/HBASE-9554
Project: HBase
Issue Type: Bug
Reporter: Ted Yu
Assignee: Ted Yu
Fix For: 0.98.0, 0.96.0
From
http://54.241.6.143/job/HBase-TRUNK/org.apache.hbase$hbase-server/496/testReport/org.apache.hadoop.hbase.util.hbck/TestOfflineMetaRebuildOverlap/testMetaRebuildOverlapFail/
:
{code}
java.lang.Exception: test timed out after 12 milliseconds
at java.lang.Thread.sleep(Native Method)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:148)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:94)
at
org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3153)
at
org.apache.hadoop.hbase.client.HBaseAdmin.unassign(HBaseAdmin.java:1714)
at
org.apache.hadoop.hbase.util.hbck.OfflineMetaRebuildTestCore.wipeOutMeta(OfflineMetaRebuildTestCore.java:242)
at
org.apache.hadoop.hbase.util.hbck.TestOfflineMetaRebuildOverlap.testMetaRebuildOverlapFail(TestOfflineMetaRebuildOverlap.java:54)
...
2013-09-17 00:59:52,928 ERROR [FifoRpcScheduler.handler1-thread-2]
ipc.RpcServer(2016): Unexpected throwable object
java.lang.NullPointerException
at
org.apache.hadoop.hbase.master.AssignmentManager.unassign(AssignmentManager.java:2301)
at
org.apache.hadoop.hbase.master.AssignmentManager.unassign(AssignmentManager.java:2381)
at
org.apache.hadoop.hbase.master.HMaster.unassignRegion(HMaster.java:2499)
at
org.apache.hadoop.hbase.protobuf.generated.MasterAdminProtos$MasterAdminService$2.callBlockingMethod(MasterAdminProtos.java:32854)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:1979)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:90)
at
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:73)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9555) Reset loadbalancer back to StochasticLoadBalancer
Elliott Clark created HBASE-9555: Summary: Reset loadbalancer back to StochasticLoadBalancer Key: HBASE-9555 URL: https://issues.apache.org/jira/browse/HBASE-9555 Project: HBase Issue Type: Bug Components: Balancer Affects Versions: 0.96.0 Reporter: Elliott Clark Priority: Critical Fix For: 0.96.0 It seems like HBASE-729 changed the loadbalancer class by mistake, removing a good deal of functionality. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HBASE-9556) Provide key range support to bulkload to avoid too many reducers even the data belongs to few regions
rajeshbabu created HBASE-9556: - Summary: Provide key range support to bulkload to avoid too many reducers even the data belongs to few regions Key: HBASE-9556 URL: https://issues.apache.org/jira/browse/HBASE-9556 Project: HBase Issue Type: Improvement Components: mapreduce Reporter: rajeshbabu Assignee: rajeshbabu Priority: Minor Presently the number of reducers in bulk load are equal to number of regions. Lets suppose a table has 500 regions and import data only belongs 10 regions, still we are starting 500(equal to no. of regions) reducers instead of 10. Which will consume more time and resources. If user knows the row key range of import data, then we can pass startkey and/or endkey as input and based on the key range we can define the partitions and number of reducers(regions to which the data belongs). This helps to avoid too many reducers to start and do nothing and also avoids contention in shuffling. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-9338) Test Big Linked List fails on Hadoop 2.1.0
[ https://issues.apache.org/jira/browse/HBASE-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-9338. -- Resolution: Fixed Reresolving. The committed patch makes this test pass again by avoiding the issue. Some fixes have gone into fix the issue and Jimmy is on it over in hbase-9514. So reresolving this one. hbase-9514 reenables the test to its old state. Can make that a blocker if we find stuff still broke. Test Big Linked List fails on Hadoop 2.1.0 -- Key: HBASE-9338 URL: https://issues.apache.org/jira/browse/HBASE-9338 Project: HBase Issue Type: Bug Components: test Affects Versions: 0.96.0 Reporter: Elliott Clark Assignee: Elliott Clark Priority: Blocker Fix For: 0.98.0, 0.96.0 Attachments: HBASE-9338-0.patch, HBASE-9338-1.patch, HBASE-9338-TESTING-2.patch, HBASE-9338-TESTING-3.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-9495) Sanity check visiblity and audience for hbase-client and hbase-common apis.
[ https://issues.apache.org/jira/browse/HBASE-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-9495. -- Resolution: Fixed Resolving. All subtasks are done and it seems like what this issue discussed has been fixed elsewhere. Reopen if I have it wrong Jon. Sanity check visiblity and audience for hbase-client and hbase-common apis. --- Key: HBASE-9495 URL: https://issues.apache.org/jira/browse/HBASE-9495 Project: HBase Issue Type: Task Affects Versions: 0.95.2 Reporter: Jonathan Hsieh Assignee: Jonathan Hsieh Priority: Critical Fix For: 0.98.0, 0.96.0 This is a task to audit and enumerate places where hbase-common and hbase-client should narrow or widen the exposed user program supported api. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
