Re: [VOTE] The 1st HBase 0.98.10.1 patch release candidate (RC0) is available, quick vote closing 2/13/2015

2015-02-12 Thread lars hofhansl
+1 This time I just checked out the tag and verified the one change between 0.98.10 and 0.98.10.1RC0.Change is good, and since this is the only change... +1 -- Lars From: Andrew Purtell apurt...@apache.org To: dev@hbase.apache.org dev@hbase.apache.org Sent: Tuesday, February 10, 2015

data base design question

2015-02-12 Thread Jignesh Patel
I have a requirement where I have to define two entities: orders and results. Now each order can have multiple results, for db design I will have two options: Option 1: Create an embedded entity of results and store it as list object inside order tabel as one of the column field. Option 2. Create

Fwd: data base design question

2015-02-12 Thread Dima Spivak
Forwarding to users@, moving dev@ to bcc. People on the user list might be more helpful here, Jignesh. Cheers, Dima -- Forwarded message -- From: *Jignesh Patel* jigneshmpa...@gmail.com Date: Thursday, February 12, 2015 Subject: data base design question To:

[jira] [Created] (HBASE-13030) [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn

2015-02-12 Thread stack (JIRA)
stack created HBASE-13030: - Summary: [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn Key: HBASE-13030 URL: https://issues.apache.org/jira/browse/HBASE-13030

Re: [VOTE] The 1st HBase 0.98.10.1 patch release candidate (RC0) is available, quick vote closing 2/13/2015

2015-02-12 Thread ramkrishna vasudevan
+1 Built from src. Performed operations like puts/scans, compactions etc. Restarted and found all the data was found. Looks good to me. Regards Ram On Thu, Feb 12, 2015 at 9:35 AM, Anoop John anoop.hb...@gmail.com wrote: +1 Built from src Checked with some shell commands.. Looks good

[jira] [Created] (HBASE-13031) Ability to snapshot based on a key range

2015-02-12 Thread churro morales (JIRA)
churro morales created HBASE-13031: -- Summary: Ability to snapshot based on a key range Key: HBASE-13031 URL: https://issues.apache.org/jira/browse/HBASE-13031 Project: HBase Issue Type:

Re: snapshotting key ranges

2015-02-12 Thread rahul gidwani
thanks for the response guys, I've created a ticket for this issue and we can start to take it from there. https://issues.apache.org/jira/browse/HBASE-13031 maybe we can hash out how to handle the splitting / merging logic and I can start working on some patches. On Thu, Feb 12, 2015 at

[jira] [Created] (HBASE-13032) Migration of states should be possible once META is assigned and onlined.

2015-02-12 Thread Andrey Stepachev (JIRA)
Andrey Stepachev created HBASE-13032: Summary: Migration of states should be possible once META is assigned and onlined. Key: HBASE-13032 URL: https://issues.apache.org/jira/browse/HBASE-13032

[jira] [Created] (HBASE-13033) Max allowed memstore size should be 80% not 90%

2015-02-12 Thread churro morales (JIRA)
churro morales created HBASE-13033: -- Summary: Max allowed memstore size should be 80% not 90% Key: HBASE-13033 URL: https://issues.apache.org/jira/browse/HBASE-13033 Project: HBase Issue

[jira] [Created] (HBASE-13034) Importing rows with bulkupload can overload single regionservers

2015-02-12 Thread Bryant Khau (JIRA)
Bryant Khau created HBASE-13034: --- Summary: Importing rows with bulkupload can overload single regionservers Key: HBASE-13034 URL: https://issues.apache.org/jira/browse/HBASE-13034 Project: HBase

[jira] [Resolved] (HBASE-13033) Max allowed memstore size should be 80% not 90%

2015-02-12 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales resolved HBASE-13033. Resolution: Invalid Max allowed memstore size should be 80% not 90%

[jira] [Created] (HBASE-13036) Meta scanner should use its own threadpool

2015-02-12 Thread Devaraj Das (JIRA)
Devaraj Das created HBASE-13036: --- Summary: Meta scanner should use its own threadpool Key: HBASE-13036 URL: https://issues.apache.org/jira/browse/HBASE-13036 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-11935) ZooKeeper connection storm after queue failover with slave cluster down

2015-02-12 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-11935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-11935. --- Resolution: Implemented ZooKeeper connection storm after queue failover with slave cluster

[jira] [Created] (HBASE-13035) [0.98] Backport HBASE-12867 - Shell does not support custom replication endpoint specification

2015-02-12 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-13035: - Summary: [0.98] Backport HBASE-12867 - Shell does not support custom replication endpoint specification Key: HBASE-13035 URL: https://issues.apache.org/jira/browse/HBASE-13035

[jira] [Created] (HBASE-13026) Wrong error message in case incorrect snapshot name OR Incorrect table name

2015-02-12 Thread Bhupendra Kumar Jain (JIRA)
Bhupendra Kumar Jain created HBASE-13026: Summary: Wrong error message in case incorrect snapshot name OR Incorrect table name Key: HBASE-13026 URL: https://issues.apache.org/jira/browse/HBASE-13026

[jira] [Resolved] (HBASE-13024) Broken link for Client Package Javadoc Description under section 61.1. Cluster Connections in 'http://hbase.apache.org/book.html#architecture.client'

2015-02-12 Thread Abhishek Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Kumar resolved HBASE-13024. Resolution: Duplicate Seems to be handled along with HBASE-12922. Broken link for Client

[jira] [Created] (HBASE-13027) Deprecated mapreduce.TableInputFormatBase initialization always fails

2015-02-12 Thread Sean Busbey (JIRA)
Sean Busbey created HBASE-13027: --- Summary: Deprecated mapreduce.TableInputFormatBase initialization always fails Key: HBASE-13027 URL: https://issues.apache.org/jira/browse/HBASE-13027 Project: HBase

[jira] [Created] (HBASE-13028) Cleanup mapreduce API changes

2015-02-12 Thread Sean Busbey (JIRA)
Sean Busbey created HBASE-13028: --- Summary: Cleanup mapreduce API changes Key: HBASE-13028 URL: https://issues.apache.org/jira/browse/HBASE-13028 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-13029) Table state should be deleted from META as a last operation in DeleteTableHandler

2015-02-12 Thread Andrey Stepachev (JIRA)
Andrey Stepachev created HBASE-13029: Summary: Table state should be deleted from META as a last operation in DeleteTableHandler Key: HBASE-13029 URL: https://issues.apache.org/jira/browse/HBASE-13029

snapshotting key ranges

2015-02-12 Thread rahul gidwani
Before proposing this idea, I would like to state I have recently had a through psychiatric evaluation and I'm not crazy. We here at flurry land have some very large tables on the order of 1PB, 3PB with dfs replication. We wanted to ship this table to another cluster using snapshots. Problem is

Re: snapshotting key ranges

2015-02-12 Thread Jesse Yates
Not a crazy idea at all :) It becomes very tractable if you are willing to allow keys to be munged to the nearest region boundary. The snapshot only considers the HFiles in each region and creates links to those files for the snapshot. So just capturing a subset of regions (as dictated by the

Re: snapshotting key ranges

2015-02-12 Thread Vladimir Rodionov
I do not think there is a need for new API. Take a look at TableSnapshotInputFormat which you can customize to to work with key ranges. It allows M/R over snapshots. You make a snapshot of a full table, then you run first batch of keys in M/R job then you delete snapshot and create new one ...

Re: snapshotting key ranges

2015-02-12 Thread Ted Yu
bq. allow keys to be munged to the nearest region boundary. Interesting idea. If there is region merge, this may get a bit complicated. On Thu, Feb 12, 2015 at 9:26 AM, Jesse Yates jesse.k.ya...@gmail.com wrote: Not a crazy idea at all :) It becomes very tractable if you are willing to