From: Wei Tan [w...@us.ibm.com]
Sent: Wednesday, February 26, 2014 9:48 PM
To: user@hbase.apache.org
Subject: Re: Is HBase is feasible for storing 4-5 MB of data as cell value
I am thinking of storing medium sized objects (~1M) using HBase. The
advantage of using HBase rather than HBase (storin
26, 2014 9:48 PM
To: user@hbase.apache.org
Subject: Re: Is HBase is feasible for storing 4-5 MB of data as cell value
I am thinking of storing medium sized objects (~1M) using HBase. The
advantage of using HBase rather than HBase (storing pointers) + HDFS, in
my mind, is:
data locality. When I want
block size given
the object size.
Thanks,
Wei
From: Upendra Yadav
To: user@hbase.apache.org,
Date: 02/25/2014 03:31 PM
Subject: Re: Is HBase is feasible for storing 4-5 MB of data as
cell value
Me too realize same what you suggest...: (Keep them in a separate files in
HDFS
; Sent: Tuesday, February 25, 2014 12:02 PM
> To: user@hbase.apache.org
> Subject: Re: Is HBase is feasible for storing 4-5 MB of data as cell value
>
> Minor:
> Value 0 also means no cap - see HTable#validatePut()
>
> if (maxKeyValueSize > 0) {
>
> ...
&
25, 2014 12:02 PM
To: user@hbase.apache.org
Subject: Re: Is HBase is feasible for storing 4-5 MB of data as cell value
Minor:
Value 0 also means no cap - see HTable#validatePut()
if (maxKeyValueSize > 0) {
...
if (kv.getLength() > maxKeyValueSize) {
thr
Minor:
Value 0 also means no cap - see HTable#validatePut()
if (maxKeyValueSize > 0) {
...
if (kv.getLength() > maxKeyValueSize) {
throw new IllegalArgumentException("KeyValue size too large");
}
On Tue, Feb 25, 2014 at 11:52 AM, Ameya Kanitkar wrote:
>
The only other thing I'd add is, by default HBase caps size of the data per
column at 10 MB (I think). You can change that by changing this setting:
hbase.client.keyvalue.maxsize
in hbase-site.xml
-1 means no cap. You can put other numbers for appropriate cap for your use
case.
Ameya
On Tue, F
Yes for sure you can use hbase for this, you can have
1. different fields of mail in different column of a column family and
attachment as a binary array also in a column.
2. you can keep whole message in columns in hbase and the attachments are
large enoug on the hdfs and some reference to it in h
