Hey,
HBase should work for your scenario. It will require a more than just
a few nodes, but should be doable.
So some answers:
- Generally as long as you dont have hot spots, adding nodes creates
linear scaling.
-- How long? Could be a while, there are not 1000 node HBase
installations yet, but t
I investigated following your guidance, Stack. Unfortunately I am not
seeing evidence of double assignment. It looks more like a case of missing
assignment. There appear to be key ranges that are not represented in the
.META. table. So, I have a region that handles keys AAA to BBB, and the
next
I am evaluating replacing a homegrown file storage system with HBase.
Here are the stats on our current environment:
- Our workload is going to all be single record reads and writes
- We have 50TB of data, with each record being a10kb to 10mb in
size, (average of 300kb), in a single colum
Cool. I am very interested to see what your results are. I am running
another test with with one change from last time:
dfs.datanode.max.xcievers
4096
The 554 errors from the last run were all due to
BlockAlreadyExistsExceptions:
2009-11-03 15:44:30,322 ERROR
org.apache.hadoop.hdfs.s
On Tue, Nov 3, 2009 at 2:13 PM, Artyom Shvedchikov wrote:
> Hallo, folks.
>
> We want to use partial-key lookup and compound keys (search using them)
> with
> Java API.
> Can someone to provide info and example on using such keys and lookups.
>
>
I'm not sure I understand you correctly, but parti
Meta is giving out the wrong address for a region? Do a scan of .META. It
might be easier dumping the scan into a file so you can grep around:
echo "scan '.META.'" | ./bin/hbase shell --format-width=300 &> /tmp/meta.txt
Grep in here for the region that contains the row you are looking for. Wha
HBase has started throwing WrongRegionExceptions at me when trying to access
certain regions. I'm guessing that the META table has somehow gone out of
sync with reality. I've tried compacting and I've tried restarting, but the
problem does not go away. The errors are always on the same regions.
Hi Amandeep,
Could you be a bit more specific what and ?
Should it be something different than "127.0.1.1ubuntu" ?
I'm rather a weak linux administrator and not filling well this area.
Saawek
2009/11/2 Amandeep Khurana
> Add the following in your /etc/hosts
>
>
>
> That might be the
Well it's fixed and committed in the 0.20 branch. You can do a svn
checkout or wait for 0.20.2 (very soon).
J-D
On Wed, Nov 4, 2009 at 9:45 AM, Ananth T. Sarathy
wrote:
> Sorry, you still want to me test it? I have been sick.
> Ananth T Sarathy
>
>
> On Tue, Nov 3, 2009 at 11:11 PM, Jean-Daniel
Sorry, you still want to me test it? I have been sick.
Ananth T Sarathy
On Tue, Nov 3, 2009 at 11:11 PM, Jean-Daniel Cryans wrote:
> Well I found a fix that works, currently testing.
>
> J-D
>
> On Tue, Nov 3, 2009 at 2:15 PM, Jean-Daniel Cryans
> wrote:
> > Ananth,
> >
> > If you can, please t
elsif, i'll give your program a go in a day or so and report back.
St.Ack
On Tue, Nov 3, 2009 at 6:47 PM, elsif wrote:
> I am interested as to what other folks are seeing when running this test
> against their clusters. I think my configuration is sound and the load
> is fairly realistic. Plea
11 matches
Mail list logo
