We have been running M-R jobs successfully on Hadoop v1 and HBase 0.93 SNAPSHOT
(built from trunk) using the HBase Java API. We recently updated our Hadoop and
HBase installations to the latest versions of the code from the source
repositories.
We now have a working Hadoop 1.0.2 cluster wit
m the same but that will take a few minutes :)
Thanks,
Royston
-Original Message-
From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack
Sent: 10 April 2012 17:08
To: user@hbase.apache.org
Subject: Re: Not a host:port issue
On Tue, Apr 10, 2012 at 2:58 AM, Royston Se
On 12 Apr 2012, at 15:49, Stack wrote:
> On Thu, Apr 12, 2012 at 2:52 AM, Tom Wilcox wrote:
>> I have not confirmed this, but I have suspicions that the old hbase client
>> references were coming from the pig contributions to the classpath. I am
>> wondering if perhaps the current hbase and zo
Message-
From: Subir S [mailto:subir.sasiku...@gmail.com]
Sent: 24 April 2012 13:29
To: u...@pig.apache.org; user@hbase.apache.org
Subject: Re: HBaseStorage not working
Looping HBase group.
On Tue, Apr 24, 2012 at 5:18 PM, Royston Sellman <
royston.sell...@googlemail.com> wrote:
>
Apologies if this is the wrong forum, or has come up before, or is RTFM-class...
I'm trying to run HBase example code. I think I have HBase running OK on my 6
node cluster: I can create tables with the HBase shell. I can create tables
with the ExampleClient from Chapter 13 of the Hadoop book. I
ly shows what
ended up killing the task. Go to the jobtracker's web ui, click on your job,
click on the number of failed tasks, look at the log of one of those tasks,
and look for anything that looks bad at the end of the log before the NPE.
Hope this helps,
J-D
On Mon, Nov 14, 2011
to find it. Your job needs to know about your zookeeper
configuration.
Check this out if you need some more hints:
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-su
mmary.html#classpath
J-D
On Wed, Nov 16, 2011 at 9:20 AM, Royston Sellman
wrote:
> Thanks for your suggestion
I'm a newbie learning HBase using 0.90.4. Got my data bulk loading nicely into
a cluster and now I want to have simple SQL-like aggregations (SUM, AVG, STD,
MIN, MAX, MEDIAN, WEIGHTED MEDIAN etc) working. I started off trying to build
MR code to do this but stumbled across AggregateProtocol and
uild 0.92 RC0 to test this functionality out.
>> --Suraj
>>
>
> What Suraj said. Look in the coprocessor package. There are some
> primitives that may be of use to you that already do some form of
> this.
>
> St.Ack
On Sun, Dec 11, 2011 at 10:52 AM, Royston Sellman
Hi,
Does hbase-0.92.0-candidate-0 run with hadoop 0.20.2?
Thanks,
Royston
On 13 Dec 2011, at 09:39, Harsh J wrote:
> Akhtar,
>
> You may find them under
> http://people.apache.org/~stack/hbase-0.92.0-candidate-0/
>
> On 13-Dec-2011, at 3:04 PM, Akhtar Muhammad Din wrote:
>
>> Hi,
>> From w
>
> - Original Message -
>> From: Royston Sellman
>> To: user@hbase.apache.org
>> Cc:
>> Sent: Tuesday, December 13, 2011 8:02 AM
>> Subject: Re: hbase coprocessor availability issue in 0.90.4
>>
>> Hi,
>>
>> Does hbase-0.92.0-cand
- Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein (via
> Tom White)
>
>
> - Original Message -
>> From: Royston Sellman
>> To: user@hbase.apache.org
>> Cc:
>> Sent: Tuesday, December 13, 2011 10:42 AM
>
Hi,
We are trying to use the aggregation functionality in HBase 0.92 and we have
managed to get the test code working using the following command:
java -classpath junit-4.10.jar:build/*:$HBASELIBS/* org.junit.runner.JUnitCore
org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol
Closer in
Hi Gary and Ted,
Royston (Tom's colleague) here. Back onto this after the Christmas/New Year
break.
Many thanks for your help so far. We enabled our database via your
hbase-site.xml mod and were able to move on. to other errors. But I think we
are now actually getting an aggregation partially cal
rows are there in this CF:CQ ?
> The timeout was reported earlier by other people where there're many rows
> in the table.
>
> There is a JIRA to provide streaming support for coprocessor but the
> development there has stalled.
>
> Cheers
>
> On Sun, Jan 1, 2012 at
gion distribution as such. (how many
regions?
>> Is it a full table scan?)
>>
>> You are using the sum function; how are you using the ColumnInterpreter.
>> Can you enable the log level to debug to see why the RS is taking
>> that long to respond (more than 11
by
aClient.sum()
Can you add a few log statements in LongColumnInterpreter.add() to see what
parameters are passed to it ?
Cheers
On Tue, Jan 3, 2012 at 8:32 AM, Royston Sellman <
royston.sell...@googlemail.com> wrote:
> Hi Ted, Himanshu, Gary,
>
> Thanks again for your attenti
9:32 AM, Royston Sellman
wrote:
> Hi Ted, Himanshu, Gary,
>
> Thanks again for your attention. I experimented with a shorter table
> and it looks like the timeout error was spurious...
>
> With the shorter table I now get an NPE when I call
AggregationClient.sum().
&g
for your effort trying to hunt down the problem.
>
> Can you add a log after this line to see if aClient is null ?
> AggregationClient aClient = new AggregationClient(conf);
>
> I was looking at LongColumnInterpreter.add() which is called by
> aClient.sum()
> Can yo
cally you need to place the jar containing your coprocessor and
> interpreter code on hdfs so that you can load it into your HBase table.
> Look at this for details:
> https://issues.apache.org/jira/browse/HBASE-4554
>
> Cheers
>
> On Tue, Jan 3, 2012 at 10:42 AM, Royston Sellman <
> Cheers
>
> On Wed, Jan 4, 2012 at 3:43 AM, Royston Sellman <
> royston.sell...@googlemail.com> wrote:
>
>> Ted, Himanshu and Gary,
>>
>> It works now! I re-created my HBase table to contain Bytes.toBytes(Long)
>> values and that fixed it.
>>
&g
Just to check - did you disable it the way Tom suggested? By stopping iptables?
It's not sufficient just to turn off firewall from the control panel/app.
Best,
Royston
On 5 Jan 2012, at 17:00, yonghu wrote:
> I have already disabled ipv6 and close the firewall, but I still get
> the same probl
s
> multiple roundtrips (to the region servers).
>
> Just want to confirm the use case.
>
> Thanks
>
> On Wed, Jan 4, 2012 at 10:57 AM, Royston Sellman <
> royston.sell...@googlemail.com> wrote:
>
>> Great ideas. Thanks.
>>
>> w.r.t. 5123:
Done.
Thanks,
Royston
> Do you mind putting what you wrote below on hbase-5123 ?
>
> Thanks
>
>
>
> On Jan 6, 2012, at 6:22 AM, Royston Sellman
> wrote:
>
>> Hi Ted,
>>
>> Yes, that is the use case I am thinking of.
>>
>>
e subtask so that the original JIRA can host general
> discussions.
>
> Cheers
>
> On Fri, Jan 6, 2012 at 6:22 AM, Royston Sellman <
> royston.sell...@googlemail.com> wrote:
>
>> Hi Ted,
>>
>> Yes, that is the use case I am thinking of.
>>
>&g
Trying to run my code (a test of Aggregation Protocol and an MR HBase table
loader) on latest build of 0.92.0 (r1232715) I get an 'old server' warning
(I've seen this before and it's always been non-fatal) then an out of memory
exception then job hangs:
[sshexec] 12/01/20 16:56:48 WARN zookeepe
f 0.90-style RPCs
> properly.
>
> Were your client code compiled with the same version of HBase as what was
> running on your cluster ?
>
> Thanks
>
> On Fri, Jan 20, 2012 at 9:20 AM, Royston Sellman <
> royston.sell...@googlemail.com> wrote:
>
>> Tryin
So should I try applying Benoit Sigoure's patch for HBASE-5204? Will this patch
be in the 0.92 branch soon?
Cheers,
Royston
On 21 Jan 2012, at 16:58, yuzhih...@gmail.com wrote:
> That is the correct branch.
>
> Thanks
>
>
>
> On Jan 21, 2012, at 8:50 AM,
17:13, yuzhih...@gmail.com wrote:
> Benoit's patches are already in 0.92
>
> Thanks
>
>
> On Jan 21, 2012, at 9:11 AM, Royston Sellman
> wrote:
>
>> So should I try applying Benoit Sigoure's patch for HBASE-5204? Will this
>> patch be in the 0.92 branc
2012 17:14
To: user@hbase.apache.org
Subject: Re: Hbase out of memory error
Benoit's patches are already in 0.92
Thanks
On Jan 21, 2012, at 9:11 AM, Royston Sellman
wrote:
> So should I try applying Benoit Sigoure's patch for HBASE-5204? Will this
patch be in the 0.92 branch soon
30 matches
Mail list logo
