Cool
Sent from Yahoo Mail on Android
I cloned http://svn.apache.org/repos/asf/nutch/trunk but couldn't find
dependency on HBase
The following command turned up nothing:
$ find . -name '*.java' -exec grep hbase {} \; -print
Laxmi:
Mind telling me what I was missing ?
On Sun, Oct 20, 2013 at 6:01 PM, A Laxmi wrote:
> Thanks Jean!
@Dhaval: Thanks! I did'nt know that. I've created now a field in the Mapper
class which stores information about the map() before. That works fine for
me.
regards,
john
2013/10/25 Dhaval Shah
> John, an important point to note here is that even though rows will get
> split over multiple calls
Hi,
We'll be getting together Monday (Oct 28) evening in Facebook's office
in Manhattan to talk HBase. We'll have food, drinks, several
conference rooms with projectors, two main talks, one of which will
cover HBase 0.96, plus barcamp-style sessions, followed by a visit to
an actual bar.
To RSVP
It's the last thing that I see in the file...
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/opt/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack
guard. The VM will try to fix
Can you retry with adding in your host file:
LOCAL.IP.ADDRESS.XXX HOSTNAME HOSTNAME.DOMAIN?
Like:
192.168.1.2 node2.distparser.com
?
Le vendredi 25 octobre 2013, Salih Kardan a écrit :
> No, hadoop1
>
> Salih Kardan
>
>
> On Fri, Oct 25, 2013 at 7:29 PM, Stack >
> wrote:
>
> > On hadoop2?
> >
The NPE was reported on the third line below (looking at HRegionServer.java
in 0.96 branch):
Pair p = MetaReader.getRegion(
this.catalogTracker, region.getRegionName());
if (this.getServerName().equals(p.getSecond())) {
Looks like p might be null.
bq. 2013-10-25
I see that message (about stack guard) everywhere. It does bother me, but
other things have worked. I don't know why that lib is there. It has to have
been bundled with the hadoop-2.2.0 package that I downloaded because I
didn't copy it there or anything. This was downloaded directly from the
Apach
bq. Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/opt/hadoop/lib/native/libhadoop.so.1.0.0
Can you verify your hadoop installation ? How come libhadoop.so.1.0.0 got
into play ?
On Fri, Oct 25, 2013 at 12:12 PM, psynophile wrote:
> Sure, thanks for responding, I've been wo
Sure, thanks for responding, I've been working on this and trying different
things for a week now. Here's what I see in the out file. The log file is
just repeating ulimit for the hadoop user over and over again:
[hadoop@hadoop1 hbase]$ tail -200
/opt/hadoop/hbase/logs/hbase-hadoop-regionserver-no
Haven't had a chance to run netperf, but spotted messages in syslog of the
form:
Oct 25 21:03:22 ... kernel: [107058.190743] net_ratelimit: 136 callbacks
suppressed
Oct 25 21:03:22 ... kernel: [107058.190746] nf_conntrack: table full,
dropping packet.
Which does perhaps suggest RPC requests are b
Seems like deployment issue.
[master:hadoop1:6:AssignmentManager@1974] - Failed assignment of
hbase:meta,,1.1588230740 to node3.local,60020,1382724162208, trying to
assign elsewhere instead; try=10 of 10
Can you take a look at region server log on node3.local ?
It should tell us why region co
I can't get test commands to work with hbase. Could someone help me figure
this out? Everything seems to be set up correctly, jps reports that hmaster
is running on the master node, hadoop1, and region servers are running on
the other nodes, but I get this:
hbase(main):001:0> create 'test', 'cf'
S
You can not saturate region server with one client (unless you probably use
hbase-async) if all data is cached in RAM.
In our performance tests we have run 10 clients (on different hosts) with 30
threads each to max out 1 RS when all data
is in cache (block, page, etc).
Best regards,
Vladimir Ro
What's happening before this stack trace in the log?
J-D
On Fri, Oct 25, 2013 at 6:10 AM, Salih Kardan wrote:
> Hi all
>
> I am getting the error below while starting hbase (hbase 0.94.11). I guess
> since hbase cannot
> connect to hadoop, I get this error.
>
> *java.lang.RuntimeException: Fai
No, hadoop1
Salih Kardan
On Fri, Oct 25, 2013 at 7:29 PM, Stack wrote:
> On hadoop2?
>
>
> On Fri, Oct 25, 2013 at 5:38 AM, Salih Kardan wrote:
>
> > Hi all
> >
> > I am getting the error below while starting hbase (hbase 0.94.11)
> >
> > *java.lang.RuntimeException: Failed suppression of fs
Hi,
For me scalability is to achieve same throughput and latency with the
increase in number of clients.
In my case the data set increases with the number of clients. That's the
reason I vary both clients and region servers.
I'm trying to identify how the cluster should grow to handle data from
On hadoop2?
On Fri, Oct 25, 2013 at 5:38 AM, Salih Kardan wrote:
> Hi all
>
> I am getting the error below while starting hbase (hbase 0.94.11)
>
> *java.lang.RuntimeException: Failed suppression of fs shutdown hook:
> Thread[Thread-8,5,main] at
>
> org.apache.hadoop.hbase.regionserver.Shutdown
How do you define linear scalability?
Is it as the cluster grows the time it takes to fetch data is roughly
consistent?
In your test… you’re changing both the number of users and the size at the same
time.
And here’s a bigger question… are these physical machines or are they on AWS?
1) H
Vinay:
Can you get jstack of the 2 region servers during load and pastebin them ?
Thanks
On Fri, Oct 25, 2013 at 7:53 AM, Vinay Kashyap wrote:
> Hi Lars,
>
> Yes, I understand that it is not advisable to configure memstore with such
> a huge value, but I wanted to test HBase for the scalabilit
Hi Lars,
Yes, I understand that it is not advisable to configure memstore with such
a huge value, but I wanted to test HBase for the scalability of HBase when
data is completely in memory and also I want to avoid disk access as I have
single disk configured with RAID-1, which is not an optimized f
Hi all
I am getting the error below while starting hbase (hbase 0.94.11)
*java.lang.RuntimeException: Failed suppression of fs shutdown hook:
Thread[Thread-8,5,main] at
org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressHdfsShutdownHook(ShutdownHook.java:196)
at
org.apache.hadoop.hbase.reg
Ted,
I running 8 clients in first and 25 in second. Clients running in same
machines where region servers are running.
Regards,
Ramu
John, an important point to note here is that even though rows will get split
over multiple calls to scanner.next(), all batches of 1 row will always reach 1
mapper. Another important point to note is that these batches will appear in
consecutive calls to mapper.map()
What this means is that yo
Hi all
I am getting the error below while starting hbase (hbase 0.94.11). I guess
since hbase cannot
connect to hadoop, I get this error.
*java.lang.RuntimeException: Failed suppression of fs shutdown hook:
Thread[Thread-8,5,main] at*
*
org.apache.hadoop.hbase.regionserver.ShutdownHook.suppressH
One thing I could do is to drop every batch-row where the column-size is
smaller than the batch size. Something like if(rowsize < batchsize-1) drop
row. The problem with this version is that the last row of a big row is
also droped. Here a little example:
There is one row:
row1: 3500 columns
If I
I try to build a MR-Job, but in my case that doesn't work. Because if I set
for example the batch to 1000 and there are 5000 columns in row. Now i
found to generate something for rows where are the column size is bigger
than 2500. BUT since the map function is executed for every batch-row i
can't s
27 matches
Mail list logo
