fwiw CallerDisconnectedException: Aborting call multi means that:
- the query was under execution on the server
- the client reached its timeout and disconnected
- the server saw that and stopped the execution of the query.
So it's the consequence of a slow execution, not the cause.
It would
The warning was logged by DFSOutputStream.
What was the load on hdfs around 2014-12-05 12:03 ?
Have you checked namenode log ?
Cheers
On Thu, Dec 4, 2014 at 9:01 PM, mail list louis.hust...@gmail.com wrote:
Hi ,all
I deploy Hbase0.98.6-cdh5.2.0 on 3 machine:
l-hbase1.dev.dba.cn0(hadoop
I also got the the RegionServer stack on the region server as below:
RS_OPEN_META-l-hbase3:60020-0-WAL.AsyncNotifier prio=10
tid=0x7f7e7c259000 nid=0x3d1 in Object.wait() [0x7f7e5eb9]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native
I will read it. Thanks!
The size of data is not A or B uniqueIds is pretty small compare to whole
dataset, so I think that points to the unique table solution.
Marc
-Original Message-
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Thursday, December 04, 2014 1:12 PM
To:
Hey folks,
I am trying to write a map reduce in pig against my hbase table.I have a
salting in my rowkey appended with reverse timestamps ,so I guess the best
way is to do a scan for all the dates that I require to pull out
records.Does any one know if pig supports hbase scan out of the box or
There is a built in storage handler for HBase. Take a look at the docs at
https://pig.apache.org/docs/r0.14.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html
It doesn't support dealing with salted rowkeys (or reverse timestamps) out
of the box, so you may have to munge with the data a
Thank you Pradeep.That was helpful.
-Nishan
On Fri, Dec 5, 2014 at 11:08 AM, Pradeep Gollakota pradeep...@gmail.com
wrote:
There is a built in storage handler for HBase. Take a look at the docs at
https://pig.apache.org/docs/r0.14.0/api/org/apache/pig/backend/hadoop/hbase/HBaseStorage.html
Hey all,
So, I'm currently evaluating HBase as a solution for querying a very large
data set (think 60+ TB). We'd like to use it to directly power a
customer-facing product. My question is threefold :
1) What companies use HBase to serve a customer-facing product? I'm not
interested in
Hi Jeremy!
We'll probably need more information to answer your questions.
In particular, what kind of read or write SLA are you looking to meet? At
what scale of concurrent users? What size of retrievals?
Normally, customer facing application means something in the human
interactive time scale,
Please see the following:
Facebook messages:
https://www.facebook.com/notes/facebook-engineering/the-underlying-technology-of-messages/454991608919
https://www.facebook.com/UsingHbase
https://www.facebook.com/download/499785426741400/Storage%20Infrastructure%20Behind%20Facebook%20Messages%20.pdf
The folks from Gap have a really nice use case:
http://www.slideshare.net/cloudera/1-serving-apparel-catalog-from-h-base-suraj-varma-gap-inc-finalupdated-last-minute
--
Cloudera, Inc.
On Fri, Dec 5, 2014 at 2:01 PM, Ted Yu yuzhih...@gmail.com wrote:
Please see the following:
Facebook
Hi Jeremy,
pinterest is using it for their feeds:
http://www.slideshare.net/cloudera/case-studies-session-3a
http://www.slideshare.net/cloudera/operations-session-1
Not sure on their dataset size, they are doing cluster level replication
for DR. We based our architecture on their success
Hi Ted,Thanks for your reply.Actually I shutdown the l-hbase1.dev.dba.cn0 at the time 11:47:51 and the hbase recover at 12:03the below log is the zkfc log on l-hbase2{log}2014-12-05 11:18:47,077 INFO org.apache.hadoop.ha.ActiveStandbyElector: Already in election. Not re-connecting.2014-12-05
13 matches
Mail list logo
