Hello,
While looking at, http://hbase.apache.org/book.html#important_configurations,
I noticed large machine configuration section still isnt completed.
¨Unfortunately¨, I am running on a large machine which as 64gb of memory
therefore I would need some help tuning my hbase/hadoop instance for
max
Funny, but this is part of a talk that I submitted to Strata
64GB and HBase isn't necessarily a 'large machine'.
If you're running w 12 cores, you're talking about a minimum of 48GB just for
M/R.
(4GB a core is a good rule of thumb )
Depending on what you want to do, you could set aside 8
So I see you're looking at Eran's problem ;-)
Since you say he's fairly capable, I'm assuming when he said he had GC and
MSLABS set up, he did it right, so a GC pause wouldn't cause the error.
Bad node? possible. It could easily be a networking/hardware issue which are
pain in the ass prob
most of the operations I do with MR are exporting tables and importing
tables. Does that still require a lot of memory and does it help to
allocate more memory for jobs like that?
Yes, I have 12 cores also. Are there any HDFS/MR/Hbase tuning tips for this
many processors?
btw, 64GB is a lot for u
Hi,
that depends how you open it in tomcat.
if you open the connection to zookeeper inside a Servlet you can
implement the destroy() method to clean up your resources.
/**
* Cleans up resource connection
*/
public void destroy() {
try {
resource .close();
I have set dfs.datanode.max.xcievers=4096 and have swapping turned off,
Regionserver Heap = 24 GB
Datanode Heap = 1 GB
On Fri, May 11, 2012 at 9:55 AM, sulabh choudhury wrote:
> I have spent a lot of time trying to find a solution to this issue, but
> have had no luck. I think this is because of
Hi Christoph
Thanks for the response. My issue is more general in nature. I also have
stand alone batches where I need to manage these zookeeper client
connections. These batches are just POJOs that get terminated without any
shutdown hooks so this is a bit challenging for me to get rid of existin
Hi Narenda,
There are some shared static data structures inside the HBase client that
are keyed on Configuration objects. Do you reuse the same Configuration
object everytime you instantiate an HTable? By reusing the same
Configuration objects you may cause ZooKeeper connections to be reused.
I'm
I am out of the office until 05/14/2012.
I will respond to your message when I return.
Note: This is an automated response to your message "DatanodeRegistration,
socketTImeOutException" sent on 05/11/2012 10:55:31.
This is the only notification you will receive while this person is away.
Look at HBaseCon agenda. Blake from Tumblr will be talking about Tumblr's use
of HBase. Hopefully Cloudera will make videos of all talks available.
Otis
Performance Monitoring for Solr / ElasticSearch / HBase -
http://sematext.com/spm
>
> From: S Ahmed
On Fri, May 11, 2012 at 5:17 AM, Jiajun Chen wrote:
> 2012-05-11 16:07:19,988 WARN org.apache.hadoop.ipc.HBaseServer:
> (responseTooSlow):
> {"processingtimems":12439,"call":"multi(org.apache.hadoop.hbase.client.MultiAction@1fce9e31),
> rpc version=1, client version=29, methodsFingerPrint=54742778
Hi Dave
I reuse HBase configuration object as much as possible. I make it static so
that there is one config per JVM. But the problem is stopping and starting
the batches or the tomcat container which is where I keep getting the
issue. The issue is I run in to this issue with HBase shell also to m
12 matches
Mail list logo
