Suraj,
Hbase works when i work with smaller clusters, so i dont think hbase is the
problem. But Now i'm trying to include conf directory in classpath and try
again.
But please tell me this, I dont find any proper documentation for starting
hbase in fully distributed mode.
So please help me :
hbase-site.xml [master & slave]
hbase.rootdir
hdfs://master.hadoopcluster:9000/hbase
The directory shared by region servers.
hbase.cluster.distributed
true
hbase.zookeeper.quorum
master.hadoopcluster,slave1.hadoopcluster,slave2.hadoopcluster
hbase.zookeeper.property.clientPort
2181
hbase.tmp.dir
/home/user/space/hbase-${user.name}
hbase.zookeeper.property.dataDir
${hbase.tmp.dir}/zookeeper
========
the regionservers file [master]
master.hadoopcluster
slave1.hadoopcluster
slave2.hadoopcluster
the regionservers file [slave1]
slave1.hadoopcluster
the regionservers file [slave2]
slave2.hadoopcluster
========================================================
netstat -ane | grep java
showed me :
tcp 0 0 ::ffff:172.21.203.112:2181 ::ffff:172.21.203.112:14271
ESTABLISHED 4850/java
its my local IP, not 127.0.0.1 .. i hope that is okay.!?
rajgopalv wrote:
>
>>From the logs, it looks like you don't have hbase conf directory in the
> classpath. Can you recheck? Also - in what mode are you running hbase?
> Fully
> distributed? If so, is zookeeper running locally (localhost:2181).
>
> My guess is that you are missing the hbase conf directory in your
> classpath.
> --Suraj
>
>
> Ted,
>
> For small data it works fine.!
>
> I tried reading 100 rows from a CSV and inserted into hbase, it worked.
> Now 15Million rows is not working. Stuck with this really bad.!!! %-|
>
>
> Ted Dunning-2 wrote:
>>
>> Very small clusters are often problematic but your logs look like your
>> cluster has something really hosey going on beyond just process going
>> missing for a time. I don't know what it is, off-hand, but it is ugly.
>> Approaching this cold, I would not assume
>> that anything is correct. Thus I would look at network configuration,
>> DNS
>> and other simple things.
>>
>> Can you run small test jobs correctly or does everything mess up?
>>
>> On Wed, Dec 8, 2010 at 8:26 PM, rajgopalv wrote:
>>
>>>
>>> Ted,
>>>
>>> I've tried incrementing my own counter in every map job, but this keep
>>> happening.
>>> Kindly look at the log here http://pastebin.com/Xv76mXDJ
>>> http://pastebin.com/Xv76mXDJ
>>>
>>> One more question,
>>> I have a small cluster of small computers now. Cluster contains 2
>>> machines,
>>> each of 2GB ram, dual core. but i've increased the hadoop and hbase
>>> heapsize
>>> to 1.5 gb. will this create any problem ? (other than slowing down the
>>> process, i dont think this will lead to errors like what is in the log
>>> that
>>> i've given above)
>>>
>>>
>>> Ted Dunning-2 wrote:
>>> >
>>> > lt looks like your task took a long time to complete (> 10 minutes)
>>> and
>>> > didn't produce any output or report any status to Hadoop during this
>>> time.
>>> >
>>> > This often happens during indexing tasks where a reducer or mapper
>>> builds
>>> > some off-line data structure for a long time. Can you force your
>>> mappers
>>> > to
>>> > update a Hadoop counter as they go along? That might be all that is
>>> > needed.
>>> >
>>> > On Tue, Dec 7, 2010 at 5:37 AM, rajgopalv wrote:
>>> >
>>> >> Task attempt_201012071646_0001_m_000025_0 failed to report status for
>>> 600
>>> >> seconds. Killing!
>>> >>
>>> >
>>> >
>>>
>>> --
>>> View this message in context:
>>> http://old.nabble.com/Zoo-keeper-exception-in-the-middle-of-MR-tp30396344p30412978.html
>>> Sent from the HBase User mailing list archive at Nabble.com.
>>>
>>>
>>
>>
>
>
--
View this message in context:
http://old.nabble.com/Zoo-keeper-exception-in-the-middle-of-MR-tp30396344p30423879.html
Sent from the HBase User mailing list archive at Nabble.com.
