Hi, stack
See the hadoop-site.xml in the attachment.
dfs.datanode.socket.write.timeout = 0, dfs.datanode.max.xcievers=1023
The hbase-site.xml is not interesting.
It contains only "hbase.rootdir" and "hbase.master"
I checked the logs (I did not know hbase logged ulimit).
On all region server hosts ulimit is 32768. On the master host ulimit is 1024.
Thank you for your cooperation,
M.
On Thu, Mar 19, 2009 at 7:52 PM, stack <[email protected]> wrote:
> Can you pull this file from your hdfs?
>
> /hbase/.META./1028785192/info/mapfiles/3882153324238090640/index
>
> Michael, these seem to be issues related to ulimit -n or to xceivers count
> or to dfsclient timeout. Can you confirm for us that you have indeed have
> correct configurations in place. Tell us also how you have these
> configurations deployed.
>
> Can you paste the hbase-site.xml, the hadoop-site.xml, and the first few
> lines of your log when it starts up where it shows the jvm and ulimit
> settings?
>
> Thanks,
> St.Ack
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/mnt/hadoop/data</value>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://hbmaster1:54310</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>hbmaster1:54311</value>
</property>
<property>
<name>dfs.replication</name>
<value>2</value>
</property>
<property>
<name>tasktracker.http.threads</name>
<value>80</value>
</property>
<property>
<name>mapred.tasktracker.map.tasks.maximum</name>
<value>3</value>
</property>
<property>
<name>mapred.tasktracker.reduce.tasks.maximum</name>
<value>3</value>
</property>
<property>
<name>mapred.output.compress</name>
<value>true</value>
</property>
<property>
<name>mapred.output.compression.type</name>
<value>BLOCK</value>
</property>
<property>
<name>dfs.client.block.write.retries</name>
<value>3</value>
</property>
<property>
<name>dfs.datanode.socket.write.timeout</name>
<value>0</value>
</property>
<property>
<name>dfs.datanode.max.xcievers</name>
<value>1023</value>
</property>
</configuration>
