Re: problem with HDFS caching in Hadoop 2.3

2014-04-02 Thread hwpstorage
Thanks for the reply. I used the cat command this time, the result is not great. In my test, file hadoop003.log is cached while hadoop010.log is not cached. -bash-4.1$ /hadoop/hadoop-2.3.0/bin/hadoop fs -ls -rw-r--r-- 3 hdfs hadoop 209715206 2014-03-06 18:14 hadoop003.log -rw-r--r-- 3 hdfs

Re: problem with HDFS caching in Hadoop 2.3

2014-03-11 Thread Colin McCabe
On Fri, Mar 7, 2014 at 7:37 AM, hwpstorage hwpstor...@gmail.com wrote: Hello, It looks like the HDFS caching does not work well. The cached log file is around 200MB. The hadoop cluster has 3 nodes, each has 4GB memory. -bash-4.1$ hdfs cacheadmin -addPool wptest1 Successfully added cache

Re: problem with HDFS caching in Hadoop 2.3

2014-03-09 Thread hequn cheng
hi, have you solved your problem? i have the same problem. it seems that the cache behavior has not been triggered. 2014-03-07 23:37 GMT+08:00 hwpstorage hwpstor...@gmail.com: Hello, It looks like the HDFS caching does not work well. The cached log file is around 200MB. The hadoop cluster

problem with HDFS caching in Hadoop 2.3

2014-03-07 Thread hwpstorage
Hello, It looks like the HDFS caching does not work well. The cached log file is around 200MB. The hadoop cluster has 3 nodes, each has 4GB memory. -bash-4.1$ hdfs cacheadmin -addPool wptest1 Successfully added cache pool wptest1. -bash-4.1$ /hadoop/hadoop-2.3.0/bin/hdfs cacheadmin -listPools