Hadoop Distributed Caching Technology
Hi, Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs. Cheers, Deb
Re: Hadoop Distributed Caching Technology
Hi Deb, We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs. See the docs here: http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html Best, Andrew On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish debashish.ma...@softwareag.com wrote: Hi, Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs. Cheers, Deb
RE: Hadoop Distributed Caching Technology
So how I am going to change to other cache technology like Hazelcast or ehcache etc. -Original Message- From: Andrew Wang [mailto:andrew.w...@cloudera.com] Sent: Monday, October 20, 2014 8:52 PM To: common-dev@hadoop.apache.org Subject: Re: Hadoop Distributed Caching Technology Hi Deb, We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs. See the docs here: http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html Best, Andrew On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish debashish.ma...@softwareag.com wrote: Hi, Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs. Cheers, Deb
Re: Hadoop Distributed Caching Technology
Hi Debashish, Do you mind describing in a little more detail the benefits you're interested in with different caching technology? The Hadoop distributed cache, HDFS caching, memcached, and Hazelcast are all related to caching, but aim to solve very different problems. -Sandy On Mon, Oct 20, 2014 at 12:01 PM, Maity, Debashish debashish.ma...@softwareag.com wrote: So how I am going to change to other cache technology like Hazelcast or ehcache etc. -Original Message- From: Andrew Wang [mailto:andrew.w...@cloudera.com] Sent: Monday, October 20, 2014 8:52 PM To: common-dev@hadoop.apache.org Subject: Re: Hadoop Distributed Caching Technology Hi Deb, We added support for centralized cache management to HDFS, which is out of the box and works with MR jobs. See the docs here: http://hadoop.apache.org/docs/r2.5.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html Best, Andrew On Mon, Oct 20, 2014 at 8:07 AM, Maity, Debashish debashish.ma...@softwareag.com wrote: Hi, Is there a way to use some other cache technology instead of memcache which is out of box in Hadoop Map-Reduce jobs. Cheers, Deb
