Re: Using addCacheArchive

2009-06-29 Thread Chris Curtin
r and tgz/tar.gz files) are un-archived at the slave nodes. > >> > > >> > So, from my understanding of the API docs I expect that the Config.zip > >> > file will be unzipped to Config directory and since I have SymLinked > >> them > >> > I can access

Re: Using addCacheArchive

2009-06-26 Thread akhil1988
l be unzipped to Config directory and since I have SymLinked >> them >> > I can access the directory in the following manner from my map >> function: >> > >> > FileInputStream fin = new FileInputStream("Config/file1.config"); >> > >

Re: Using addCacheArchive

2009-06-26 Thread Chris Curtin
from my map function: > > > > FileInputStream fin = new FileInputStream("Config/file1.config"); > > > > But I get the FileNotFoundException on the execution of this statement. > > Please let me know where I am going wrong. > > > > Thanks, > > Akhil > > > > -- > View this message in context: > http://www.nabble.com/Using-addCacheArchive-tp24207739p24210836.html > Sent from the Hadoop core-user mailing list archive at Nabble.com. > >

Re: Using addCacheArchive

2009-06-25 Thread akhil1988
org/core/docs/r0.20.0/api/index.html) says that >>>>> the >>>>> archive files are unzipped in the local cache directory : >>>>> >>>>> DistributedCache can be used to distribute simple, read-only data/text >>>>> files and/or

Re: Using addCacheArchive

2009-06-25 Thread Amareshwari Sriramadasu
Is your hdfs path /home/akhil1988/Config.zip? Usually hdfs path is of the form /user/akhil1988/Config.zip. Just wondering if you are giving wrong path in the uri! Thanks Amareshwari akhil1988 wrote: Thanks Amareshwari for your reply! The file Config.zip is lying in the HDFS, if it would not h

Re: Using addCacheArchive

2009-06-25 Thread akhil1988
s I expect that the Config.zip >>> file will be unzipped to Config directory and since I have SymLinked >>> them >>> I can access the directory in the following manner from my map function: >>> >>> FileInputStream fin = new FileInputStream("Config/file1.config"); >>> >>> But I get the FileNotFoundException on the execution of this statement. >>> Please let me know where I am going wrong. >>> >>> Thanks, >>> Akhil >>> >>> >> >> > > > -- View this message in context: http://www.nabble.com/Using-addCacheArchive-tp24207739p24214657.html Sent from the Hadoop core-user mailing list archive at Nabble.com.

Re: Using addCacheArchive

2009-06-25 Thread Amareshwari Sriramadasu
Hi Akhil, DistributedCache.addCacheArchive takes path on hdfs. From your code, it looks like you are passing local path. Also, if you want to create symlink, you should pass URI as hdfs://#, besides calling DistributedCache.createSymlink(conf); Thanks Amareshwari akhil1988 wrote: Please a

Re: Using addCacheArchive

2009-06-25 Thread akhil1988
wing manner from my map function: > > FileInputStream fin = new FileInputStream("Config/file1.config"); > > But I get the FileNotFoundException on the execution of this statement. > Please let me know where I am going wrong. > > Thanks, > Akhil > -- View this me

Using addCacheArchive

2009-06-25 Thread akhil1988
, Akhil -- View this message in context: http://www.nabble.com/Using-addCacheArchive-tp24207739p24207739.html Sent from the Hadoop core-user mailing list archive at Nabble.com.