Re: Help on perl streaming

2015-12-07 Thread Dingcheng Li
Thanks for your quick response. It seems to make sense that I should put the resource file and script into the same directory. Sigh, I cannot test it now since our hadoop environment is down for maintenance this week. I will keep you posted if this will work. Thanks a lot, Dingcheng On Sun, Dec 6

Re: Help on perl streaming

2015-12-06 Thread Dingcheng Li
Without it, it works well after I comment the script to create and read the resource file. For python, exactly the same file structure, it works. I do not think that the resource file ("salesData/salesFilter.txt") should be in HDFS directory since the resource file is like a dictionary which I use

Help on perl streaming

2015-12-06 Thread Dingcheng Li
Hi, folks, I am using hadoop streaming to call perl scripts as mapper. Things are working well. But I found that the resource file reading is a problem. Basically I think that I am on the right track, -file option is the correct way to get resource file read. I tested on python script. But for pe