Re: Reading fields from a Text line

Wouldn't it be better if you could skip those unwanted lines upfront(preprocess) and have a file which is ready to be processed by the MR system? In any case, more details are needed. On Thu, Aug 2, 2012 at 8:23 AM, Harsh J wrote: > Mohammad, > > > But it seems I am not doing things in correct

Re: Reading fields from a Text line

Mohammad, > But it seems I am not doing things in correct way. Need some guidance. What do you mean by the above? What is your written code exactly expected to do and what is it not doing? Perhaps since you ask for a code question here, can you share it with us (pastebin or gists, etc.)? For sk

Issue with Hadoop Streaming

I am trying to run hadoop streaming using perl script as the mapper and with no reducer. My requirement is for the Mapper  to run on one file at a time.  since I have to do pattern processing in the entire contents of one file at a time and the file size is small. Hadoop streaming manual sugge

Reading fields from a Text line

Hello list, I have a flat file in which data is stored as lines of 107 bytes each. I need to skip the first 8 lines(as they don't contain any valuable info). Thereafter, I have to read each line and extract the information from them, but not the line as a whole. Each line is composed of sev

Re: server side DAG of jobs in YARN

Not working yet. I expect to finish it in one month or so. On Tue, Jul 31, 2012 at 3:15 AM, Radim Kolar wrote: > > I am working on the server side DAG execution actually. Here is a JIRA. >> >> https://issues.apache.org/**jira/browse/MAPREDUCE-4495

Re: server side DAG of jobs in YARN

I am working on the server side DAG execution actually. Here is a JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-4495 do you have some code in hand?