How pig make hadoop to recognize "pig.reduce.output.dirs" property to set output directory?

2014-08-04 Thread Ji Mahn Ok
Hi, I would like to ask a question on pig property to set the output directory of MapReduce Job produced by pig. As we know, "mapreduce.output.fileoutputformat.outputdir" or "mapred.output.dir" is the property we use to set the output directory. It seems that pig sets "pig.reduce.output.dirs" prop

No setting for output key/value class in MapOnly Job. Could anyone explain the reason/intention for this, if any?

2014-07-30 Thread Ji Mahn Ok
Hi, I am a kind of novice on Pig and currently reviewing the overall source code briefly because I run pig on top of an other execution engine (somewhat similar to hadoop) in my project. In the middle of looking at JobControlCompiler class code, I found that, in case of MapOnly job, the property f

Where can I find the class in which the job configurations are set in a job jar file produced by pig?

2014-07-17 Thread Ji Mahn Ok
Hello, I am trying to find the class which contains the job configuration part in a job file produced by pig. In detail, for example, I run a PigMix query. As you know, when I run pig script, it produces job jar file in tmp directory. I stored that job jar file separately to figure out what kind