Hi Wojciech, Well, the parameter mapred.child.java.opts is also subject to memory limit of your box and by the limit set by mapred.child.ulimit. It is ideal though to find the root cause of heap error. If needed use specific mapred.(map|reduce).child.java.opts as needed.
In some cases it needs to be rectified by using nocombiner (-Dpig.exec.nocombiner=true) but I reckon that would be 0.8.. Also as Olga confirmed from 0.8 you would be able to see -D params list settable from pig command using -help -properties Thanks & Regards, /Rekha On 10/25/10 2:15 AM, "Wojciech Langiewicz" <[email protected]> wrote: Hi, But will this work with different settings for every job? Because this is what I essentially need. Marcos Medrado Rubinelli wrote: > Wojcieh, > > One alternative is setting this and other parameters in a > mapred-site.xml file in your classpath. > > Chhers, > Marcos > >> Hello, >> I want to set more heap space to my scripts, but I can't make Pig >> support this, when I call: "pig -Dmapred.child.java.opts=-Xmx2048" >> It fails (just prints help), and option --help doesn't show any >> information about -D parameter. >> >> How can I do this? >> I'm using version 0.7.0+9. >> -- >> Wojciech Langiewicz
