Re: Passing Properties With Whitespace To Streaming

2009-10-28 Thread Brian Vargas
Todd, I am using CDH2, and solution 'a' fixed the problem. Thanks for the help, and I look forward to the next release! Brian Todd Lipcon wrote: > Hi Brian, > > Any chance you are using the Cloudera distribution? We did accidentally ship > a bug like this which will be ameliorated in our next

Re: Passing Properties With Whitespace To Streaming

2009-10-28 Thread Todd Lipcon
Hi Brian, Any chance you are using the Cloudera distribution? We did accidentally ship a bug like this which will be ameliorated in our next release. The temporary workarounds are: a) edit /usr/bin/hadoop and change the $* to a "$@" (including the quotes!) or b) use /usr/lib/hadoop-0.20/bin/had

Passing Properties With Whitespace To Streaming

2009-10-28 Thread Brian Vargas
Hi, Using Hadoop 0.20 (CDH2) I'm trying to pass some JVM options to my child tasks on the command-line, like this: $ hadoop jar streaming.jar -D mapred.reduce.tasks=0 -D 'mapred.child.java.opts=-Xms200m -Xmx400m' -input foo.txt -output bar -mapper /bin/cat However, this fails with: ERROR streami