RandomTextWriter

2008-07-07 Thread Chris K Wensel
Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. chris -- Chris K Wensel [EMAIL PROTECTED] http://chris.wensel.net/ http://www.cascading.org/

Re: RandomTextWriter

2008-07-07 Thread Arun C Murthy
On Jul 7, 2008, at 9:46 AM, Chris K Wensel wrote: Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. What problems are you seeing? It seems to work fine for me... Arun

Re: RandomTextWriter

2008-07-07 Thread Chris K Wensel
, 2008, at 10:08 AM, Arun C Murthy wrote: On Jul 7, 2008, at 9:46 AM, Chris K Wensel wrote: Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. What problems are you seeing? It seems to work fine for me.

Re: RandomTextWriter

2008-07-07 Thread Chris K Wensel
008, at 9:46 AM, Chris K Wensel wrote: Hey all Has anyone had success with RandomTextWriter? I'm finding it fairly unstable on 0.16.x, haven't tried 0.17 yet though. What problems are you seeing? It seems to work fine for me... Arun -- Chris K Wensel [EMAIL PROTECTED] http

randomtextwriter can not write 100GB text file on a 500GB cluster

2008-06-29 Thread Richard Zhang
met it before? Below is the command I used: bin/hadoop jar hadoop-0.17.0-examples.jar randomtextwriter -D test.randomtextwrite.min_words_key=5 -D test.randomtextwrite.max_words_key=10 -D test.randomtextwrite.min_words_value=20 test.randomtextwrite.max_words_value=100 -D