Re: Hadoop Streaming and Multiline Input

2008-09-09 Thread Jim Twensky
If I understand your question correctly, you need to write your own FileInputFormat. Please see http://hadoop.apache.org/core/docs/r0.18.0/api/index.html for details. Regards, Tim On Sat, Sep 6, 2008 at 9:20 PM, Dennis Kubes [EMAIL PROTECTED] wrote: Is is possible to set a multiline text input

Re: Hadoop Streaming and Multiline Input

2008-09-09 Thread lohit
@hadoop.apache.org Sent: Tuesday, September 9, 2008 11:23:37 AM Subject: Re: Hadoop Streaming and Multiline Input If I understand your question correctly, you need to write your own FileInputFormat. Please see http://hadoop.apache.org/core/docs/r0.18.0/api/index.html for details. Regards, Tim On Sat, Sep 6, 2008

Hadoop Streaming and Multiline Input

2008-09-06 Thread Dennis Kubes
Is is possible to set a multiline text input in streaming to be used as a single record? For example say I wanted to scan a webpage for a specific regex that is multiline, is this possible in streaming? Dennis