Re: Using the Stanford NLP with hadoop

by 'ClassName', which class are you actually refering to? the class in which the LexicalParser is invoked? in my code, the class that implements the parser is named 'parse' and this is the code that i used. lp = new LexicalizedParser(new ObjectInputStream(new GZIPInputStream(parse.class.getReso

Re: Using the Stanford NLP with hadoop

On Tue, Apr 21, 2009 at 4:58 PM, Kevin Peterson wrote: > I'm interested to know if you have found any other open source parsers in > Java or at least have java bindings. Stanford is one of the best, although it is slow. LingPipe is free for non-commercial use, and

Re: Using the Stanford NLP with hadoop

On Sat, Apr 18, 2009 at 5:18 AM, hari939 wrote: > > My project of parsing through material for a semantic search engine > requires > me to use the http://nlp.stanford.edu/software/lex-parser.shtml Stanford > NLP parser on hadoop cluster. > > To use the Stanford NLP parser, one must create a lex

Re: Using the Stanford NLP with hadoop

Greetings, There's a way you can distribute files along with your MR job as part of a "payload", or you could save the file in the same spot on every machine of your cluster with some rsyncing, and hard-code loading it. This may be of some help: http://hadoop.apache.org/core/docs/r0.18.2/api/org/