Re: Automaton improvements

2011-07-25 Thread Kirby Bohling
https://issues.apache.org/jira/browse/NUTCH-1068 Issue created, patch attached. Once I hear back from the author about getting it included in the upstream library, I'll update the issue. I'm really not able to pursue directly, as I'm not much of a Nutch user at the moment. I've lurked on the li

Re: Automaton improvements

2011-07-25 Thread Dawid Weiss
It is actually Robert Muir and Mike McCandless doing the heavy lifting here, so modesty has nothing to do with it :) I just think it'll stay inside Lucene because it is often tweaked and tuned. Plus, there is the FSTBuilder and associated classes which provide yet another way to build and traverse

Re: Automaton improvements

2011-07-25 Thread Julien Nioche
Hi Dawid, This was a bit of wishful thinking indeed :-) With a bit of luck the improvements will be added to brics, but as you pointed out we can always use the lucene jar anyway. BTW you are too modest, you should have pointed to the video of your talk in Berlin http://vimeo.com/26517310 which i

Re: Automaton improvements

2011-07-25 Thread Dawid Weiss
I don't think this will make it into a separate library, Julien. It's a port of brics and done specifically so that it fits Lucene's internal needs. If anything, I would just make Nutch require Lucene as a dependency -- this would provide more stable updates. Dawid On Mon, Jul 25, 2011 at 10:35 A

Re: Automaton improvements

2011-07-25 Thread Julien Nioche
Hi Kirby, Thanks for sharing this. It is definitely relevant for Nutch and I am sure that there would be quite a few people interested in giving it a try. Let's hope that this patch gets into the original library or that the Lucene people ship it in a separate jar, in the meantime your patch would