[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-25 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735253#action_12735253 ] Uwe Schindler commented on LUCENE-1693: --- Committed revision: 797727

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734955#action_12734955 ] Michael Busch commented on LUCENE-1693: --- {quote} Token is no longer deprecated, but

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734959#action_12734959 ] Uwe Schindler commented on LUCENE-1693: --- And in 3.0 all my phantastic

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734963#action_12734963 ] Uwe Schindler commented on LUCENE-1693: --- bq. if you don't want to deal with multiple

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734982#action_12734982 ] Michael Busch commented on LUCENE-1693: --- {quote} So in general you can add an Token

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735114#action_12735114 ] Michael Busch commented on LUCENE-1693: --- Grant, are you still reviewing? I was going

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735119#action_12735119 ] Grant Ingersoll commented on LUCENE-1693: - Go ahead, I'm satisfied.

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735123#action_12735123 ] Michael Busch commented on LUCENE-1693: --- Cool thanks for reviewing. I'll commit

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735124#action_12735124 ] Robert Muir commented on LUCENE-1693: - {quote} I completely agree. We should

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735125#action_12735125 ] Grant Ingersoll commented on LUCENE-1693: - Actually, one thing I still don't get:

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735133#action_12735133 ] Michael Busch commented on LUCENE-1693: --- {quote} I don't think the WARNING:

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735134#action_12735134 ] Michael Busch commented on LUCENE-1693: --- {quote} What happens to the attributes that

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735210#action_12735210 ] Mark Miller commented on LUCENE-1693: - Not sure what issue it stems from, but Token

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735215#action_12735215 ] Michael Busch commented on LUCENE-1693: --- {quote} Not sure what issue it stems from,

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-23 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734867#action_12734867 ] Grant Ingersoll commented on LUCENE-1693: - Checking now.

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-23 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12734888#action_12734888 ] Grant Ingersoll commented on LUCENE-1693: - {quote}Token is no longer deprecated,

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733580#action_12733580 ] Michael McCandless commented on LUCENE-1693: OK I looked at the latest patch!

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733604#action_12733604 ] Grant Ingersoll commented on LUCENE-1693: - One of the things that works really

Re: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Mark Miller
bq. * Are we going to keep Token.java or not? (Current patch still has it deprecated). I need to know this as well - I have to make a new Token class for the Highlighter package if this one is deprecated. It would seem a convenience to keep it around. On Tue, Jul 21, 2009 at 8:51 AM, Grant

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733761#action_12733761 ] Uwe Schindler commented on LUCENE-1693: --- Mark Miller on java-dev: bq. * Are we

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733765#action_12733765 ] Uwe Schindler commented on LUCENE-1693: --- {quote} bq. * Are we going to keep

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-21 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733931#action_12733931 ] Michael Busch commented on LUCENE-1693: --- I think the points listed in the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733070#action_12733070 ] Uwe Schindler commented on LUCENE-1693: --- Michael: can you wait for comments and

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733081#action_12733081 ] Michael Busch commented on LUCENE-1693: --- Hi Uwe, I haven't reviewed the latest

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733083#action_12733083 ] Uwe Schindler commented on LUCENE-1693: --- OK! I forgot to mention: I replaced the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733091#action_12733091 ] Michael Busch commented on LUCENE-1693: --- I like the cache you added to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733095#action_12733095 ] Uwe Schindler commented on LUCENE-1693: --- Yes, good idea. I added it locally, works

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-19 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12733096#action_12733096 ] Michael Busch commented on LUCENE-1693: --- yep, did already and all tests pass!

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-18 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732869#action_12732869 ] Michael McCandless commented on LUCENE-1693: bq. Given the difficulty of using

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-18 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732878#action_12732878 ] Uwe Schindler commented on LUCENE-1693: --- In this case we should rename TeeSink to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732407#action_12732407 ] Michael Busch commented on LUCENE-1693: --- {quote} As CachingTokenFilter has no API to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732450#action_12732450 ] Uwe Schindler commented on LUCENE-1693: --- Patch looks good. Only one thing: If you

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732458#action_12732458 ] Michael Busch commented on LUCENE-1693: --- {quote} Or we do not call the method

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732478#action_12732478 ] Uwe Schindler commented on LUCENE-1693: --- bq. +1. Let's do that. OK, I change this

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732483#action_12732483 ] Mark Miller commented on LUCENE-1693: - bq. ...and Mike said all others are trivial

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732749#action_12732749 ] Michael Busch commented on LUCENE-1693: --- {quote} Michael, any idea? The

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732757#action_12732757 ] Yonik Seeley commented on LUCENE-1693: -- bq. I have personally never used the Tee/Sink

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732762#action_12732762 ] Uwe Schindler commented on LUCENE-1693: --- In my opinion, this test that I was not

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732767#action_12732767 ] Uwe Schindler commented on LUCENE-1693: --- So the simple case of an

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732769#action_12732769 ] Grant Ingersoll commented on LUCENE-1693: - bq. Who invented the whole Tee/Sink

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732772#action_12732772 ] Grant Ingersoll commented on LUCENE-1693: - It is not theoretical at all, even if

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732773#action_12732773 ] Michael Busch commented on LUCENE-1693: --- {quote} I have never heard of Tee/Sink

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732781#action_12732781 ] Uwe Schindler commented on LUCENE-1693: --- bq. Hey, stop insulting my awesome

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-16 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731893#action_12731893 ] Uwe Schindler commented on LUCENE-1693: --- Ok looks good. I think you will go to bed

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-16 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731896#action_12731896 ] Grant Ingersoll commented on LUCENE-1693: - Favor to ask, when this is ready to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-16 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731947#action_12731947 ] Uwe Schindler commented on LUCENE-1693: --- I forgot: I also implemented the final

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731315#action_12731315 ] Michael Busch commented on LUCENE-1693: --- {quote} There is one case, when it also

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731317#action_12731317 ] Michael Busch commented on LUCENE-1693: --- {quote} In my opinion, we should remove the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731330#action_12731330 ] Uwe Schindler commented on LUCENE-1693: --- bq. What we really should have is an

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731334#action_12731334 ] Michael Busch commented on LUCENE-1693: --- {quote} Have you seen my backwards

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731337#action_12731337 ] Uwe Schindler commented on LUCENE-1693: --- bq. But I'm not sure how realistic this

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-15 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731555#action_12731555 ] Uwe Schindler commented on LUCENE-1693: --- After the whole day thinking about a

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-14 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730993#action_12730993 ] Uwe Schindler commented on LUCENE-1693: --- I forgot: I also added the TestCompatibilty

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-14 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731289#action_12731289 ] Michael Busch commented on LUCENE-1693: --- So if people are using streams/filters that

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-13 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730306#action_12730306 ] Uwe Schindler commented on LUCENE-1693: --- Mike implemented a nice idea to solve the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-11 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730003#action_12730003 ] Mark Miller commented on LUCENE-1693: - Token is still deprecated in the latest patch -

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-10 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729565#action_12729565 ] Michael Busch commented on LUCENE-1693: --- Thanks for all your hard work here, Uwe. I

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-10 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729567#action_12729567 ] Uwe Schindler commented on LUCENE-1693: --- Thanks! Before going to bed yesterday, I

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-10 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729568#action_12729568 ] Michael Busch commented on LUCENE-1693: --- I agree that in any case we should

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729819#action_12729819 ] Michael McCandless commented on LUCENE-1693: I'm still trying to wrap my brain

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-10 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729823#action_12729823 ] Yonik Seeley commented on LUCENE-1693: -- bq. One concern is: TokenStream.initialize

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-08 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12728823#action_12728823 ] Mark Miller commented on LUCENE-1693: - Mr. Busch my friend, I'll buy both you and Uwe

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-08 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12728879#action_12728879 ] Michael Busch commented on LUCENE-1693: --- Alright, I hope you are coming to Oakland

Re: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-01 Thread Mark Miller
Hows the progress here guys? I have 2 or 3 issues that relate to this, and I really don't want to commit/finish them until this is done ...

RE: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-01 Thread Uwe Schindler
://www.thetaphi.de eMail: u...@thetaphi.de _ From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, July 01, 2009 3:14 PM To: java-dev@lucene.apache.org Subject: Re: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements Hows the progress here guys? I have 2 or 3

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-01 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12726066#action_12726066 ] Uwe Schindler commented on LUCENE-1693: --- After thinking one round about it again.

RE: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-01 Thread Uwe Schindler
.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de _ From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Wednesday, July 01, 2009 3:14 PM To: java-dev@lucene.apache.org Subject: Re: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

Re: [jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-07-01 Thread Mark Miller
I hope Michael will have time to review this, too. It seems that we are the only ones who can follow the thread J and all these “hey here is a BW break…” hick-hacks. Personally, I'm not a big fan of the new API. I think its going to be *much* harder for new users to grok/manipulate. These back

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723473#action_12723473 ] Uwe Schindler commented on LUCENE-1693: --- {quote} bq. The big difference is, that you

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723549#action_12723549 ] Uwe Schindler commented on LUCENE-1693: --- bq. But I'll definitely buy Uwe a beer if

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723720#action_12723720 ] Michael Busch commented on LUCENE-1693: --- Sorry, I don't want to be the bad guy here,

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723727#action_12723727 ] Uwe Schindler commented on LUCENE-1693: --- In your example, you mean SinkTokenizer is

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723749#action_12723749 ] Uwe Schindler commented on LUCENE-1693: --- bq. Not sure if we're talking about the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723751#action_12723751 ] Uwe Schindler commented on LUCENE-1693: --- One solution around this poblem would be to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-24 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723759#action_12723759 ] Michael Busch commented on LUCENE-1693: --- {quote} I decided a while ago that you'll

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723345#action_12723345 ] Mark Miller commented on LUCENE-1693: - How is this patch coming? Do you think

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-23 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723351#action_12723351 ] Uwe Schindler commented on LUCENE-1693: --- Michael did not yet respond (I think he is

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-23 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723353#action_12723353 ] Uwe Schindler commented on LUCENE-1693: --- By the way: Token is no longer deprecated,

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723362#action_12723362 ] Mark Miller commented on LUCENE-1693: - Ah, nice - I had to re-implement it for one or

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-23 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12723369#action_12723369 ] Mark Miller commented on LUCENE-1693: - bq. The big difference is, that you do not need

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-19 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721722#action_12721722 ] Michael Busch commented on LUCENE-1693: --- Sorry, Uwe, I was really busy today. I'll

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-19 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721795#action_12721795 ] Uwe Schindler commented on LUCENE-1693: --- During my tests I found a small problem

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-18 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721135#action_12721135 ] Michael Busch commented on LUCENE-1693: --- {quote} For backwards-compatiblility we

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-18 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721142#action_12721142 ] Uwe Schindler commented on LUCENE-1693: --- OK, we can merge our patches then! At the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-18 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721158#action_12721158 ] Uwe Schindler commented on LUCENE-1693: --- By the way, I tested Solr's token streams

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-18 Thread Grant Ingersoll (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721281#action_12721281 ] Grant Ingersoll commented on LUCENE-1693: - {quote} By the way, I tested Solr's

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-18 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12721426#action_12721426 ] Uwe Schindler commented on LUCENE-1693: --- I only tested performance with the lucene

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720524#action_12720524 ] Shai Erera commented on LUCENE-1693: Doesn't this mean that we need to change all our

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720529#action_12720529 ] Michael Busch commented on LUCENE-1693: --- I don't think we mention subclassing of

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720530#action_12720530 ] Michael Busch commented on LUCENE-1693: --- But I'll definitely buy Uwe a beer if he

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720534#action_12720534 ] Uwe Schindler commented on LUCENE-1693: --- Hi Michael, in principle your test is

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720538#action_12720538 ] Michael Busch commented on LUCENE-1693: --- OK, what about this sentence in Token.java:

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720550#action_12720550 ] Uwe Schindler commented on LUCENE-1693: --- OK, I have a solution: I write a wrapper

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720562#action_12720562 ] Michael Busch commented on LUCENE-1693: --- For caching: I guess you would have to

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720568#action_12720568 ] Uwe Schindler commented on LUCENE-1693: --- bq. I think you should try it out and see

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720571#action_12720571 ] Michael Busch commented on LUCENE-1693: --- {quote} I am working on that, I have a

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720676#action_12720676 ] Uwe Schindler commented on LUCENE-1693: --- Hi Michael, I did not do any performance

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Shai Erera (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720692#action_12720692 ] Shai Erera commented on LUCENE-1693: You can run tokenize.alg which invokes the

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Michael Busch (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720794#action_12720794 ] Michael Busch commented on LUCENE-1693: --- I'm looking at TokenStream.next():

[jira] Commented: (LUCENE-1693) AttributeSource/TokenStream API improvements

2009-06-17 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12720809#action_12720809 ] Uwe Schindler commented on LUCENE-1693: --- The code is almost identical to before, the

  1   2   >