[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-29 Thread Andrzej Bialecki (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095689#comment-17095689 ] Andrzej Bialecki commented on SOLR-14428: - Alan, seems you're on top of things here, feel free to

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-29 Thread Alan Woodward (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17095452#comment-17095452 ] Alan Woodward commented on SOLR-14428: -- I opened https://github.com/apache/lucene-solr/pull/1467 -

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-28 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094850#comment-17094850 ] Mike Drob commented on SOLR-14428: -- bq. I don't think we need to give queries the ability to produce

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-28 Thread Alan Woodward (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094411#comment-17094411 ] Alan Woodward commented on SOLR-14428: -- I think we can try building the automata in

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-28 Thread Adrien Grand (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094401#comment-17094401 ] Adrien Grand commented on SOLR-14428: - We currently store automata on the Query because it's more

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-28 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094309#comment-17094309 ] Colvin Cowie commented on SOLR-14428: - {quote}The QueryResultKey could cache by the original string

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-28 Thread Alan Woodward (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094304#comment-17094304 ] Alan Woodward commented on SOLR-14428: -- There's some prior art on this one:

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-27 Thread David Smiley (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093979#comment-17093979 ] David Smiley commented on SOLR-14428: - BTW This issue should probably be a Lucene JIRA issue but

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-27 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093864#comment-17093864 ] Mike Drob commented on SOLR-14428: -- That's a pretty good approach, I'm glad you thought of it! The

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-27 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093772#comment-17093772 ] Colvin Cowie commented on SOLR-14428: - That's fair. I think that having a distinction between the

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091912#comment-17091912 ] Mike Drob commented on SOLR-14428: -- I'm going to pause on the path with {{interface Minimizable}}

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091900#comment-17091900 ] Mike Drob commented on SOLR-14428: -- So another approach here would be to intercept the keys in

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091882#comment-17091882 ] Colvin Cowie commented on SOLR-14428: - I did the same thing with {{filters}} and that's ok... Now

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091869#comment-17091869 ] Colvin Cowie commented on SOLR-14428: - Oh yes, you're absolutely right > FuzzyQuery has severe

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091862#comment-17091862 ] Mike Drob commented on SOLR-14428: -- Good catch. I think we might also need to do a similar operation on

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091843#comment-17091843 ] Colvin Cowie commented on SOLR-14428: - Ah, the statistics plugin uses RamUsageQueryVisitor, which

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091838#comment-17091838 ] Colvin Cowie commented on SOLR-14428: - Thanks, I patched it in. The heap usage looks a lot closer to

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091754#comment-17091754 ] Mike Drob commented on SOLR-14428: -- I've created https://github.com/apache/lucene-solr/pull/1455 for

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-24 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091714#comment-17091714 ] Mike Drob commented on SOLR-14428: -- bq. Maybe there is an elegant way to store a stripped down

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090877#comment-17090877 ] Mike Drob commented on SOLR-14428: -- Adding some notes here as I've been diving through this... The

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Mike Drob (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090721#comment-17090721 ] Mike Drob commented on SOLR-14428: -- If there are no terms in the index, then the fuzzy query should be

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090609#comment-17090609 ] Colvin Cowie commented on SOLR-14428: - Thanks, we'll just stick on 8.3.1 for the time being. Though I

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Andrzej Bialecki (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090564#comment-17090564 ] Andrzej Bialecki commented on SOLR-14428: - [~cjcowie] as a temporary workaround you can switch to

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Alan Woodward (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090534#comment-17090534 ] Alan Woodward commented on SOLR-14428: -- Hi [~cjcowie], thanks for opening this and for the thorough

[jira] [Commented] (SOLR-14428) FuzzyQuery has severe memory usage in 8.5

2020-04-23 Thread Colvin Cowie (Jira)
[ https://issues.apache.org/jira/browse/SOLR-14428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090482#comment-17090482 ] Colvin Cowie commented on SOLR-14428: - Hi [~romseygeek], what are your thoughts on this? Thanks >