Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3705 - Still Failing

2013-02-03 Thread Dawid Weiss
Very weird.

On Mon, Feb 4, 2013 at 12:46 AM, Mark Miller  wrote:
> It looks like this thing hung doing a security check….
>
> [junit4:junit4]   2>  21) Thread[id=499, 
> name=TEST-BasicDistributedZkTest.testDistribSearch-seed#[437C1ACFB7351B0A], 
> state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
> [junit4:junit4]   2>at 
> java.security.AccessController.getStackAccessControlContext(Native Method)
> [junit4:junit4]   2>at 
> java.security.AccessController.checkPermission(AccessController.java:534)
> [junit4:junit4]   2>at 
> java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
> [junit4:junit4]   2>at 
> java.util.concurrent.ThreadPoolExecutor.checkShutdownAccess(ThreadPoolExecutor.java:711)
> [junit4:junit4]   2>at 
> java.util.concurrent.ThreadPoolExecutor.shutdownNow(ThreadPoolExecutor.java:1387)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Jason Nacional (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Nacional updated LUCENE-4743:
---

Affects Version/s: (was: 3.6.2)
   3.6

> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Jason Nacional (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13570020#comment-13570020
 ] 

Jason Nacional commented on LUCENE-4743:


I also have a question about rewriting ComplexPhraseQuery. Do I really need to 
always open an IndexReader? I mean, in our system, searching and viewing the 
hit document is a separate page. So what I'm doing to highlight terms (since I 
used ComplexPhraseQuery and it needs to be "rewritten") is to open an 
IndexReader.

I hope you understand my concerns. And I apologize for so many questions.

Thanks.



> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4393) 'Execute Query' in the dashboard does not build the url correctly

2013-02-03 Thread David Smiley (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

David Smiley updated SOLR-4393:
---

Assignee: Stefan Matheis (steffkes)

> 'Execute Query' in the dashboard does not build the url correctly
> -
>
> Key: SOLR-4393
> URL: https://issues.apache.org/jira/browse/SOLR-4393
> Project: Solr
>  Issue Type: Bug
>  Components: web gui
>Affects Versions: 4.1
>Reporter: Anand
>Assignee: Stefan Matheis (steffkes)
>
> Recently upgraded to 4.1 and started seeing this issue since the upgrade. We 
> also went from single core to multiple core at the same time.
>  
> Steps to reproduce
> 1. Select a core from the dashboard.
> 2. Select 'Query'
> 3. Without changing anything, click 'Execture Query'.
> Expected: 10 hits (or less depending on data indexed) displayed on the screen.
> Observed: See response below.
> http://localhost:8080/solr/coreName/select?
> 
> 
> 0 name="QTime">0 numFound="0" start="0">
> 
> Issue:  "http://localhost:8080/solr/coreName/select?"; is incomplete and 
> "q=*:*" is not appended to the url.
> Tested on Firefox and Chrome and both suffer from this issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4349) Admin UI - Query Interface does not work in IE

2013-02-03 Thread David Smiley (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13570001#comment-13570001
 ] 

David Smiley commented on SOLR-4349:


For the record, the symptom is seen in Safari too :-( 
(I haven't tested the patch but someone on SOLR-4393 says that this patch fixes 
it). 

> Admin UI - Query Interface does not work in IE
> --
>
> Key: SOLR-4349
> URL: https://issues.apache.org/jira/browse/SOLR-4349
> Project: Solr
>  Issue Type: Bug
>  Components: web gui
>Affects Versions: 4.1
>Reporter: Stefan Matheis (steffkes)
>Assignee: Stefan Matheis (steffkes)
>  Labels: IE, IE10, InternetExplorer
> Fix For: 4.2, 5.0
>
> Attachments: IE10-Query-Interface.png, SOLR-4349.patch
>
>
> While fiddeling with SOLR-4345, i realized that the Query-Interface does not 
> really work in IE (at least IE10, i guess that's also valid for IE9 and maybe 
> others)
> The Interface itself (including the Form on the left side, including various 
> options) is there, but if you submit the Form, the result is always empty (as 
> in 0 Documents returned) because of the used url:
> bq. http://host:port/solr/collection1/select?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Jason Nacional (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569947#comment-13569947
 ] 

Jason Nacional commented on LUCENE-4743:


Just an addition, I also used ComplexPhraseQueryParser as a default parser.

> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4401) Move the stress test in SOLR-4196 into a junit test

2013-02-03 Thread Erick Erickson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erick Erickson updated SOLR-4401:
-

Fix Version/s: 5.0
   4.2
Affects Version/s: 5.0
   4.2

> Move the stress test in SOLR-4196 into a junit test
> ---
>
> Key: SOLR-4401
> URL: https://issues.apache.org/jira/browse/SOLR-4401
> Project: Solr
>  Issue Type: Test
>Affects Versions: 4.2, 5.0
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Minor
> Fix For: 4.2, 5.0
>
>
> As part of SOLR-4196, I created a stress test proces for rapidly opening and 
> closing cores. It'd probably be useful to make this into a junit test that 
> ran nightly (it needs some time in order to show anything, as in minutes). 
> Typical failures are 20 minutes into the run, but occasionally they're faster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-4401) Move the stress test in SOLR-4196 into a junit test

2013-02-03 Thread Erick Erickson (JIRA)
Erick Erickson created SOLR-4401:


 Summary: Move the stress test in SOLR-4196 into a junit test
 Key: SOLR-4401
 URL: https://issues.apache.org/jira/browse/SOLR-4401
 Project: Solr
  Issue Type: Test
Reporter: Erick Erickson
Assignee: Erick Erickson
Priority: Minor


As part of SOLR-4196, I created a stress test proces for rapidly opening and 
closing cores. It'd probably be useful to make this into a junit test that ran 
nightly (it needs some time in order to show anything, as in minutes). Typical 
failures are 20 minutes into the run, but occasionally they're faster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Jason Nacional (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569935#comment-13569935
 ] 

Jason Nacional commented on LUCENE-4743:


Thanks all for the quick response. I can provide you some sample queries:

Let's say we have the following line: Make Sure Our Emails Reach Your Inbox

the query is: "(Make Sur*) Inbox"~10

after searching, the hits are correct. but somehow "Make" is not being 
highlighted. Am I missing something here? here is my code.

{code:title=DocHighlighter.java|borderStyle=solid}
...
Query rewrite_result = phrase.rewrite(IndexReader.open(INDEX_DIR));
QueryScorer qs_phrases = new QueryScorer(rewrite_result);
qs_phrases.setExpandMultiTermQuery(true);
highlighter = new Highlighter(htmlFormatter, qs_phrases);
highlighter.setTextFragmenter(new NullFragmenter());
highlighter.setMaxDocCharsToAnalyze(Integer.MAX_VALUE);
//get the temp text
if(text == null){
text = highlighter.getBestFragment(analyzer, "", pText);
}else{
text_temp = highlighter.getBestFragment(analyzer, "", text);
text = text_temp;
}
...
{code}

I'll start to create a test case for more info.

> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Jason Nacional (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569935#comment-13569935
 ] 

Jason Nacional edited comment on LUCENE-4743 at 2/4/13 12:14 AM:
-

Thanks all for the quick response. I can provide you some sample query:

Let's say we have the following line: Make Sure Our Emails Reach Your Inbox

the query is: "(Make Sur*) Inbox"~10

after searching, the hits are correct. but somehow "Make" is not being 
highlighted. Am I missing something here? here is my code.

{code:title=DocHighlighter.java|borderStyle=solid}
...
Query rewrite_result = phrase.rewrite(IndexReader.open(INDEX_DIR));
QueryScorer qs_phrases = new QueryScorer(rewrite_result);
qs_phrases.setExpandMultiTermQuery(true);
highlighter = new Highlighter(htmlFormatter, qs_phrases);
highlighter.setTextFragmenter(new NullFragmenter());
highlighter.setMaxDocCharsToAnalyze(Integer.MAX_VALUE);
//get the temp text
if(text == null){
text = highlighter.getBestFragment(analyzer, "", pText);
}else{
text_temp = highlighter.getBestFragment(analyzer, "", text);
text = text_temp;
}
...
{code}

I'll start to create a test case for more info.

  was (Author: jason.nacional):
Thanks all for the quick response. I can provide you some sample queries:

Let's say we have the following line: Make Sure Our Emails Reach Your Inbox

the query is: "(Make Sur*) Inbox"~10

after searching, the hits are correct. but somehow "Make" is not being 
highlighted. Am I missing something here? here is my code.

{code:title=DocHighlighter.java|borderStyle=solid}
...
Query rewrite_result = phrase.rewrite(IndexReader.open(INDEX_DIR));
QueryScorer qs_phrases = new QueryScorer(rewrite_result);
qs_phrases.setExpandMultiTermQuery(true);
highlighter = new Highlighter(htmlFormatter, qs_phrases);
highlighter.setTextFragmenter(new NullFragmenter());
highlighter.setMaxDocCharsToAnalyze(Integer.MAX_VALUE);
//get the temp text
if(text == null){
text = highlighter.getBestFragment(analyzer, "", pText);
}else{
text_temp = highlighter.getBestFragment(analyzer, "", text);
text = text_temp;
}
...
{code}

I'll start to create a test case for more info.
  
> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4393) 'Execute Query' in the dashboard does not build the url correctly

2013-02-03 Thread Anand (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569931#comment-13569931
 ] 

Anand commented on SOLR-4393:
-

Applied the patch and verified that it now works on both Firefox and Chrome.

> 'Execute Query' in the dashboard does not build the url correctly
> -
>
> Key: SOLR-4393
> URL: https://issues.apache.org/jira/browse/SOLR-4393
> Project: Solr
>  Issue Type: Bug
>  Components: web gui
>Affects Versions: 4.1
>Reporter: Anand
>
> Recently upgraded to 4.1 and started seeing this issue since the upgrade. We 
> also went from single core to multiple core at the same time.
>  
> Steps to reproduce
> 1. Select a core from the dashboard.
> 2. Select 'Query'
> 3. Without changing anything, click 'Execture Query'.
> Expected: 10 hits (or less depending on data indexed) displayed on the screen.
> Observed: See response below.
> http://localhost:8080/solr/coreName/select?
> 
> 
> 0 name="QTime">0 numFound="0" start="0">
> 
> Issue:  "http://localhost:8080/solr/coreName/select?"; is incomplete and 
> "q=*:*" is not appended to the url.
> Tested on Firefox and Chrome and both suffer from this issue.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569924#comment-13569924
 ] 

Michael McCandless commented on LUCENE-4748:


bq. Whether DrillDown (and sideways) should have .search(), or .getCollector() 
(something I've been thinking about before looking at your 2nd patch) ... I 
think that .search() looks good. If needed, we can always add a getCollector() 
later.

I think we should somehow do a .getCollector().

For example, if you want to do grouping (using GroupingSearch) and faceting 
(using DrillSideways) ... you're kind of stuck because each of these classes 
does the "search" for you.

It's also a hassle having to make the N search methods (I still have a nocommit 
to add searchAfter...).

So a .getCollector would be nice so the app could use MultiCollector to run 
everything (maybe they need to do joins too!).

But the challenge is ... we'd also need .getQuery, because DrillSideways runs a 
different Query from what the user provided (and a different collector).  And 
then we'd need to expose the collector, and add methods to get the drill-down 
and drill-sideways results ...

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>  Components: modules/facet
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569919#comment-13569919
 ] 

Mark Miller commented on LUCENE-4743:
-

The std Highlighter can highlight span querys when in postion aware mode. It 
uses a memory index and decomposes the original query to find the matches.

> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4743) ComplexPhraseQuery highlight problem after rewriting using ComplexPhraseQuery.rewrite(IndexReader)

2013-02-03 Thread Ryan Lauck (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569903#comment-13569903
 ] 

Ryan Lauck commented on LUCENE-4743:


ComplexPhraseQuery rewrites complex proximity searches into SpanQuerys. 
FastVectorHighlighter currently just ignores SpanQuery, I'm not sure how 
Highlighter behaves. I use ComplexPhraseQuery in production so I'd be happy to 
help trace this issue if you can provide some sample queries or some test 
cases. 

> ComplexPhraseQuery highlight problem after rewriting using 
> ComplexPhraseQuery.rewrite(IndexReader)
> --
>
> Key: LUCENE-4743
> URL: https://issues.apache.org/jira/browse/LUCENE-4743
> Project: Lucene - Core
>  Issue Type: Bug
>  Components: core/search, modules/queryparser
>Affects Versions: 3.6.2
>Reporter: Jason Nacional
>  Labels: complexqueryparser, newbie, queryparser
>
> Just want to ask an assistance using ComplexPhraseQuery. I mean, when it 
> comes to highlighting the hits are not correct. I also started using 
> ComplexPhraseQueryParser to support complex proximity searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 178 - Still Failing!

2013-02-03 Thread Shawn Heisey

On 2/3/2013 2:01 PM, Uwe Schindler wrote:

Could this maybe related to number of open files? I have no idea how to
configure that on MacOS. If this is the case, we should really drill
down this test to not open so many file descriptors. Current setting:


I located this:

http://ghickman.co.uk/2012/02/25/osx-max-files-limit-neo4j.html

Thanks,
Shawn


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4642) TokenizerFactory should provide a create method with a given AttributeSource

2013-02-03 Thread Renaud Delbru (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569883#comment-13569883
 ] 

Renaud Delbru commented on LUCENE-4642:
---

Hi,

I have submitted a patch which integrates:
- the patch from Uwe
- the removal of the Tokenizer(AttributeSource) constructor
- the addition of a TokenizerFactory.create(AttributeFactory) method
- some of the changes from the previous patch from Steve (e.g., 
TokenizerFactory.create method throw UOE by default)

All test suites are passing.

> TokenizerFactory should provide a create method with a given AttributeSource
> 
>
> Key: LUCENE-4642
> URL: https://issues.apache.org/jira/browse/LUCENE-4642
> Project: Lucene - Core
>  Issue Type: Improvement
>  Components: modules/analysis
>Affects Versions: 4.1
>Reporter: Renaud Delbru
>Assignee: Steve Rowe
>  Labels: analysis, attribute, tokenizer
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4642.patch, LUCENE-4642.patch, LUCENE-4642.patch, 
> TrieTokenizerFactory.java.patch
>
>
> All tokenizer implementations have a constructor that takes a given 
> AttributeSource as parameter (LUCENE-1826). However, the TokenizerFactory 
> does not provide an API to create tokenizers with a given AttributeSource.
> Side note: There are still a lot of tokenizers that do not provide 
> constructors that take AttributeSource and AttributeFactory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-4642) TokenizerFactory should provide a create method with a given AttributeSource

2013-02-03 Thread Renaud Delbru (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-4642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Renaud Delbru updated LUCENE-4642:
--

Attachment: LUCENE-4642.patch

> TokenizerFactory should provide a create method with a given AttributeSource
> 
>
> Key: LUCENE-4642
> URL: https://issues.apache.org/jira/browse/LUCENE-4642
> Project: Lucene - Core
>  Issue Type: Improvement
>  Components: modules/analysis
>Affects Versions: 4.1
>Reporter: Renaud Delbru
>Assignee: Steve Rowe
>  Labels: analysis, attribute, tokenizer
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4642.patch, LUCENE-4642.patch, LUCENE-4642.patch, 
> TrieTokenizerFactory.java.patch
>
>
> All tokenizer implementations have a constructor that takes a given 
> AttributeSource as parameter (LUCENE-1826). However, the TokenizerFactory 
> does not provide an API to create tokenizers with a given AttributeSource.
> Side note: There are still a lot of tokenizers that do not provide 
> constructors that take AttributeSource and AttributeFactory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Shai Erera (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shai Erera updated LUCENE-4748:
---

Component/s: modules/facet

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>  Components: modules/facet
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Shai Erera (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569852#comment-13569852
 ] 

Shai Erera commented on LUCENE-4748:


bq. Now you instantiate DrillSideways, calls .addDrillDown one or more times, 
then call one of the search methods.

That's actually very cool!

bq. I think DrillDown ought to have a similar API

I agree! Today DrillDown API is kinda confusing (you even have a nocommit 
regarding that). E.g. how should one use DrillDown to construct and AND of ORs. 
Having DrillDown.add() will be a great simplification!

Whether DrillDown (and sideways) should have .search(), or .getCollector() 
(something I've been thinking about before looking at your 2nd patch) ... I 
think that .search() looks good. If needed, we can always add a getCollector() 
later.

I think it would be good if we can merge DrillDown and Sideways, though not 
sure how the API would look like at the moment. So maybe for now we keep them 
separated. I.e., Sideways requires heavy jdocs, explaining exactly what it 
does, and e.g. the multiple FacetArrays allocation, so if all that we get by 
merging is the joint .add() logic ... I'd rather keep them separated.

I plan to do a more thorough review tomorrow, but briefly scanning the new 
patch, this looks awesome!

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4193) A ZooKeeper RequestHandler that allows you to post config files to a collections linked config set or a specific config set.

2013-02-03 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569830#comment-13569830
 ] 

Mark Miller commented on SOLR-4193:
---

Hey Shawn, you can do this with the zkcli tool by the way - just change the 
config set link for the collection and reload.

Will make sure it's supported through an http api as well though.

> A ZooKeeper RequestHandler that allows you to post config files to a 
> collections linked config set or a specific config set.
> 
>
> Key: SOLR-4193
> URL: https://issues.apache.org/jira/browse/SOLR-4193
> Project: Solr
>  Issue Type: New Feature
>  Components: SolrCloud
>Reporter: Mark Miller
>Assignee: Mark Miller
>Priority: Minor
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4193.patch, SOLR-4193.patch
>
>
> Could have an admin zk handler and one per core?
> An admin zk handler would allow you to access it without specifying an 
> existing core if done right.
> One per core lets you do things like:
> post solrconfig.xml to localhost:8983:/solr/collection1/zkhandler
> Then we look up what config set we linked to and overwrite the solrconfig.xml.
> You can already GET config files through another handler, so at the moment 
> I'd avoid duplicating that.
> Could imagine adding commands over time though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4193) A ZooKeeper RequestHandler that allows you to post config files to a collections linked config set or a specific config set.

2013-02-03 Thread Shawn Heisey (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569820#comment-13569820
 ] 

Shawn Heisey commented on SOLR-4193:


I'd like the ability to tell a collection to use a different config set.  I 
brought this up on the mailing list, where Mark Miller directed me to this 
issue.  Consider this situation, which is essentially where I am right now:

I have a config set named 'mbbasecfg' which for the immediate future will be 
used by all collections that I add to my SolrCloud (4.1).  Each collection will 
get used by a SolrJ servlet, which serves content from one specific customer.  
The 'mb' prefix is something specific to our software.

Let's say customer X decides they want things to work very differently for 
their application, and they are willing to pay us development costs to make it 
happen.  Their requested changes will require a different Solr config and maybe 
a different schema.  Customer X already has a collection in SolrCloud.

What I'd like to be able to do is upload a new config set called mbcustxcfg, 
then ask SolrCloud to change the customerx collection to use that new config 
set.  If the changes don't require a reindex, we'd be done after reloading the 
collection.  If they do require a reindex, then we'll do that.

Currently we would have to delete their collection and build it again with a 
new config set.  If renaming a collection is possible (not sure whether it is), 
we could do that before making a new collection with the original name.  This 
is not the end of the world, of course.


> A ZooKeeper RequestHandler that allows you to post config files to a 
> collections linked config set or a specific config set.
> 
>
> Key: SOLR-4193
> URL: https://issues.apache.org/jira/browse/SOLR-4193
> Project: Solr
>  Issue Type: New Feature
>  Components: SolrCloud
>Reporter: Mark Miller
>Assignee: Mark Miller
>Priority: Minor
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4193.patch, SOLR-4193.patch
>
>
> Could have an admin zk handler and one per core?
> An admin zk handler would allow you to access it without specifying an 
> existing core if done right.
> One per core lets you do things like:
> post solrconfig.xml to localhost:8983:/solr/collection1/zkhandler
> Then we look up what config set we linked to and overwrite the solrconfig.xml.
> You can already GET config files through another handler, so at the moment 
> I'd avoid duplicating that.
> Could imagine adding commands over time though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4196) Untangle XML-specific nature of Config and Container classes

2013-02-03 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569811#comment-13569811
 ] 

Mark Miller commented on SOLR-4196:
---

bq. Hmmm, I have no idea why Eclipse didn't like the patch,

I mention it because previous patches applied no problem, so I wasn't sure if 
something was done differently. I almost never find a patch eclipse won't apply 
for me.

> Untangle XML-specific nature of Config and Container classes
> 
>
> Key: SOLR-4196
> URL: https://issues.apache.org/jira/browse/SOLR-4196
> Project: Solr
>  Issue Type: Improvement
>  Components: Schema and Analysis
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Minor
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, 
> SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, 
> SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, StressTest.zip, 
> StressTest.zip, StressTest.zip
>
>
> sub-task for SOLR-4083. If we're going to try to obsolete solr.xml, we need 
> to pull all of the specific XML processing out of Config and Container. 
> Currently, we refer to xpaths all over the place. This JIRA is about 
> providing a thunking layer to isolate the XML-esque nature of solr.xml and 
> allow a simple properties file to be used instead which will lead, 
> eventually, to solr.xml going away.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4400) Rapidly opening and closing cores can lead to deadlock

2013-02-03 Thread Mark Miller (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569810#comment-13569810
 ] 

Mark Miller commented on SOLR-4400:
---

Yup, the attached is the commit lock issue.

> Rapidly opening and closing cores can lead to deadlock
> --
>
> Key: SOLR-4400
> URL: https://issues.apache.org/jira/browse/SOLR-4400
> Project: Solr
>  Issue Type: Bug
>Affects Versions: 4.1
>Reporter: Erick Erickson
>Assignee: Erick Erickson
> Fix For: 4.2, 5.0
>
> Attachments: 4x_stack.txt
>
>
> See the discussion at SOLR-4196. Under ridiculous loads (i.e. every request 
> causes a core to close and another one to open) Solr can lock up. This is 
> _only_ a problem if you are using transient cores (see SOLR-1028) with a 
> limited cache size. Simply lazily loading cores that are NOT transient 
> shouldn't have this problem, you need to be closing cores to get here.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4400) Rapidly opening and closing cores can lead to deadlock

2013-02-03 Thread Erick Erickson (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Erick Erickson updated SOLR-4400:
-

Attachment: 4x_stack.txt

Attaching jstack output for a fresh (3-Feb) run against 4x, on a _very_ quick 
look it has the same issue, so I think we can be confident that the same fix 
needs to go in both places. Won't have time to look at this in detail until 
later today.

> Rapidly opening and closing cores can lead to deadlock
> --
>
> Key: SOLR-4400
> URL: https://issues.apache.org/jira/browse/SOLR-4400
> Project: Solr
>  Issue Type: Bug
>Affects Versions: 4.1
>Reporter: Erick Erickson
>Assignee: Erick Erickson
> Fix For: 4.2, 5.0
>
> Attachments: 4x_stack.txt
>
>
> See the discussion at SOLR-4196. Under ridiculous loads (i.e. every request 
> causes a core to close and another one to open) Solr can lock up. This is 
> _only_ a problem if you are using transient cores (see SOLR-1028) with a 
> limited cache size. Simply lazily loading cores that are NOT transient 
> shouldn't have this problem, you need to be closing cores to get here.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Michael McCandless (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael McCandless updated LUCENE-4748:
---

Attachment: LUCENE-4748.patch

New patch, addressing some nocommits.

Now you instantiate DrillSideways, calls .addDrillDown one or more times, then 
call one of the search methods.

I think DrillDown ought to have a similar API, so that you can build up some 
dims with OR and others without ... and maybe we should merge DrillDown and 
DrillSideways ...

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Stress test deadlocks

2013-02-03 Thread Mark Miller

On Feb 2, 2013, at 10:29 AM, Erick Erickson  wrote:

>  My stray thought was I wonder if it'd make sense to add this to some kind of 
> regular test process just for yucks

I really think this should be converted into a junit test - it's very useful 
and could be cranked up on nightly runs.

- Mark
-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569804#comment-13569804
 ] 

Michael McCandless commented on LUCENE-4748:


{quote}
Since drill-down followed by drill-sideways is a sort of (re)filtering over the 
original result set, perhaps the query result (say ScoredDocIds) could be 
passed through rather than re-evaluating the Query? 
IIRC the scores should not change during drill-down (and sideways as well), so 
without re-evaluating this could perhaps save some juice?
{quote}

Yes, this would work correctly: the drill-sideways counts for dim X will be the 
same as the drill-down counts for dim X on the query just before you drilled 
into dim X.  So we could save counting the sideways counts for dim X (but, 
other dimensions previously drilled-down will still need new counting).

We'd need to run a different query, basically moving dim X up to the top 
BooleanQuery as a MUST, and of course the app would have to save & return the 
previous queries drill-down counts for dim X (which is a hassle in a stateless 
server app)...

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-4400) Rapidly opening and closing cores can lead to deadlock

2013-02-03 Thread Mark Miller (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-4400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Miller updated SOLR-4400:
--

Fix Version/s: 5.0
   4.2
Affects Version/s: (was: 5.0)

> Rapidly opening and closing cores can lead to deadlock
> --
>
> Key: SOLR-4400
> URL: https://issues.apache.org/jira/browse/SOLR-4400
> Project: Solr
>  Issue Type: Bug
>Affects Versions: 4.1
>Reporter: Erick Erickson
>Assignee: Erick Erickson
> Fix For: 4.2, 5.0
>
>
> See the discussion at SOLR-4196. Under ridiculous loads (i.e. every request 
> causes a core to close and another one to open) Solr can lock up. This is 
> _only_ a problem if you are using transient cores (see SOLR-1028) with a 
> limited cache size. Simply lazily loading cores that are NOT transient 
> shouldn't have this problem, you need to be closing cores to get here.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-4196) Untangle XML-specific nature of Config and Container classes

2013-02-03 Thread Erick Erickson (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569790#comment-13569790
 ] 

Erick Erickson commented on SOLR-4196:
--

Hmmm, I have no idea why Eclipse didn't like the patch, I just generated it 
with svn diff. But it I'm guessing you have it applied anyway.

Sounds like we should raise a new JIRA about the deadlock issue, so I raised 
SOLR-4400 since it doesn't look like it's related to this particular patch... 
Certainly SOLR-1028 made the stress test possible so we're seeing it.

NOTE: I'm pretty sure this applies to 4x too, I'm running that test now, will 
record it in SOLR-4400

> Untangle XML-specific nature of Config and Container classes
> 
>
> Key: SOLR-4196
> URL: https://issues.apache.org/jira/browse/SOLR-4196
> Project: Solr
>  Issue Type: Improvement
>  Components: Schema and Analysis
>Reporter: Erick Erickson
>Assignee: Erick Erickson
>Priority: Minor
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, 
> SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, 
> SOLR-4196.patch, SOLR-4196.patch, SOLR-4196.patch, StressTest.zip, 
> StressTest.zip, StressTest.zip
>
>
> sub-task for SOLR-4083. If we're going to try to obsolete solr.xml, we need 
> to pull all of the specific XML processing out of Config and Container. 
> Currently, we refer to xpaths all over the place. This JIRA is about 
> providing a thunking layer to isolate the XML-esque nature of solr.xml and 
> allow a simple properties file to be used instead which will lead, 
> eventually, to solr.xml going away.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-4400) Rapidly opening and closing cores can lead to deadlock

2013-02-03 Thread Erick Erickson (JIRA)
Erick Erickson created SOLR-4400:


 Summary: Rapidly opening and closing cores can lead to deadlock
 Key: SOLR-4400
 URL: https://issues.apache.org/jira/browse/SOLR-4400
 Project: Solr
  Issue Type: Bug
Affects Versions: 4.1, 5.0
Reporter: Erick Erickson
Assignee: Erick Erickson


See the discussion at SOLR-4196. Under ridiculous loads (i.e. every request 
causes a core to close and another one to open) Solr can lock up. This is 
_only_ a problem if you are using transient cores (see SOLR-1028) with a 
limited cache size. Simply lazily loading cores that are NOT transient 
shouldn't have this problem, you need to be closing cores to get here.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Gilad Barkai (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569780#comment-13569780
 ] 

Gilad Barkai commented on LUCENE-4748:
--

Great idea!

Since drill-down followed by drill-sideways is a sort of (re)filtering over the 
original result set, perhaps the query result (say ScoredDocIds) could be 
passed through rather than re-evaluating the Query? 
IIRC the scores should not change during drill-down (and sideways as well), so 
without re-evaluating this could perhaps save some juice?

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-3967) Mapping error: langid.enforceSchema option checks source field instead of target field

2013-02-03 Thread Mateusz Matela (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569777#comment-13569777
 ] 

Mateusz Matela commented on SOLR-3967:
--

Yes, the fix looks good. Thanks!

> Mapping error: langid.enforceSchema option checks source field instead of 
> target field
> --
>
> Key: SOLR-3967
> URL: https://issues.apache.org/jira/browse/SOLR-3967
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - LangId
>Affects Versions: 4.0
>Reporter: Mateusz Matela
>Assignee: Jan Høydahl
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-3967.patch
>
>
> I use LangDetect update processor with a document that has "body" field. 
> LangDetect should map this field to "body_pl", "body_en" or "body_nolang". My 
> schema defines fields with language suffixes, but not "body" field. When the 
> processor runs, I get error:
> {quote}Unsuccessful field name mapping to body_nolang, field does not exist, 
> skipping mapping.{quote}
> I looked up source code and it seems there's an error in 
> {{org.apache.solr.update.processor.LanguageIdentifierUpdateProcessor.process(SolrInputDocument)}}:
> {noformat}
>   String mappedOutputField = getMappedField(fieldName, fieldLang);
>   if(enforceSchema && schema.getFieldOrNull(fieldName) == null) {
> log.warn("Unsuccessful field name mapping to {}, field does not 
> exist, skipping mapping.", mappedOutputField, fieldName);
> mappedOutputField = fieldName;
>   }
> {noformat}
> I think it should check for {{schema.getFieldOrNull(mappedOutputField)}} 
> instead.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Closed] (SOLR-3967) Mapping error: langid.enforceSchema option checks source field instead of target field

2013-02-03 Thread Mateusz Matela (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mateusz Matela closed SOLR-3967.



> Mapping error: langid.enforceSchema option checks source field instead of 
> target field
> --
>
> Key: SOLR-3967
> URL: https://issues.apache.org/jira/browse/SOLR-3967
> Project: Solr
>  Issue Type: Bug
>  Components: contrib - LangId
>Affects Versions: 4.0
>Reporter: Mateusz Matela
>Assignee: Jan Høydahl
> Fix For: 4.2, 5.0
>
> Attachments: SOLR-3967.patch
>
>
> I use LangDetect update processor with a document that has "body" field. 
> LangDetect should map this field to "body_pl", "body_en" or "body_nolang". My 
> schema defines fields with language suffixes, but not "body" field. When the 
> processor runs, I get error:
> {quote}Unsuccessful field name mapping to body_nolang, field does not exist, 
> skipping mapping.{quote}
> I looked up source code and it seems there's an error in 
> {{org.apache.solr.update.processor.LanguageIdentifierUpdateProcessor.process(SolrInputDocument)}}:
> {noformat}
>   String mappedOutputField = getMappedField(fieldName, fieldLang);
>   if(enforceSchema && schema.getFieldOrNull(fieldName) == null) {
> log.warn("Unsuccessful field name mapping to {}, field does not 
> exist, skipping mapping.", mappedOutputField, fieldName);
> mappedOutputField = fieldName;
>   }
> {noformat}
> I think it should check for {{schema.getFieldOrNull(mappedOutputField)}} 
> instead.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-4748) Add DrillSideways helper class to Lucene facets module

2013-02-03 Thread Michael McCandless (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael McCandless updated LUCENE-4748:
---

Attachment: LUCENE-4748.patch

New patch, just using IS.search instead of walking the leaves myself...

> Add DrillSideways helper class to Lucene facets module
> --
>
> Key: LUCENE-4748
> URL: https://issues.apache.org/jira/browse/LUCENE-4748
> Project: Lucene - Core
>  Issue Type: Improvement
>Reporter: Michael McCandless
>Assignee: Michael McCandless
> Fix For: 4.2, 5.0
>
> Attachments: LUCENE-4748.patch, LUCENE-4748.patch
>
>
> This came out of a discussion on the java-user list with subject
> "Faceted search in OR": http://markmail.org/thread/jmnq6z2x7ayzci5k
> The basic idea is to count "near misses" during collection, ie
> documents that matched the main query and also all except one of the
> drill down filters.
> Drill sideways makes for a very nice faceted search UI because you
> don't "lose" the facet counts after drilling in.  Eg maybe you do a
> search for "cameras", and you see facets for the manufacturer, so you
> drill into "Nikon".
> With drill sideways, even after drilling down, you'll still get the
> counts for all the other brands, where each count tells you how many
> hits you'd get if you changed to a different manufacturer.
> This becomes more fun if you add further drill-downs, eg maybe I next drill
> down into Resolution=10 megapixels", and then I can see how many 10
> megapixel cameras all other manufacturers, and what other resolutions
> Nikon cameras offer.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4747) java7 as a minimum requirement for lucene 5

2013-02-03 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569761#comment-13569761
 ] 

Michael McCandless commented on LUCENE-4747:


+1

> java7 as a minimum requirement for lucene 5
> ---
>
> Key: LUCENE-4747
> URL: https://issues.apache.org/jira/browse/LUCENE-4747
> Project: Lucene - Core
>  Issue Type: Task
>Affects Versions: 5.0
>Reporter: Robert Muir
> Fix For: 5.0
>
>
> Spinoff from LUCENE-4746. 
> I propose we make this change on trunk only. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-4747) java7 as a minimum requirement for lucene 5

2013-02-03 Thread Adrien Grand (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13569743#comment-13569743
 ] 

Adrien Grand commented on LUCENE-4747:
--

+1

> java7 as a minimum requirement for lucene 5
> ---
>
> Key: LUCENE-4747
> URL: https://issues.apache.org/jira/browse/LUCENE-4747
> Project: Lucene - Core
>  Issue Type: Task
>Affects Versions: 5.0
>Reporter: Robert Muir
> Fix For: 5.0
>
>
> Spinoff from LUCENE-4746. 
> I propose we make this change on trunk only. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org