Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Mark Miller
Welcome!

- Mark

On Tue, Jul 21, 2015 at 10:39 AM Shawn Heisey apa...@elyograg.org wrote:

 On 7/21/2015 1:21 AM, Adrien Grand wrote:
  I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
  invitation to become a committer.

 Congratulations and welcome to the group!

 Thanks,
 Shawn


 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org

 --
- Mark
about.me/markrmiller


[jira] [Commented] (SOLR-7806) SolrCloud to use 127.0.01 instead of localhost

2015-07-21 Thread Uwe Schindler (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635221#comment-14635221
 ] 

Uwe Schindler commented on SOLR-7806:
-

-1 to this patch, because it makes use of Solr impossible on IPv6-only 
configurations. localhost is neutral (one could also argue to use ::1 
instead of 127.0.0.1).

 SolrCloud to use 127.0.01 instead of localhost
 --

 Key: SOLR-7806
 URL: https://issues.apache.org/jira/browse/SOLR-7806
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Affects Versions: 5.2.1
 Environment: Linux
 Mac OS X
Reporter: Arcadius Ahouansou
 Attachments: SOLR-7806.patch


 A colleague is having an issue very similar to the one described at
 http://muddyazian.blogspot.co.uk/2015/03/how-to-get-solr-500-quick-start.html
 He is running on the latest Arch Linux, and he gets that issue only when he 
 connects to the office network.
 We also have another case when this happens only when a colleague is 
 connected to the office network via VPN from his mac.
 I have looked around IMHO, the usage of 'localhost' in the solr code base may 
 be leading to this kind of issues where the resolved IP is not route-able.
 Does it make any sense to replace all usage of 'localhost' in the code base 
 by 127.0.01?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Michael McCandless
Welcome Mikhail!

Mike McCandless

http://blog.mikemccandless.com


On Tue, Jul 21, 2015 at 3:21 AM, Adrien Grand jpou...@gmail.com wrote:
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7806) SolrCloud to use 127.0.01 instead of localhost

2015-07-21 Thread Arcadius Ahouansou (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635201#comment-14635201
 ] 

Arcadius Ahouansou commented on SOLR-7806:
--

Please see attached patch [~markrmil...@gmail.com]

 SolrCloud to use 127.0.01 instead of localhost
 --

 Key: SOLR-7806
 URL: https://issues.apache.org/jira/browse/SOLR-7806
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Affects Versions: 5.2.1
 Environment: Linux
 Mac OS X
Reporter: Arcadius Ahouansou
 Attachments: SOLR-7806.patch


 A colleague is having an issue very similar to the one described at
 http://muddyazian.blogspot.co.uk/2015/03/how-to-get-solr-500-quick-start.html
 He is running on the latest Arch Linux, and he gets that issue only when he 
 connects to the office network.
 We also have another case when this happens only when a colleague is 
 connected to the office network via VPN from his mac.
 I have looked around IMHO, the usage of 'localhost' in the solr code base may 
 be leading to this kind of issues where the resolved IP is not route-able.
 Does it make any sense to replace all usage of 'localhost' in the code base 
 by 127.0.01?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_60-ea-b21) - Build # 13554 - Still Failing!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13554/
Java: 32bit/jdk1.8.0_60-ea-b21 -server -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
commitWithin did not work on node: http://127.0.0.1:51986/collection1 
expected:68 but was:67

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: 
http://127.0.0.1:51986/collection1 expected:68 but was:67
at 
__randomizedtesting.SeedInfo.seed([DE54AE50096BF924:5600918AA79794DC]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at 
org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:332)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 

[GitHub] lucene-solr pull request: SOLR-7816: timeAllowed parameter ignored...

2015-07-21 Thread cpoerschke
GitHub user cpoerschke opened a pull request:

https://github.com/apache/lucene-solr/pull/192

SOLR-7816: timeAllowed parameter ignored edge-case bug?

for https://issues.apache.org/jira/i#browse/SOLR-7816

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bloomberg/lucene-solr 
trunk-time-allowed-edge-case

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/lucene-solr/pull/192.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #192


commit 5147dd906f4fe7b054e525f36937bc1640e373de
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-21T15:42:21Z

[notes] SOLR-: timeAllowed parameter ignored edge-case bug?

'ant test -Dtestcase=ExitableDirectoryReaderTest 
-Dtests.method=testTimeAllowed' to see the notes




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: timeAllowed parameter ignored edge-case bug?

2015-07-21 Thread Christine Poerschke (BLOOMBERG/ LONDON)
https://issues.apache.org/jira/i#browse/SOLR-7816 raised to track this.

Yes, the issue only surfaces if queryResultsCache is configured and filterCache 
is not configured. I agree, this should not affect (m)any real users, just 
points towards opportunity to split/refactor somehow - i stumbled across this 
as part of SOLR-5730 when trying to see how/where the 
EarlyTerminatingSortingCollector should be added.

-Christine

- Original Message -
From: hossman_luc...@fucit.org
To: Christine Poerschke (BLOOMBERG/ LONDON), dev@lucene.apache.org
At: Jul 21 2015 00:32:23


: In the scenario outlined below, the second run's timeAllowed parameter 
: is unexpectedly ignored. Could this be intentionally so somehow (q vs. 
: fq processing?, Collector vs. LeafCollector?, DocList vs. DocSet?), or 
: is it an edge-case bug?

Based on your description (didn't re-review the code directly) it sounds 
like an oversight with timeAllowed -- probably overlooked because of the 
oddity of having a queryResultCache but not filterCache (correct me if i'm 
wrong, but it sounds like this bug won't surface if both queryResultsCache 
 filterCache are enabled -- or both disabled -- correct?) ... probably 
doesn't affect (m)any real users because of this.

Sounds like we should split out the build part of 
buildAndRunCollectorChain into it's own method and re-use it in 
getDocSet (although it seems like that will almost certainly require some 
API changes to propogate the QueryCommand context down)

Christine: can you file this as a Jira so we don't lose track of it?

: 
: Regards,
: 
: Christine
: 
: ---
: 
: solrconfig characteristics:
:  * a queryResultsCache is configured
:  * no filterCache is configured
: 
: query characteristics:
:  * q parameter present
:  * at least one fq parameter present
:  * sort parameter present (and does not require the score field)
:  * GET_DOCSET flag is set e.g. via the StatsComponent i.e. stats=true 
parameter
: 
: runtime characteristics:
:  * first run of the query gets a queryResultsCache-miss and respects 
timeAllowed
:  * second run gets a queryResultsCache-hit and ignores timeAllowed (but still
:makes use of the lucene IndexSearcher)
: 
: code path execution details (first run):
: * SolrIndexSearcher.search calls getDocListC
: * getDocListC called queryResultCache.get which found nothing
: * getDocListC calls getDocListAndSetNC
: * getDocListAndSetNC calls buildAndRunCollectorChain
: * buildAndRunCollectorChain constructs TimeLimitingCollector
: 
: code path execution details (second run):
: * SolrIndexSearcher.search calls getDocListC
: * getDocListC called queryResultCache.get which found something
: * getDocListC calls getDocSet(ListQuery queries)
: * getDocSet(ListQuery queries) iterates over IndexSearcher.leafContexts
: -
: To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
: For additional commands, e-mail: dev-h...@lucene.apache.org
: 
: 

-Hoss
http://www.lucidworks.com/


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7765) TokenizerChain without char filters cause NPE in luke request handler

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635385#comment-14635385
 ] 

ASF subversion and git services commented on SOLR-7765:
---

Commit 1692170 from hoss...@apache.org in branch 'dev/trunk'
[ https://svn.apache.org/r1692170 ]

SOLR-7765: Hardened the behavior of TokenizerChain when null arguments are used 
in constructor. This prevents NPEs in some code paths.

 TokenizerChain without char filters cause NPE in luke request handler
 -

 Key: SOLR-7765
 URL: https://issues.apache.org/jira/browse/SOLR-7765
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
Reporter: Konstantin Gribov
Assignee: Hoss Man
Priority: Minor
 Attachments: SOLR-7765.patch, SOLR-7765.patch, SOLR-7765.patch


 {{TokenizerChain}} created using 2-arg constructor has {{null}} in 
 {{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.
 Will create PR in a couple of minutes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7765) TokenizerChain without char filters cause NPE in luke request handler

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635438#comment-14635438
 ] 

ASF subversion and git services commented on SOLR-7765:
---

Commit 1692174 from hoss...@apache.org in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1692174 ]

SOLR-7765: Hardened the behavior of TokenizerChain when null arguments are used 
in constructor. This prevents NPEs in some code paths. (merge r1692170)

 TokenizerChain without char filters cause NPE in luke request handler
 -

 Key: SOLR-7765
 URL: https://issues.apache.org/jira/browse/SOLR-7765
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
Reporter: Konstantin Gribov
Assignee: Hoss Man
Priority: Minor
 Attachments: SOLR-7765.patch, SOLR-7765.patch, SOLR-7765.patch


 {{TokenizerChain}} created using 2-arg constructor has {{null}} in 
 {{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.
 Will create PR in a couple of minutes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7765) TokenizerChain methods may return null depending on how constructor is called -- causes NPE in luke request handler

2015-07-21 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man updated SOLR-7765:
---
Description: 
{{TokenizerChain}} created using 2-arg constructor has {{null}} in 
{{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.

{{TokenizerChain}} constructor's should be hardened to do explicit null checks, 
throwing early NPE where appropriate (tokenizer factory), or initializing 
internal arrays to have 0 length when optional (factories for char filters and 
token filters)

  was:
{{TokenizerChain}} created using 2-arg constructor has {{null}} in 
{{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.

Will create PR in a couple of minutes.

Summary: TokenizerChain methods may return null depending on how 
constructor is called -- causes NPE in luke request handler  (was: 
TokenizerChain without char filters cause NPE in luke request handler)

 TokenizerChain methods may return null depending on how constructor is called 
 -- causes NPE in luke request handler
 ---

 Key: SOLR-7765
 URL: https://issues.apache.org/jira/browse/SOLR-7765
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
Reporter: Konstantin Gribov
Assignee: Hoss Man
Priority: Minor
 Attachments: SOLR-7765.patch, SOLR-7765.patch, SOLR-7765.patch


 {{TokenizerChain}} created using 2-arg constructor has {{null}} in 
 {{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.
 {{TokenizerChain}} constructor's should be hardened to do explicit null 
 checks, throwing early NPE where appropriate (tokenizer factory), or 
 initializing internal arrays to have 0 length when optional (factories for 
 char filters and token filters)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Mike Drob
Congratulations!

On Tue, Jul 21, 2015 at 12:31 PM, Joel Bernstein joels...@gmail.com wrote:

 Congratulations Mikhail!

 Joel Bernstein
 http://joelsolr.blogspot.com/

 On Tue, Jul 21, 2015 at 12:39 PM, Michael McCandless 
 luc...@mikemccandless.com wrote:

 Welcome Mikhail!

 Mike McCandless

 http://blog.mikemccandless.com


 On Tue, Jul 21, 2015 at 3:21 AM, Adrien Grand jpou...@gmail.com wrote:
  I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
  invitation to become a committer.
 
  Mikhail, it's tradition that you introduce yourself with a brief bio.
 
  Your handle mkhl has already added to the “lucene LDAP group, so
  you now have commit privileges. Please test this by adding yourself to
  the committers section of the Who We Are page on the website:
  http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
  at the bottom of the page here: https://cms.apache.org/#bookmark -
  more info here http://www.apache.org/dev/cms.html).
 
  Congratulations and welcome!
 
  --
  Adrien
 
  -
  To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
  For additional commands, e-mail: dev-h...@lucene.apache.org
 

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org





[jira] [Commented] (SOLR-7816) timeAllowed parameter ignored edge-case bug (queryResultsCache=yes,filterCache=no)

2015-07-21 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635488#comment-14635488
 ] 

ASF GitHub Bot commented on SOLR-7816:
--

GitHub user cpoerschke opened a pull request:

https://github.com/apache/lucene-solr/pull/192

SOLR-7816: timeAllowed parameter ignored edge-case bug?

for https://issues.apache.org/jira/i#browse/SOLR-7816

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bloomberg/lucene-solr 
trunk-time-allowed-edge-case

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/lucene-solr/pull/192.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #192


commit 5147dd906f4fe7b054e525f36937bc1640e373de
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-21T15:42:21Z

[notes] SOLR-: timeAllowed parameter ignored edge-case bug?

'ant test -Dtestcase=ExitableDirectoryReaderTest 
-Dtests.method=testTimeAllowed' to see the notes




 timeAllowed parameter ignored edge-case bug 
 (queryResultsCache=yes,filterCache=no)
 --

 Key: SOLR-7816
 URL: https://issues.apache.org/jira/browse/SOLR-7816
 Project: Solr
  Issue Type: Bug
Reporter: Christine Poerschke
Priority: Minor

 dev mailing list reference: http://markmail.org/message/3ttwppsbtia4e56t
 ---
 solrconfig characteristics:
  * a queryResultsCache is configured
  * no filterCache is configured
 query characteristics:
  * q parameter present
  * at least one fq parameter present
  * sort parameter present (and does not require the score field)
  * GET_DOCSET flag is set e.g. via the StatsComponent i.e. stats=true 
 parameter
 ---
 github pull request with notes/reproduce debug trace to follow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7816) timeAllowed parameter ignored edge-case bug (queryResultsCache=yes,filterCache=no)

2015-07-21 Thread Christine Poerschke (JIRA)
Christine Poerschke created SOLR-7816:
-

 Summary: timeAllowed parameter ignored edge-case bug 
(queryResultsCache=yes,filterCache=no)
 Key: SOLR-7816
 URL: https://issues.apache.org/jira/browse/SOLR-7816
 Project: Solr
  Issue Type: Bug
Reporter: Christine Poerschke
Priority: Minor


dev mailing list reference: http://markmail.org/message/3ttwppsbtia4e56t
---
solrconfig characteristics:
 * a queryResultsCache is configured
 * no filterCache is configured

query characteristics:
 * q parameter present
 * at least one fq parameter present
 * sort parameter present (and does not require the score field)
 * GET_DOCSET flag is set e.g. via the StatsComponent i.e. stats=true parameter

---
github pull request with notes/reproduce debug trace to follow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Parsing and indexing parts of the input file paths

2015-07-21 Thread Erik Hatcher
If this is only for search, then an analysis chain could be crafted, likely 
with the pattern regex filter in the mix, to pull out pieces of the path.  How 
will you know the prefix of the file though? 

There’s also the ability to do this sort of thing in an update processor, most 
easily using the script update processor, using a bit of JavaScript to pull out 
the piece(s) you want to index (and even store at this point).

—
Erik Hatcher, Senior Solutions Architect
http://www.lucidworks.com http://www.lucidworks.com/




 On Jul 21, 2015, at 1:31 PM, Andrew Musselman andrew.mussel...@gmail.com 
 wrote:
 
 Dear user and dev lists,
 
 We are loading files from a directory and would like to index a portion of 
 each file path as a field as well as the text inside the file.
 
 E.g., on HDFS we have this file path:
 
 /user/andrew/1234/1234/file.pdf
 
 And we would like the 1234 token parsed from the file path and indexed as 
 an additional field that can be searched on.
 
 From my initial searches I can't see how to do this easily, so would I need 
 to write some custom code, or a plugin?
 
 Thanks!



Parsing and indexing parts of the input file paths

2015-07-21 Thread Andrew Musselman
Dear user and dev lists,

We are loading files from a directory and would like to index a portion of
each file path as a field as well as the text inside the file.

E.g., on HDFS we have this file path:

/user/andrew/1234/1234/file.pdf

And we would like the 1234 token parsed from the file path and indexed as
an additional field that can be searched on.

From my initial searches I can't see how to do this easily, so would I need
to write some custom code, or a plugin?

Thanks!


Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Joel Bernstein
Congratulations Mikhail!

Joel Bernstein
http://joelsolr.blogspot.com/

On Tue, Jul 21, 2015 at 12:39 PM, Michael McCandless 
luc...@mikemccandless.com wrote:

 Welcome Mikhail!

 Mike McCandless

 http://blog.mikemccandless.com


 On Tue, Jul 21, 2015 at 3:21 AM, Adrien Grand jpou...@gmail.com wrote:
  I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
  invitation to become a committer.
 
  Mikhail, it's tradition that you introduce yourself with a brief bio.
 
  Your handle mkhl has already added to the “lucene LDAP group, so
  you now have commit privileges. Please test this by adding yourself to
  the committers section of the Who We Are page on the website:
  http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
  at the bottom of the page here: https://cms.apache.org/#bookmark -
  more info here http://www.apache.org/dev/cms.html).
 
  Congratulations and welcome!
 
  --
  Adrien
 
  -
  To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
  For additional commands, e-mail: dev-h...@lucene.apache.org
 

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




[jira] [Resolved] (SOLR-7765) TokenizerChain methods may return null depending on how constructor is called -- causes NPE in luke request handler

2015-07-21 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man resolved SOLR-7765.

   Resolution: Fixed
Fix Version/s: Trunk
   5.3

Thanks for rasiing this issue and helping out with the tests Konstantin,

bq. Is there any reason to use reversed order in ifs...

It's just a defensive coding habbit i developed from doing a lot of C and perl 
coding in my early years as a developer ... trained my brain to default to 
putting constants on the left in comparisons in cause i misstype = instead of 
== or = 

 TokenizerChain methods may return null depending on how constructor is called 
 -- causes NPE in luke request handler
 ---

 Key: SOLR-7765
 URL: https://issues.apache.org/jira/browse/SOLR-7765
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
Reporter: Konstantin Gribov
Assignee: Hoss Man
Priority: Minor
 Fix For: 5.3, Trunk

 Attachments: SOLR-7765.patch, SOLR-7765.patch, SOLR-7765.patch


 {{TokenizerChain}} created using 2-arg constructor has {{null}} in 
 {{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.
 {{TokenizerChain}} constructor's should be hardened to do explicit null 
 checks, throwing early NPE where appropriate (tokenizer factory), or 
 initializing internal arrays to have 0 length when optional (factories for 
 char filters and token filters)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7816) timeAllowed parameter ignored edge-case bug (queryResultsCache=yes,filterCache=no)

2015-07-21 Thread Christine Poerschke (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635491#comment-14635491
 ] 

Christine Poerschke commented on SOLR-7816:
---

debug trace extract:
{code}
SolrIndexSearcher.constructor pretendMode=1
SolrIndexSearcher.constructor pretend that no filterCache is configured
SolrIndexSearcher.search(QueryResult qr, QueryCommand cmd) called
SolrIndexSearcher.getDocListC(QueryResult qr, QueryCommand cmd) called
SolrIndexSearcher.getDocListAndSetNC(QueryResult qr, QueryCommand cmd) called
SolrIndexSearcher.getProcessedFilter(DocSet setFilter, ListQuery queries) 
called
SolrIndexSearcher.getProcessedFilter - there is no cache: don't pull bitsets
SolrIndexSearcher.buildAndRunCollectorChain(...) called
TimeLimitingCollector.constructor(...ticksAllowed=10001) called
SolrIndexSearcher.buildAndRunCollectorChain(...) call IndexSearcher.search
# should have seen TimeLimitingCollector.constructor and IndexSearcher.search 
calls

SolrIndexSearcher.search(QueryResult qr, QueryCommand cmd) called
SolrIndexSearcher.getDocListC(QueryResult qr, QueryCommand cmd) called
SolrIndexSearcher.getDocSet(ListQuery queries) called
SolrIndexSearcher.getProcessedFilter(DocSet setFilter, ListQuery queries) 
called
SolrIndexSearcher.getProcessedFilter - there is no cache: don't pull bitsets
SolrIndexSearcher.getProcessedFilter - there is no cache: don't pull bitsets
SolrIndexSearcher.getDocSet(ListQuery queries) iterate over 
IndexSearcher.leafContexts 
([LeafReaderContext(FilterLeafReader(Uninverting(_0(6.0.0):c297)) docBase=0 
ord=0)])
# if IndexSearcher.leafContexts were iterated over then should have seen 
TimeLimitingCollector.constructor use also
{code}

 timeAllowed parameter ignored edge-case bug 
 (queryResultsCache=yes,filterCache=no)
 --

 Key: SOLR-7816
 URL: https://issues.apache.org/jira/browse/SOLR-7816
 Project: Solr
  Issue Type: Bug
Reporter: Christine Poerschke
Priority: Minor

 dev mailing list reference: http://markmail.org/message/3ttwppsbtia4e56t
 ---
 solrconfig characteristics:
  * a queryResultsCache is configured
  * no filterCache is configured
 query characteristics:
  * q parameter present
  * at least one fq parameter present
  * sort parameter present (and does not require the score field)
  * GET_DOCSET flag is set e.g. via the StatsComponent i.e. stats=true 
 parameter
 ---
 github pull request with notes/reproduce debug trace to follow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7742) Support for Immutable ConfigSets

2015-07-21 Thread Gregory Chanan (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gregory Chanan updated SOLR-7742:
-
Attachment: SOLR-7742log.patch

Here's a patch to improve the logging:

- Makes it more obvious it's not an error, i.e. says assuming default 
properties
- Only prints the exception message, not the stacktrace

 Support for Immutable ConfigSets
 

 Key: SOLR-7742
 URL: https://issues.apache.org/jira/browse/SOLR-7742
 Project: Solr
  Issue Type: New Feature
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Fix For: 5.3, Trunk

 Attachments: SOLR-7742, SOLR-7742.patch, SOLR-7742log.patch


 See the discussion in SOLR-5955; to properly support collection templates 
 that can be specified as the starting point for a collection configuration, 
 we need support for ConfigSets that are immutable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_45) - Build # 5052 - Still Failing!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5052/
Java: 64bit/jdk1.8.0_45 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.lucene.store.TestSimpleFSLockFactory.testStressLocks

Error Message:
Captured an uncaught exception in thread: Thread[id=712, name=Thread-500, 
state=RUNNABLE, group=TGRP-TestSimpleFSLockFactory]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=712, name=Thread-500, state=RUNNABLE, 
group=TGRP-TestSimpleFSLockFactory]
at 
__randomizedtesting.SeedInfo.seed([D84E895A7ED9E6D6:867FC7A762752EB0]:0)
Caused by: java.lang.AssertionError: hit unexpected NoSuchFileException: 
file=_m.cfs
at __randomizedtesting.SeedInfo.seed([D84E895A7ED9E6D6]:0)
at 
org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:750)
at 
org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:528)
at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:636)
at 
org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3020)
at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2970)
at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1066)
at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1109)
at 
org.apache.lucene.store.BaseLockFactoryTestCase$WriterThread.run(BaseLockFactoryTestCase.java:221)




Build Log:
[...truncated 1022 lines...]
   [junit4] Suite: org.apache.lucene.store.TestSimpleFSLockFactory
   [junit4]   2 de jul. 21, 2015 9:12:46 PM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2 WARNING: Uncaught exception in thread: 
Thread[Thread-500,5,TGRP-TestSimpleFSLockFactory]
   [junit4]   2 java.lang.AssertionError: hit unexpected NoSuchFileException: 
file=_m.cfs
   [junit4]   2at 
__randomizedtesting.SeedInfo.seed([D84E895A7ED9E6D6]:0)
   [junit4]   2at 
org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:750)
   [junit4]   2at 
org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:528)
   [junit4]   2at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:636)
   [junit4]   2at 
org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3020)
   [junit4]   2at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2970)
   [junit4]   2at 
org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1066)
   [junit4]   2at 
org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1109)
   [junit4]   2at 
org.apache.lucene.store.BaseLockFactoryTestCase$WriterThread.run(BaseLockFactoryTestCase.java:221)
   [junit4]   2 
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestSimpleFSLockFactory -Dtests.method=testStressLocks 
-Dtests.seed=D84E895A7ED9E6D6 -Dtests.slow=true -Dtests.locale=ca_ES 
-Dtests.timezone=America/Indiana/Knox -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   2.96s J1 | TestSimpleFSLockFactory.testStressLocks 
   [junit4] Throwable #1: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=712, name=Thread-500, state=RUNNABLE, 
group=TGRP-TestSimpleFSLockFactory]
   [junit4]at 
__randomizedtesting.SeedInfo.seed([D84E895A7ED9E6D6:867FC7A762752EB0]:0)
   [junit4] Caused by: java.lang.AssertionError: hit unexpected 
NoSuchFileException: file=_m.cfs
   [junit4]at 
__randomizedtesting.SeedInfo.seed([D84E895A7ED9E6D6]:0)
   [junit4]at 
org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:750)
   [junit4]at 
org.apache.lucene.index.IndexFileDeleter.deletePendingFiles(IndexFileDeleter.java:528)
   [junit4]at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:636)
   [junit4]at 
org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:3020)
   [junit4]at 
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2970)
   [junit4]at 
org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1066)
   [junit4]at 
org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1109)
   [junit4]at 
org.apache.lucene.store.BaseLockFactoryTestCase$WriterThread.run(BaseLockFactoryTestCase.java:221)
   [junit4]   2 NOTE: test params are: codec=Asserting(Lucene53): 
{content=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, 
sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {content=DFR GL1}, 
locale=ca_ES, timezone=America/Indiana/Knox
   [junit4]   2 NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0_45 
(64-bit)/cpus=3,threads=1,free=304611952,total=331350016
   [junit4]   

[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.7.0_80) - Build # 13373 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13373/
Java: 64bit/jdk1.7.0_80 -XX:-UseCompressedOops -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 62386 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:536: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:443: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:105: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:122: 
java.lang.OutOfMemoryError: PermGen space
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at 
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at groovy.lang.GroovyClassLoader.loadClass(GroovyClassLoader.java:677)
at groovy.lang.GroovyClassLoader.loadClass(GroovyClassLoader.java:787)
at groovy.lang.GroovyClassLoader.loadClass(GroovyClassLoader.java:775)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2625)
at java.lang.Class.getDeclaredMethods(Class.java:1868)
at 
org.codehaus.groovy.reflection.stdclasses.CachedSAMClass$1.run(CachedSAMClass.java:104)
at 
org.codehaus.groovy.reflection.stdclasses.CachedSAMClass$1.run(CachedSAMClass.java:102)
at java.security.AccessController.doPrivileged(Native Method)
at 
org.codehaus.groovy.reflection.stdclasses.CachedSAMClass.getDeclaredMethods(CachedSAMClass.java:102)
at 
org.codehaus.groovy.reflection.stdclasses.CachedSAMClass.getAbstractMethods(CachedSAMClass.java:120)
at 
org.codehaus.groovy.reflection.stdclasses.CachedSAMClass.getSAMMethod(CachedSAMClass.java:186)
at org.codehaus.groovy.reflection.ClassInfo.isSAM(ClassInfo.java:359)
at 
org.codehaus.groovy.reflection.ClassInfo.createCachedClass(ClassInfo.java:349)
at 
org.codehaus.groovy.reflection.ClassInfo.access$700(ClassInfo.java:41)
at 
org.codehaus.groovy.reflection.ClassInfo$LazyCachedClassRef.initValue(ClassInfo.java:497)
at 
org.codehaus.groovy.reflection.ClassInfo$LazyCachedClassRef.initValue(ClassInfo.java:488)
at 
org.codehaus.groovy.util.LazyReference.getLocked(LazyReference.java:49)
at org.codehaus.groovy.util.LazyReference.get(LazyReference.java:36)
at 
org.codehaus.groovy.reflection.ClassInfo.getCachedClass(ClassInfo.java:111)
at 
org.codehaus.groovy.reflection.ReflectionCache.getCachedClass(ReflectionCache.java:110)
at 
org.codehaus.groovy.reflection.ParameterTypes.getParametersTypes0(ParameterTypes.java:81)

Total time: 61 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[jira] [Commented] (SOLR-7742) Support for Immutable ConfigSets

2015-07-21 Thread Gregory Chanan (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636061#comment-14636061
 ] 

Gregory Chanan commented on SOLR-7742:
--

ok, that isn't indicative of an error, it's just logged at info level giving 
info about where it looked for the properties (it's not an error to not find 
the properties).  I agree it's not ideal because people tend to assume 
something is serious when they see a stacktrace.

 Support for Immutable ConfigSets
 

 Key: SOLR-7742
 URL: https://issues.apache.org/jira/browse/SOLR-7742
 Project: Solr
  Issue Type: New Feature
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Fix For: 5.3, Trunk

 Attachments: SOLR-7742, SOLR-7742.patch


 See the discussion in SOLR-5955; to properly support collection templates 
 that can be specified as the starting point for a collection configuration, 
 we need support for ConfigSets that are immutable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7441) Improve overall robustness of the Streaming stack: Streaming API, Streaming Expressions, Parallel SQL

2015-07-21 Thread Gus Heck (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636176#comment-14636176
 ] 

Gus Heck commented on SOLR-7441:


[~joel.bernstein] thx for reviewing this in and carrying it forward. I got 
behind on my list mail and didn't see your comments. Sorry!

 Improve overall robustness of the Streaming stack: Streaming API, Streaming 
 Expressions, Parallel SQL
 -

 Key: SOLR-7441
 URL: https://issues.apache.org/jira/browse/SOLR-7441
 Project: Solr
  Issue Type: Improvement
Affects Versions: 5.1
Reporter: Erick Erickson
Assignee: Joel Bernstein
Priority: Minor
 Attachments: SOLR-7441.patch, SOLR-7441.patch, SOLR-7441.patch, 
 SOLR-7441.patch


 It's harder than it could be to figure out what the error is when using 
 Streaming Aggregation. For instance if you specify an fl parameter for a 
 field that doesn't exist it's hard to figure out that's the cause. This is 
 true even if you look in the Solr logs.
 I'm not quite sure whether it'd be possible to report this at the client 
 level or not, but it seems at least we could repor something more helpful in 
 the Solr logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7441) Improve overall robustness of the Streaming stack: Streaming API, Streaming Expressions, Parallel SQL

2015-07-21 Thread Gus Heck (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14636178#comment-14636178
 ] 

Gus Heck commented on SOLR-7441:


Also, if you or anyone reading this has the karma, please disable the 
gus.h...@olin.edu account. Mail to it (and thus the inline references you used 
here) don't actually reach me. I haven't worked there since 2004, and there is 
no way for me to regain control of that account using that address.

 Improve overall robustness of the Streaming stack: Streaming API, Streaming 
 Expressions, Parallel SQL
 -

 Key: SOLR-7441
 URL: https://issues.apache.org/jira/browse/SOLR-7441
 Project: Solr
  Issue Type: Improvement
Affects Versions: 5.1
Reporter: Erick Erickson
Assignee: Joel Bernstein
Priority: Minor
 Attachments: SOLR-7441.patch, SOLR-7441.patch, SOLR-7441.patch, 
 SOLR-7441.patch


 It's harder than it could be to figure out what the error is when using 
 Streaming Aggregation. For instance if you specify an fl parameter for a 
 field that doesn't exist it's hard to figure out that's the cause. This is 
 true even if you look in the Solr logs.
 I'm not quite sure whether it'd be possible to report this at the client 
 level or not, but it seems at least we could repor something more helpful in 
 the Solr logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2534 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2534/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([FA6717C1ABDFB670:F20762EDA4D19E7B]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:384)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_45) - Build # 13552 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13552/
Java: 64bit/jdk1.8.0_45 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard2

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard2
at 
__randomizedtesting.SeedInfo.seed([1EF978C134121804:16990DED3B1C300F]:0)
at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:732)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:362)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[jira] [Commented] (SOLR-7742) Support for Immutable ConfigSets

2015-07-21 Thread Noble Paul (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635708#comment-14635708
 ] 

Noble Paul commented on SOLR-7742:
--

Yes I see this error often

 Support for Immutable ConfigSets
 

 Key: SOLR-7742
 URL: https://issues.apache.org/jira/browse/SOLR-7742
 Project: Solr
  Issue Type: New Feature
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Fix For: 5.3, Trunk

 Attachments: SOLR-7742, SOLR-7742.patch


 See the discussion in SOLR-5955; to properly support collection templates 
 that can be specified as the starting point for a collection configuration, 
 we need support for ConfigSets that are immutable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7742) Support for Immutable ConfigSets

2015-07-21 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635703#comment-14635703
 ] 

Anshum Gupta commented on SOLR-7742:


Hi Greg, I've been seeing a lot of Exceptions like the one below after this 
commit
{code}
org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 
'configsetprops.json' in classpath or '/configs/conf1', 
cwd=/Users/anshumgupta/workspace/lucene-trunk/solr/build/solr-core/test/J0
   [junit4]   2at 
org.apache.solr.cloud.ZkSolrResourceLoader.openResource(ZkSolrResourceLoader.java:99)
   [junit4]   2at 
org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2at 
org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2at 
org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2at 
org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2at 
org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2at 
org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2at 
java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2at java.lang.Thread.run(Thread.java:745)
{code}

P.S: I've noticed this while running the tests generally.

 Support for Immutable ConfigSets
 

 Key: SOLR-7742
 URL: https://issues.apache.org/jira/browse/SOLR-7742
 Project: Solr
  Issue Type: New Feature
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Fix For: 5.3, Trunk

 Attachments: SOLR-7742, SOLR-7742.patch


 See the discussion in SOLR-5955; to properly support collection templates 
 that can be specified as the starting point for a collection configuration, 
 we need support for ConfigSets that are immutable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7817) Move solr.test.sys.prop(1|2) out of the generic solrconfig.xml that's used by most tests

2015-07-21 Thread Anshum Gupta (JIRA)
Anshum Gupta created SOLR-7817:
--

 Summary: Move solr.test.sys.prop(1|2) out of the generic 
solrconfig.xml that's used by most tests
 Key: SOLR-7817
 URL: https://issues.apache.org/jira/browse/SOLR-7817
 Project: Solr
  Issue Type: Test
Reporter: Anshum Gupta
Priority: Minor


We have solr.test.sys.prop1 and solr.test.sys.prop2 system properties in the 
widely used solrconfig.xml and it would make sense to move these to a different 
solrconfig which can be used by the tests that need this.

Setting this system property in the test base class isn't good, specially as 
writing a new test that doesn't extend on the existing test base classes 
requires the knowledge of setting these if you want to use the widely used 
solrconfig.xml.

Here's another conversation about the same from 2007:
http://mail-archives.apache.org/mod_mbox/lucene-solr-dev/200703.mbox/%3cc68e39170703291430w5a57f603p7f0b7412d7cbb...@mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5379) Query-time multi-word synonym expansion

2015-07-21 Thread Timothy Garafola (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635899#comment-14635899
 ] 

Timothy Garafola commented on SOLR-5379:


Is there a status on this issue?  Did it get moved forward to 5.x?  Is it 
available in 4.10?


 Query-time multi-word synonym expansion
 ---

 Key: SOLR-5379
 URL: https://issues.apache.org/jira/browse/SOLR-5379
 Project: Solr
  Issue Type: Improvement
  Components: query parsers
Reporter: Tien Nguyen Manh
  Labels: multi-word, queryparser, synonym
 Fix For: 4.9, Trunk

 Attachments: conf-test-files-4_8_1.patch, quoted-4_8_1.patch, 
 quoted.patch, solr-5379-version-4.10.3.patch, synonym-expander-4_8_1.patch, 
 synonym-expander.patch


 While dealing with synonym at query time, solr failed to work with multi-word 
 synonyms due to some reasons:
 - First the lucene queryparser tokenizes user query by space so it split 
 multi-word term into two terms before feeding to synonym filter, so synonym 
 filter can't recognized multi-word term to do expansion
 - Second, if synonym filter expand into multiple terms which contains 
 multi-word synonym, The SolrQueryParseBase currently use MultiPhraseQuery to 
 handle synonyms. But MultiPhraseQuery don't work with term have different 
 number of words.
 For the first one, we can extend quoted all multi-word synonym in user query 
 so that lucene queryparser don't split it. There are a jira task related to 
 this one https://issues.apache.org/jira/browse/LUCENE-2605.
 For the second, we can replace MultiPhraseQuery by an appropriate BoleanQuery 
 SHOULD which contains multiple PhraseQuery in case tokens stream have 
 multi-word synonym.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6685) GeoPointInBBox/Distance queries should have safeguards

2015-07-21 Thread Nicholas Knize (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nicholas Knize updated LUCENE-6685:
---
Attachment: LUCENE-6685.patch

Updated patch iincludes the following improvements:

* Dynamically compute detail level based on query size (includes min/max bounds 
on detail level)
* Remove unnecessary ranges from PointDistanceQuery

 GeoPointInBBox/Distance queries should have safeguards
 --

 Key: LUCENE-6685
 URL: https://issues.apache.org/jira/browse/LUCENE-6685
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Michael McCandless
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6685.patch, LUCENE-6685.patch, LUCENE-6685.patch


 These queries build a big list of term ranges, where the size of the list is 
 in proportion to how many cells of the space filling curve are crossed by 
 the perimeter of the query (I think?).
 This can easily be 100s of MBs for a big enough query ... not to mention slow 
 to enumerate (we still do this again for each segment).
 I think the queries should have safeguards, much like we have 
 maxDeterminizedStates for Automaton based queries, to prevent accidental 
 OOMEs.
 But I think longer term we should either change the ranges to be enumerated 
 on-demand and never stored in entirety (like NumericRangeTermsEnum), or 
 change the query so it has a fixed budget of how many cells it's allowed to 
 visit and then within a crossing cell it uses doc values to post-filter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6547) Add dateline crossing support to GeoPointInBBox and GeoPointDistance Queries

2015-07-21 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635860#comment-14635860
 ] 

Nicholas Knize commented on LUCENE-6547:


bq. The test was very slow with the * 1000 random radius ... I'm not sure why? 

There were unnecessary ranges being computed for the GeoPointDistance query. 
This has been fixed in the latest patch for LUCENE-6685.

 Add dateline crossing support to GeoPointInBBox and GeoPointDistance Queries
 

 Key: LUCENE-6547
 URL: https://issues.apache.org/jira/browse/LUCENE-6547
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/search
Reporter: Nicholas Knize
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6547.patch, LUCENE-6547.patch, LUCENE-6547.patch, 
 LUCENE-6547.patch, LUCENE-6547.patch, LUCENE-6547.patch, LUCENE-6547.patch, 
 LUCENE-6547.patch, LUCENE-6547.patch


 The current GeoPointInBBoxQuery only supports bounding boxes that are within 
 the standard -180:180 longitudinal bounds. While its perfectly fine to 
 require users to split dateline crossing bounding boxes in two, 
 GeoPointDistanceQuery should support distance queries that cross the 
 dateline.  Since morton encoding doesn't support unwinding this issue will 
 add dateline crossing to GeoPointInBBoxQuery and GeoPointDistanceQuery 
 classes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-6685) GeoPointInBBox/Distance queries should have safeguards

2015-07-21 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635858#comment-14635858
 ] 

Nicholas Knize edited comment on LUCENE-6685 at 7/21/15 9:41 PM:
-

Updated patch iincludes the following improvements:

* Dynamically compute detail level based on query size (includes min/max bounds 
on detail level)
* Remove unnecessary ranges from PointDistanceQuery
* Updated javadocs


was (Author: nknize):
Updated patch iincludes the following improvements:

* Dynamically compute detail level based on query size (includes min/max bounds 
on detail level)
* Remove unnecessary ranges from PointDistanceQuery

 GeoPointInBBox/Distance queries should have safeguards
 --

 Key: LUCENE-6685
 URL: https://issues.apache.org/jira/browse/LUCENE-6685
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Michael McCandless
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6685.patch, LUCENE-6685.patch, LUCENE-6685.patch


 These queries build a big list of term ranges, where the size of the list is 
 in proportion to how many cells of the space filling curve are crossed by 
 the perimeter of the query (I think?).
 This can easily be 100s of MBs for a big enough query ... not to mention slow 
 to enumerate (we still do this again for each segment).
 I think the queries should have safeguards, much like we have 
 maxDeterminizedStates for Automaton based queries, to prevent accidental 
 OOMEs.
 But I think longer term we should either change the ranges to be enumerated 
 on-demand and never stored in entirety (like NumericRangeTermsEnum), or 
 change the query so it has a fixed budget of how many cells it's allowed to 
 visit and then within a crossing cell it uses doc values to post-filter.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7560) Parallel SQL Support

2015-07-21 Thread Joel Bernstein (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635770#comment-14635770
 ] 

Joel Bernstein commented on SOLR-7560:
--

Just wrapped up the work on SOLR-7441 which really makes the SQL interface much 
more robust and user friendly when errors occur.

I think the SQL work is ready to backport to the 5x branch.

 Parallel SQL Support
 

 Key: SOLR-7560
 URL: https://issues.apache.org/jira/browse/SOLR-7560
 Project: Solr
  Issue Type: New Feature
  Components: clients - java, search
Reporter: Joel Bernstein
 Fix For: 5.3

 Attachments: SOLR-7560.patch, SOLR-7560.patch, SOLR-7560.patch, 
 SOLR-7560.patch


 This ticket provides support for executing *Parallel SQL* queries across 
 SolrCloud collections. The SQL engine will be built on top of the Streaming 
 API (SOLR-7082), which provides support for *parallel relational algebra* and 
 *real-time map-reduce*.
 Basic design:
 1) A new SQLHandler will be added to process SQL requests. The SQL statements 
 will be compiled to live Streaming API objects for parallel execution across 
 SolrCloud worker nodes.
 2) SolrCloud collections will be abstracted as *Relational Tables*. 
 3) The Presto SQL parser will be used to parse the SQL statements.
 4) A JDBC thin client will be added as a Solrj client.
 This ticket will focus on putting the framework in place and providing basic 
 SELECT support and GROUP BY aggregate support.
 Future releases will build on this framework to provide additional SQL 
 features.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7742) Support for Immutable ConfigSets

2015-07-21 Thread Gregory Chanan (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635730#comment-14635730
 ] 

Gregory Chanan commented on SOLR-7742:
--

Do you have a specific test case I can look at?

 Support for Immutable ConfigSets
 

 Key: SOLR-7742
 URL: https://issues.apache.org/jira/browse/SOLR-7742
 Project: Solr
  Issue Type: New Feature
Reporter: Gregory Chanan
Assignee: Gregory Chanan
 Fix For: 5.3, Trunk

 Attachments: SOLR-7742, SOLR-7742.patch


 See the discussion in SOLR-5955; to properly support collection templates 
 that can be specified as the starting point for a collection configuration, 
 we need support for ConfigSets that are immutable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_45) - Build # 5051 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5051/
Java: 32bit/jdk1.8.0_45 -server -XX:+UseG1GC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not 
released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([D9A9A80C8F0C73BF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:235)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest

Error Message:
Could not remove the following files (in the order of attempts):
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data\tlog\tlog.000:
 java.nio.file.FileSystemException: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data\tlog\tlog.000:
 The process cannot access the file because it is being used by another 
process. 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data\tlog:
 java.nio.file.DirectoryNotEmptyException: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data\tlog

C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data:
 java.nio.file.DirectoryNotEmptyException: 
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1\data

C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.HttpPartitionTest_D9A9A80C8F0C73BF-001\control-001\cores\c8n_1x2_leader_session_loss_shard1_replica1:
 

[jira] [Commented] (SOLR-7441) Improve overall robustness of the Streaming stack: Streaming API, Streaming Expressions, Parallel SQL

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635758#comment-14635758
 ] 

ASF subversion and git services commented on SOLR-7441:
---

Commit 1692193 from [~joel.bernstein] in branch 'dev/trunk'
[ https://svn.apache.org/r1692193 ]

SOLR-7441:Improve overall robustness of the Streaming stack: Streaming API, 
Streaming Expressions, Parallel SQL

 Improve overall robustness of the Streaming stack: Streaming API, Streaming 
 Expressions, Parallel SQL
 -

 Key: SOLR-7441
 URL: https://issues.apache.org/jira/browse/SOLR-7441
 Project: Solr
  Issue Type: Improvement
Affects Versions: 5.1
Reporter: Erick Erickson
Assignee: Joel Bernstein
Priority: Minor
 Attachments: SOLR-7441.patch, SOLR-7441.patch, SOLR-7441.patch, 
 SOLR-7441.patch


 It's harder than it could be to figure out what the error is when using 
 Streaming Aggregation. For instance if you specify an fl parameter for a 
 field that doesn't exist it's hard to figure out that's the cause. This is 
 true even if you look in the Solr logs.
 I'm not quite sure whether it'd be possible to report this at the client 
 level or not, but it seems at least we could repor something more helpful in 
 the Solr logs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Parsing and indexing parts of the input file paths

2015-07-21 Thread Andrew Musselman
Erik, thanks; the prefix starting with /user/andrew/ will be known, and
can be put into config, let's assume.  Would this be config-only or would
it require some code, and could you point to some classes I can start with
if I need to write code, and some up-to-date docs?

Same for the update processor, is there an example I could read?

On Tue, Jul 21, 2015 at 11:19 AM, Erik Hatcher erik.hatc...@gmail.com
wrote:

 If this is only for search, then an analysis chain could be crafted,
 likely with the pattern regex filter in the mix, to pull out pieces of the
 path.  How will you know the prefix of the file though?

 There’s also the ability to do this sort of thing in an update processor,
 most easily using the script update processor, using a bit of JavaScript to
 pull out the piece(s) you want to index (and even store at this point).

 —
 Erik Hatcher, Senior Solutions Architect
 http://www.lucidworks.com




 On Jul 21, 2015, at 1:31 PM, Andrew Musselman andrew.mussel...@gmail.com
 wrote:

 Dear user and dev lists,

 We are loading files from a directory and would like to index a portion of
 each file path as a field as well as the text inside the file.

 E.g., on HDFS we have this file path:

 /user/andrew/1234/1234/file.pdf

 And we would like the 1234 token parsed from the file path and indexed
 as an additional field that can be searched on.

 From my initial searches I can't see how to do this easily, so would I
 need to write some custom code, or a plugin?

 Thanks!





[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b21) - Build # 13553 - Still Failing!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13553/
Java: 64bit/jdk1.8.0_60-ea-b21 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationHandlerTest.doTest

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 
seconds
at 
__randomizedtesting.SeedInfo.seed([AAD1A27A9CD8CB7E:D951ADEF163D8C7]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearSourceCollection(BaseCdcrDistributedZkTest.java:319)
at 
org.apache.solr.cloud.CdcrReplicationHandlerTest.doTestPartialReplicationAfterPeerSync(CdcrReplicationHandlerTest.java:158)
at 
org.apache.solr.cloud.CdcrReplicationHandlerTest.doTest(CdcrReplicationHandlerTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 

Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Adrien Grand
I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
invitation to become a committer.

Mikhail, it's tradition that you introduce yourself with a brief bio.

Your handle mkhl has already added to the “lucene LDAP group, so
you now have commit privileges. Please test this by adding yourself to
the committers section of the Who We Are page on the website:
http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
at the bottom of the page here: https://cms.apache.org/#bookmark -
more info here http://www.apache.org/dev/cms.html).

Congratulations and welcome!

-- 
Adrien

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6668) Optimize SortedSet/SortedNumeric storage for the few unique sets use-case

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634735#comment-14634735
 ] 

ASF subversion and git services commented on LUCENE-6668:
-

Commit 1692061 from [~jpountz] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1692061 ]

LUCENE-6668: Added table encoding to sorted set/numeric doc values.

 Optimize SortedSet/SortedNumeric storage for the few unique sets use-case
 -

 Key: LUCENE-6668
 URL: https://issues.apache.org/jira/browse/LUCENE-6668
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6668.patch, LUCENE-6668.patch


 Robert suggested this idea: if there are few unique sets of values, we could 
 build a lookup table and then map each doc to an ord in this table, just like 
 we already do for table compression for numerics.
 I think this is especially compelling given that SortedSet/SortedNumeric are 
 our two only doc values types that use O(maxDoc) memory because of the 
 offsets map. When this new strategy is used, memory usage could be bounded to 
 a constant.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: [JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.7.0_80) - Build # 13364 - Failure!

2015-07-21 Thread Adrien Grand
This is because of my commit, I tested with Java 8 which has a default
method for remove() on the contrary to Java 7. I'll fix.

On Tue, Jul 21, 2015 at 10:28 AM, Policeman Jenkins Server
jenk...@thetaphi.de wrote:
 Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13364/
 Java: 32bit/jdk1.7.0_80 -server -XX:+UseConcMarkSweepGC

 No tests ran.

 Build Log:
 [...truncated 399 lines...]
 [javac] Compiling 735 source files to 
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/core/classes/java
 [javac] 
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/core/src/java/org/apache/lucene/codecs/lucene50/Lucene50DocValuesConsumer.java:591:
  error: anonymous 
 org.apache.lucene.codecs.lucene50.Lucene50DocValuesConsumer$1$1 is not 
 abstract and does not override abstract method remove() in Iterator
 [javac] return new IteratorNumber() {
 [javac]   ^
 [javac] Note: Some input files use or override a deprecated API.
 [javac] Note: Recompile with -Xlint:deprecation for details.
 [javac] 1 error

 BUILD FAILED
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:536: The following 
 error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:484: The following 
 error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following 
 error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The 
 following error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build.xml:50: The 
 following error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:525: 
 The following error occurred while executing this line:
 /home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1956: 
 Compile failed; see the compiler error output for details.

 Total time: 7 seconds
 Build step 'Invoke Ant' marked build as failure
 Archiving artifacts
 Recording test results
 ERROR: Publisher 'Publish JUnit test result report' failed: No test report 
 files were found. Configuration error?
 Email was triggered for: Failure - Any
 Sending email for trigger: Failure - Any




 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org



-- 
Adrien

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Shai Erera
Welcome Mikhail!
On Jul 21, 2015 10:23 AM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Christian Moen
Congrats, Mikhail!

 On Jul 21, 2015, at 4:21 PM, Adrien Grand jpou...@gmail.com wrote:
 
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.
 
 Mikhail, it's tradition that you introduce yourself with a brief bio.
 
 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).
 
 Congratulations and welcome!
 
 -- 
 Adrien
 
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org
 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.7.0_80) - Build # 13364 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13364/
Java: 32bit/jdk1.7.0_80 -server -XX:+UseConcMarkSweepGC

No tests ran.

Build Log:
[...truncated 399 lines...]
[javac] Compiling 735 source files to 
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/core/classes/java
[javac] 
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/core/src/java/org/apache/lucene/codecs/lucene50/Lucene50DocValuesConsumer.java:591:
 error: anonymous 
org.apache.lucene.codecs.lucene50.Lucene50DocValuesConsumer$1$1 is not 
abstract and does not override abstract method remove() in Iterator
[javac] return new IteratorNumber() {
[javac]   ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] 1 error

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:536: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:484: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error 
occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build.xml:50: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:525: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1956: 
Compile failed; see the compiler error output for details.

Total time: 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
ERROR: Publisher 'Publish JUnit test result report' failed: No test report 
files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

[jira] [Commented] (LUCENE-6690) Speed up MultiTermsEnum.next()

2015-07-21 Thread Martijn van Groningen (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634897#comment-14634897
 ] 

Martijn van Groningen commented on LUCENE-6690:
---

+1 this looks great. I test it out on an index with a single doc values field 
with 100M unique values and 42 segments and the rebuilding time dropped from 
~17000 ms to ~10800ms.  

 Speed up MultiTermsEnum.next()
 --

 Key: LUCENE-6690
 URL: https://issues.apache.org/jira/browse/LUCENE-6690
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6690.patch, OrdinalMapBuildBench.java


 OrdinalMap is very useful when computing top terms on a multi-index segment. 
 However I've seen it being occasionally slow to build, which was either 
 making facets (when the ordinals map is computed lazily) or reopen (when 
 computed eagerly) slow. So out of curiosity, I tried to profile ordinal map 
 building on a simple index: 10M random strings of length between 0 and 20 
 stored as a SORTED doc values field. The index has 19 segments. The 
 bottleneck was MultiTermsEnum.next() (by far) due to lots of BytesRef 
 comparisons (UTF8SortedAsUnicodeComparator).
 MultiTermsEnum stores sub enums in two different places:
  - top: a simple array containing all enums on the current term
  - queue: a queue for enums that are not exhausted yet but beyond the current 
 term.
 A non-exhausted enum is in exactly one of these data-structures. When moving 
 to the next term, MultiTermsEnum advances all enums in {{top}}, then adds 
 them to {{queue}} and finally, pops all enum that are on the same term back 
 into {{top}}.
 We could save reorderings of the priority queue by not removing entries from 
 the priority queue and then calling updateTop to advance enums which are on 
 the current term. This is already what we do for disjunctions of doc IDs in 
 DISIPriorityQueue.
 On the index described above and current trunk, building an OrdinalMap has to 
 call UTF8SortedAsUnicodeComparator.compare 80114820 times and runs in 1.9 s. 
 With the change, it calls UTF8SortedAsUnicodeComparator.compare 36900694 
 times, BytesRef.equals 16297638 times and runs in 1.4s (~26% faster).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Ramkumar R. Aiyengar
Welcome Mikhail!

On Tue, Jul 21, 2015 at 8:21 AM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




-- 
Not sent from my iPhone or my Blackberry or anyone else's


Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Alan Woodward
Welcome, Mikhail!

Alan Woodward
www.flax.co.uk


On 21 Jul 2015, at 08:21, Adrien Grand wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.
 
 Mikhail, it's tradition that you introduce yourself with a brief bio.
 
 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).
 
 Congratulations and welcome!
 
 -- 
 Adrien
 
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org
 



[jira] [Commented] (LUCENE-6674) J9 assertion / crash in tests

2015-07-21 Thread Brijesh Nekkare (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634941#comment-14634941
 ] 

Brijesh Nekkare commented on LUCENE-6674:
-

We would also need the coredump to be jextracted as detailed at 
http://www-01.ibm.com/support/docview.wss?uid=swg21577379

 J9 assertion / crash in tests
 -

 Key: LUCENE-6674
 URL: https://issues.apache.org/jira/browse/LUCENE-6674
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Robert Muir

 {quote}
06:45:04.031 0x2518500j9mm.107*   ** ASSERTION FAILED ** at 
 ParallelScavenger.cpp:3053: ((false  
 (_extensions-objectModel.isRemembered(objectPtr
 {quote}
 http://build-eu-00.elastic.co/job/lucene_linux_java8_64_test_only/55153/consoleFull



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7639) Bring MLTQParser at par with the MLT Handler w.r.t supported options

2015-07-21 Thread Jens Wille (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jens Wille updated SOLR-7639:
-
Attachment: (was: SOLR-7639-use-defaults.patch)

 Bring MLTQParser at par with the MLT Handler w.r.t supported options
 

 Key: SOLR-7639
 URL: https://issues.apache.org/jira/browse/SOLR-7639
 Project: Solr
  Issue Type: Improvement
Reporter: Anshum Gupta
Assignee: Anshum Gupta
 Fix For: 5.3

 Attachments: SOLR-7639-add-boost-and-exclude-current.patch, 
 SOLR-7639.patch, SOLR-7639.patch


 As of now, there are options that the MLT Handler supports which the QParser 
 doesn't. It would be good to have the QParser tap into everything that's 
 supported.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7639) Bring MLTQParser at par with the MLT Handler w.r.t supported options

2015-07-21 Thread Jens Wille (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jens Wille updated SOLR-7639:
-
Attachment: SOLR-7639-add-boost-and-exclude-current.patch

 Bring MLTQParser at par with the MLT Handler w.r.t supported options
 

 Key: SOLR-7639
 URL: https://issues.apache.org/jira/browse/SOLR-7639
 Project: Solr
  Issue Type: Improvement
Reporter: Anshum Gupta
Assignee: Anshum Gupta
 Fix For: 5.3

 Attachments: SOLR-7639-add-boost-and-exclude-current.patch, 
 SOLR-7639-add-boost-and-exclude-current.patch, SOLR-7639.patch, 
 SOLR-7639.patch


 As of now, there are options that the MLT Handler supports which the QParser 
 doesn't. It would be good to have the QParser tap into everything that's 
 supported.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7639) Bring MLTQParser at par with the MLT Handler w.r.t supported options

2015-07-21 Thread Jens Wille (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634984#comment-14634984
 ] 

Jens Wille commented on SOLR-7639:
--

I've updated the {{SOLR-7639-add-boost-and-exclude-current}} patch for 
{{CloudMLTQParser}}. Anything else I can do?

 Bring MLTQParser at par with the MLT Handler w.r.t supported options
 

 Key: SOLR-7639
 URL: https://issues.apache.org/jira/browse/SOLR-7639
 Project: Solr
  Issue Type: Improvement
Reporter: Anshum Gupta
Assignee: Anshum Gupta
 Fix For: 5.3

 Attachments: SOLR-7639-add-boost-and-exclude-current.patch, 
 SOLR-7639-add-boost-and-exclude-current.patch, SOLR-7639.patch, 
 SOLR-7639.patch


 As of now, there are options that the MLT Handler supports which the QParser 
 doesn't. It would be good to have the QParser tap into everything that's 
 supported.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7756) NPE in ExactStatsCache when a term doesn't exist on a shard

2015-07-21 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634841#comment-14634841
 ] 

Anshum Gupta commented on SOLR-7756:


Thanks Varun. Looks good. Here are a few suggestions:
* You should reset solr.test.sys.* system properties during teardown.
* It'd be good to refactor the test a little bit (nothing pressing)
* Do we really need 3 shards in the test? I think we can do with just 2 and 
save time for the test run.

There's also a bunch of formatting changes that's a part of the patch. I just 
glanced through it, but in case it's something that's not required, it'd be 
good to not refactor those.
P.S: If the current formatting is screwed up, by all means clean it up.

 NPE in ExactStatsCache when a term doesn't exist on a shard
 ---

 Key: SOLR-7756
 URL: https://issues.apache.org/jira/browse/SOLR-7756
 Project: Solr
  Issue Type: Bug
Reporter: Varun Thacker
 Fix For: 5.3

 Attachments: SOLR-7756.patch, SOLR-7756.patch, SOLR-7756.patch, 
 SOLR-7756.patch


 If a term doesn't exist on a shard {{ExactStatsCache#getPerShardTermStats}} 
 throws an NullPointerException. 
 Attaching a test and a patch shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Stefan Matheis
Welcome Mikhail!  

-Stefan  


On Tuesday, July 21, 2015 at 9:21 AM, Adrien Grand wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.
  
 Mikhail, it's tradition that you introduce yourself with a brief bio.
  
 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).
  
 Congratulations and welcome!
  
 --  
 Adrien
  
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org 
 (mailto:dev-unsubscr...@lucene.apache.org)
 For additional commands, e-mail: dev-h...@lucene.apache.org 
 (mailto:dev-h...@lucene.apache.org)
  
  




[jira] [Commented] (SOLR-7715) Remove IgnoreAcceptDocsQuery

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634778#comment-14634778
 ] 

ASF subversion and git services commented on SOLR-7715:
---

Commit 1692067 from [~jpountz] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1692067 ]

SOLR-7715: Removed IgnoreAcceptDocsQuery.

 Remove IgnoreAcceptDocsQuery
 

 Key: SOLR-7715
 URL: https://issues.apache.org/jira/browse/SOLR-7715
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Priority: Minor

 While reviewing how queries apply acceptDocs, I noticed that Solr has 
 org.apache.solr.search.join.IgnoreAcceptDocsQuery, but it looks unused. 
 Should we remove it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7815) Remove LuceneQueryOptimizer

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634791#comment-14634791
 ] 

ASF subversion and git services commented on SOLR-7815:
---

Commit 1692070 from [~jpountz] in branch 'dev/trunk'
[ https://svn.apache.org/r1692070 ]

SOLR-7815: Removed LuceneQueryOptimizer.

 Remove LuceneQueryOptimizer
 ---

 Key: SOLR-7815
 URL: https://issues.apache.org/jira/browse/SOLR-7815
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: SOLR-7815.patch


 I noticed that I introduced a bug in this class when refactoring BooleanQuery 
 to be immutable (using the builder as a cache key instead of the query 
 itself). But then I noticed that this class is actually never used, so let's 
 remove it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6668) Optimize SortedSet/SortedNumeric storage for the few unique sets use-case

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634785#comment-14634785
 ] 

ASF subversion and git services commented on LUCENE-6668:
-

Commit 1692069 from [~jpountz] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1692069 ]

LUCENE-6668: Add missing Iterator.remove() implementation.

 Optimize SortedSet/SortedNumeric storage for the few unique sets use-case
 -

 Key: LUCENE-6668
 URL: https://issues.apache.org/jira/browse/LUCENE-6668
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6668.patch, LUCENE-6668.patch


 Robert suggested this idea: if there are few unique sets of values, we could 
 build a lookup table and then map each doc to an ord in this table, just like 
 we already do for table compression for numerics.
 I think this is especially compelling given that SortedSet/SortedNumeric are 
 our two only doc values types that use O(maxDoc) memory because of the 
 offsets map. When this new strategy is used, memory usage could be bounded to 
 a constant.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7715) Remove IgnoreAcceptDocsQuery

2015-07-21 Thread Adrien Grand (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634788#comment-14634788
 ] 

Adrien Grand commented on SOLR-7715:


There also was a commit on trunk but I wrongly labeled it as LUCENE-7715 
instead of SOLR-7715: http://svn.apache.org/r1692062

 Remove IgnoreAcceptDocsQuery
 

 Key: SOLR-7715
 URL: https://issues.apache.org/jira/browse/SOLR-7715
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Priority: Minor

 While reviewing how queries apply acceptDocs, I noticed that Solr has 
 org.apache.solr.search.join.IgnoreAcceptDocsQuery, but it looks unused. 
 Should we remove it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-6668) Optimize SortedSet/SortedNumeric storage for the few unique sets use-case

2015-07-21 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand resolved LUCENE-6668.
--
   Resolution: Fixed
Fix Version/s: 5.3

 Optimize SortedSet/SortedNumeric storage for the few unique sets use-case
 -

 Key: LUCENE-6668
 URL: https://issues.apache.org/jira/browse/LUCENE-6668
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3

 Attachments: LUCENE-6668.patch, LUCENE-6668.patch


 Robert suggested this idea: if there are few unique sets of values, we could 
 build a lookup table and then map each doc to an ord in this table, just like 
 we already do for table compression for numerics.
 I think this is especially compelling given that SortedSet/SortedNumeric are 
 our two only doc values types that use O(maxDoc) memory because of the 
 offsets map. When this new strategy is used, memory usage could be bounded to 
 a constant.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-7715) Remove IgnoreAcceptDocsQuery

2015-07-21 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand resolved SOLR-7715.

   Resolution: Fixed
 Assignee: Adrien Grand
Fix Version/s: 5.3

 Remove IgnoreAcceptDocsQuery
 

 Key: SOLR-7715
 URL: https://issues.apache.org/jira/browse/SOLR-7715
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3


 While reviewing how queries apply acceptDocs, I noticed that Solr has 
 org.apache.solr.search.join.IgnoreAcceptDocsQuery, but it looks unused. 
 Should we remove it?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-7815) Remove LuceneQueryOptimizer

2015-07-21 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand resolved SOLR-7815.

   Resolution: Fixed
Fix Version/s: 5.3

Thanks Hoss for adding context and reviewing the patch.

 Remove LuceneQueryOptimizer
 ---

 Key: SOLR-7815
 URL: https://issues.apache.org/jira/browse/SOLR-7815
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7815.patch


 I noticed that I introduced a bug in this class when refactoring BooleanQuery 
 to be immutable (using the builder as a cache key instead of the query 
 itself). But then I noticed that this class is actually never used, so let's 
 remove it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7815) Remove LuceneQueryOptimizer

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634793#comment-14634793
 ] 

ASF subversion and git services commented on SOLR-7815:
---

Commit 1692073 from [~jpountz] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1692073 ]

SOLR-7815: Removed LuceneQueryOptimizer.

 Remove LuceneQueryOptimizer
 ---

 Key: SOLR-7815
 URL: https://issues.apache.org/jira/browse/SOLR-7815
 Project: Solr
  Issue Type: Task
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7815.patch


 I noticed that I introduced a bug in this class when refactoring BooleanQuery 
 to be immutable (using the builder as a cache key instead of the query 
 itself). But then I noticed that this class is actually never used, so let's 
 remove it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Tommaso Teofili
congrats and welcome!

Tommaso

2015-07-21 9:21 GMT+02:00 Adrien Grand jpou...@gmail.com:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




[jira] [Commented] (LUCENE-6668) Optimize SortedSet/SortedNumeric storage for the few unique sets use-case

2015-07-21 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634660#comment-14634660
 ] 

ASF subversion and git services commented on LUCENE-6668:
-

Commit 1692058 from [~jpountz] in branch 'dev/trunk'
[ https://svn.apache.org/r1692058 ]

LUCENE-6668: Added table encoding to sorted set/numeric doc values.

 Optimize SortedSet/SortedNumeric storage for the few unique sets use-case
 -

 Key: LUCENE-6668
 URL: https://issues.apache.org/jira/browse/LUCENE-6668
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6668.patch, LUCENE-6668.patch


 Robert suggested this idea: if there are few unique sets of values, we could 
 build a lookup table and then map each doc to an ord in this table, just like 
 we already do for table compression for numerics.
 I think this is especially compelling given that SortedSet/SortedNumeric are 
 our two only doc values types that use O(maxDoc) memory because of the 
 offsets map. When this new strategy is used, memory usage could be bounded to 
 a constant.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Han Jiang
Welcome, Mikhail!

On Tue, Jul 21, 2015 at 3:21 PM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




-- 
Han Jiang

Team of Search Engine and Web Mining,
School of Electronic Engineering and Computer Science,
Peking University, China


Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Dawid Weiss
Welcome and congratulations, Mikhail!

Dawid

On Tue, Jul 21, 2015 at 9:27 AM, Shai Erera ser...@gmail.com wrote:
 Welcome Mikhail!

 On Jul 21, 2015 10:23 AM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Ryan Ernst
Congrats!

On Tue, Jul 21, 2015 at 12:21 AM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Koji Sekiguchi

Welcome Mikhail!

Koji

On 2015/07/21 16:21, Adrien Grand wrote:

I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
invitation to become a committer.

Mikhail, it's tradition that you introduce yourself with a brief bio.

Your handle mkhl has already added to the “lucene LDAP group, so
you now have commit privileges. Please test this by adding yourself to
the committers section of the Who We Are page on the website:
http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
at the bottom of the page here: https://cms.apache.org/#bookmark -
more info here http://www.apache.org/dev/cms.html).

Congratulations and welcome!




-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Yonik Seeley
Congrats Mikhail!

-Yonik


On Tue, Jul 21, 2015 at 3:21 AM, Adrien Grand jpou...@gmail.com wrote:
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



RE: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Uwe Schindler
Welcome Mikhail!

-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de


 -Original Message-
 From: Adrien Grand [mailto:jpou...@gmail.com]
 Sent: Tuesday, July 21, 2015 9:22 AM
 To: dev@lucene.apache.org; Mikhail Khludnev
 Subject: Welcome Mikhail Khludnev as Lucene/Solr committer
 
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.
 
 Mikhail, it's tradition that you introduce yourself with a brief bio.
 
 Your handle mkhl has already added to the “lucene LDAP group, so you
 now have commit privileges. Please test this by adding yourself to the
 committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).
 
 Congratulations and welcome!
 
 --
 Adrien
 
 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional
 commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread david.w.smi...@gmail.com
Welcome!  Well deserved Mikhail!

On Tue, Jul 21, 2015 at 10:24 AM Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org

 --
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com


Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Shalin Shekhar Mangar
Welcome Mikhail!

On Tue, Jul 21, 2015 at 12:51 PM, Adrien Grand jpou...@gmail.com wrote:
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




-- 
Regards,
Shalin Shekhar Mangar.

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7765) TokenizerChain without char filters cause NPE in luke request handler

2015-07-21 Thread Konstantin Gribov (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635043#comment-14635043
 ] 

Konstantin Gribov commented on SOLR-7765:
-

Fixing this in {{TokenizerChain}} itself seems better to me. 

Is there any reason to use reversed order in ifs (like {{if (0  
cfiltfacs.length)}})? It looks quite strange since most of lucene  solr code 
use more usual {{if (var  0)}} style.

 TokenizerChain without char filters cause NPE in luke request handler
 -

 Key: SOLR-7765
 URL: https://issues.apache.org/jira/browse/SOLR-7765
 Project: Solr
  Issue Type: Bug
Affects Versions: 5.2.1
Reporter: Konstantin Gribov
Assignee: Hoss Man
Priority: Minor
 Attachments: SOLR-7765.patch, SOLR-7765.patch, SOLR-7765.patch


 {{TokenizerChain}} created using 2-arg constructor has {{null}} in 
 {{charFilters}}, so {{LukeRequestHandler}} throws NPE on iterating it.
 Will create PR in a couple of minutes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6691) tweak SortingMergePolicy.getSortDescription

2015-07-21 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635084#comment-14635084
 ] 

ASF GitHub Bot commented on LUCENE-6691:


GitHub user cpoerschke opened a pull request:

https://github.com/apache/lucene-solr/pull/191

LUCENE-6691: tweak SortingMergePolicy.getSortDescription

for https://issues.apache.org/jira/i#browse/LUCENE-6691

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bloomberg/lucene-solr 
trunk-SortingMergePolicy-isSorted

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/lucene-solr/pull/191.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #191


commit 4626b4977f384ce9dc103531ace566da17c93205
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-16T19:42:21Z

lucene: add EarlyTerminatingSortingCollector.terminatedEarly() method

commit 6b7a11c0ced960f80152aed2c582cfaa6217c0af
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-17T15:46:39Z

lucene: add TestEarlyTerminatingSortingCollector.testTerminatedEarly()

commit 2afd60f6d29b5d4759a3eaf6ed1aef22a368bedb
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-20T12:54:04Z

lucene: tweak SortingMergePolicy.getSortDescription(LeafReader reader)




 tweak SortingMergePolicy.getSortDescription
 ---

 Key: LUCENE-6691
 URL: https://issues.apache.org/jira/browse/LUCENE-6691
 Project: Lucene - Core
  Issue Type: Test
Reporter: Christine Poerschke
Priority: Minor

 Building tests for SOLR-5730 identified that early termination can be omitted 
 for sorted segments because the {{LeafReader}} concerned is not a 
 {{SegmentReader}} - github pull request to illustrate to follow:
 * the {{TestEarlyTerminatingSortingCollector.testTerminatedEarly}} test uses 
 a wrapped reader in the same way as {{SolrIndexSearcher}}
 * the {{SortingMergePolicy.getSortDescription}} change (assuming it is a 
 valid change to make) fixes that particular test only
 * {{ExitableDirectoryReader}} and {{UninvertingReader}} wrap could perhaps 
 also be added in {{LuceneTestCase.wrapReader}} ?
 LUCENE-6065 remove foreign readers from merge, fix LeafReader instead. 
 also concerns SortingMergePolicy.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (LUCENE-6691) tweak SortingMergePolicy.getSortDescription

2015-07-21 Thread Christine Poerschke (JIRA)
Christine Poerschke created LUCENE-6691:
---

 Summary: tweak SortingMergePolicy.getSortDescription
 Key: LUCENE-6691
 URL: https://issues.apache.org/jira/browse/LUCENE-6691
 Project: Lucene - Core
  Issue Type: Test
Reporter: Christine Poerschke
Priority: Minor


Building tests for SOLR-5730 identified that early termination can be omitted 
for sorted segments because the {{LeafReader}} concerned is not a 
{{SegmentReader}} - github pull request to illustrate to follow:
* the {{TestEarlyTerminatingSortingCollector.testTerminatedEarly}} test uses a 
wrapped reader in the same way as {{SolrIndexSearcher}}
* the {{SortingMergePolicy.getSortDescription}} change (assuming it is a valid 
change to make) fixes that particular test only
* {{ExitableDirectoryReader}} and {{UninvertingReader}} wrap could perhaps also 
be added in {{LuceneTestCase.wrapReader}} ?

LUCENE-6065 remove foreign readers from merge, fix LeafReader instead. also 
concerns SortingMergePolicy.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[GitHub] lucene-solr pull request: LUCENE-6691: tweak SortingMergePolicy.ge...

2015-07-21 Thread cpoerschke
GitHub user cpoerschke opened a pull request:

https://github.com/apache/lucene-solr/pull/191

LUCENE-6691: tweak SortingMergePolicy.getSortDescription

for https://issues.apache.org/jira/i#browse/LUCENE-6691

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bloomberg/lucene-solr 
trunk-SortingMergePolicy-isSorted

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/lucene-solr/pull/191.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #191


commit 4626b4977f384ce9dc103531ace566da17c93205
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-16T19:42:21Z

lucene: add EarlyTerminatingSortingCollector.terminatedEarly() method

commit 6b7a11c0ced960f80152aed2c582cfaa6217c0af
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-17T15:46:39Z

lucene: add TestEarlyTerminatingSortingCollector.testTerminatedEarly()

commit 2afd60f6d29b5d4759a3eaf6ed1aef22a368bedb
Author: Christine Poerschke cpoersc...@bloomberg.net
Date:   2015-07-20T12:54:04Z

lucene: tweak SortingMergePolicy.getSortDescription(LeafReader reader)




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Steve Rowe
Welcome Mikhail!

Steve
www.lucidworks.com

On Tuesday, July 21, 2015, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org javascript:;
 For additional commands, e-mail: dev-h...@lucene.apache.org javascript:;




[jira] [Updated] (SOLR-7692) Implement BasicAuth based impl for the new Authentication/Authorization APIs

2015-07-21 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-7692:
-
Attachment: SOLR-7692.patch

some cleanup

 Implement BasicAuth based impl for the new Authentication/Authorization APIs
 

 Key: SOLR-7692
 URL: https://issues.apache.org/jira/browse/SOLR-7692
 Project: Solr
  Issue Type: New Feature
Reporter: Noble Paul
Assignee: Noble Paul
 Attachments: SOLR-7692.patch, SOLR-7692.patch, SOLR-7692.patch, 
 SOLR-7692.patch, SOLR-7692.patch, SOLR-7692.patch, SOLR-7692.patch, 
 SOLR-7692.patch


 This involves various components
 h2. Authentication
 A basic auth based authentication filter. This should retrieve the user 
 credentials from ZK.  The user name and sha1 hash of password should be 
 stored in ZK
 sample authentication json 
 {code:javascript}
 {
   authentication:{
 class: solr.BasicAuthPlugin,
 users :{
   john :09fljnklnoiuy98 buygujkjnlk,
   david:f678njfgfjnklno iuy9865ty,
   pete: 87ykjnklndfhjh8 98uyiy98,
}
   }
 }
 {code}
 h2. authorization plugin
 This would store the roles of various users and their privileges in ZK
 sample authorization.json
 {code:javascript}
 {
   authorization: {
 class: solr.ZKAuthorization,
roles :{
   admin : [john]
   guest : [john, david,pete]
}
 permissions: {
collection-edit: {
  role: admin 
},
coreadmin:{
  role:admin
},
config-edit: {
  //all collections
  role: admin,
  method:POST
},
schema-edit: {
  roles: admin,
  method:POST
},
update: {
  //all collections
  role: dev
},
   mycoll_update: {
 collection: mycoll,
 path:[/update/*],
 role: [somebody]
   }
 }
   }
 }
 {code} 
 We will also need to provide APIs to create users and assign them roles



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Upayavira
Welcome Mikhail!


On Tue, Jul 21, 2015, at 02:47 PM, Han Jiang wrote:
 Welcome, Mikhail!

 On Tue, Jul 21, 2015 at 3:21 PM, Adrien Grand
 jpou...@gmail.com wrote:
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's

invitation to become a committer.


Mikhail, it's tradition that you introduce yourself with a brief bio.


Your handle mkhl has already added to the “lucene LDAP group, so

you now have commit privileges. Please test this by adding yourself to

the committers section of the Who We Are page on the website:

http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet

at the bottom of the page here: https://cms.apache.org/#bookmark -

more info here http://www.apache.org/dev/cms.html).


Congratulations and welcome!


--
 
Adrien
 
 
-
 
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 
For additional commands, e-mail: dev-h...@lucene.apache.org
  
  
  
 -- 
 Han Jiang
  
 Team of Search Engine and Web Mining, 
 School of Electronic Engineering and Computer Science, 
 Peking University, China
 


[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.7.0_80) - Build # 13367 - Failure!

2015-07-21 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13367/
Java: 64bit/jdk1.7.0_80 -XX:+UseCompressedOops -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 62361 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:536: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:443: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:105: The 
following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:122: 
java.lang.OutOfMemoryError: PermGen space
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at 
org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124)
at 
org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295)
at 
org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351)
at 
org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311)
at 
org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at 
embedded_script_in__home_jenkins_workspace_Lucene_Solr_5_dot_x_Linux_extra_targets_dot_xml.run(embedded_script_in__home_jenkins_workspace_Lucene_Solr_5_dot_x_Linux_extra_targets_dot_xml:9)
at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:501)
at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:448)
at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:313)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.taskdefs.Sequential.execute(Sequential.java:68)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.java:348)
at 
org.apache.tools.ant.taskdefs.MacroInstance.execute(MacroInstance.java:398)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)

Total time: 62 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Mikhail Khludnev
Thanks for the best birthday present I’ve ever had!

bio: I grew up at the Far East of Russia, it’s really far - it’s beyond
China. I’ve got engineer degree, work in transportation and geodesy, which
I miss so much now. I start with C++, then learned Java, and moved into
Saint-Petersburg at the North-West.

I met Solr 1.4 at 2010, after programming enterprise applications for a few
years. Now I work with search in Grid Dynamics, where we focus mostly on
retail industry, which has own specifics.

My favorite topics in search: Joins, Facets, Scorers, Codecs, and
DataImportHandler. I spoke at the conferences couple times a year, blog
rarely and post to G+.

In my free time, I’m keeping fit: mostly swimming, attending rock concerts,
and researching something with my daughter.


Thanks you again for this honor! I’ll do my best to be accurate and
responsible.

On Tue, Jul 21, 2015 at 4:47 PM, Han Jiang jiangha...@gmail.com wrote:

 Welcome, Mikhail!

 On Tue, Jul 21, 2015 at 3:21 PM, Adrien Grand jpou...@gmail.com wrote:

 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

 Mikhail, it's tradition that you introduce yourself with a brief bio.

 Your handle mkhl has already added to the “lucene LDAP group, so
 you now have commit privileges. Please test this by adding yourself to
 the committers section of the Who We Are page on the website:
 http://lucene.apache.org/whoweare.html (use the ASF CMS bookmarklet
 at the bottom of the page here: https://cms.apache.org/#bookmark -
 more info here http://www.apache.org/dev/cms.html).

 Congratulations and welcome!

 --
 Adrien

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org




 --
 Han Jiang

 Team of Search Engine and Web Mining,
 School of Electronic Engineering and Computer Science,
 Peking University, China




-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

http://www.griddynamics.com
mkhlud...@griddynamics.com


Re: Welcome Mikhail Khludnev as Lucene/Solr committer

2015-07-21 Thread Shawn Heisey
On 7/21/2015 1:21 AM, Adrien Grand wrote:
 I'm pleased to announce that Mikhail Khludnev has accepted the PMC's
 invitation to become a committer.

Congratulations and welcome to the group!

Thanks,
Shawn


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7806) SolrCloud to use 127.0.01 instead of localhost

2015-07-21 Thread Arcadius Ahouansou (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14635198#comment-14635198
 ] 

Arcadius Ahouansou commented on SOLR-7806:
--

I have taken note [~anders5737]

 SolrCloud to use 127.0.01 instead of localhost
 --

 Key: SOLR-7806
 URL: https://issues.apache.org/jira/browse/SOLR-7806
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Affects Versions: 5.2.1
 Environment: Linux
 Mac OS X
Reporter: Arcadius Ahouansou
 Attachments: SOLR-7806.patch


 A colleague is having an issue very similar to the one described at
 http://muddyazian.blogspot.co.uk/2015/03/how-to-get-solr-500-quick-start.html
 He is running on the latest Arch Linux, and he gets that issue only when he 
 connects to the office network.
 We also have another case when this happens only when a colleague is 
 connected to the office network via VPN from his mac.
 I have looked around IMHO, the usage of 'localhost' in the solr code base may 
 be leading to this kind of issues where the resolved IP is not route-able.
 Does it make any sense to replace all usage of 'localhost' in the code base 
 by 127.0.01?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7806) SolrCloud to use 127.0.01 instead of localhost

2015-07-21 Thread Arcadius Ahouansou (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Arcadius Ahouansou updated SOLR-7806:
-
Attachment: SOLR-7806.patch

Initial patch with localhost changed to 127.0.0.1

 SolrCloud to use 127.0.01 instead of localhost
 --

 Key: SOLR-7806
 URL: https://issues.apache.org/jira/browse/SOLR-7806
 Project: Solr
  Issue Type: Bug
  Components: SolrCloud
Affects Versions: 5.2.1
 Environment: Linux
 Mac OS X
Reporter: Arcadius Ahouansou
 Attachments: SOLR-7806.patch


 A colleague is having an issue very similar to the one described at
 http://muddyazian.blogspot.co.uk/2015/03/how-to-get-solr-500-quick-start.html
 He is running on the latest Arch Linux, and he gets that issue only when he 
 connects to the office network.
 We also have another case when this happens only when a colleague is 
 connected to the office network via VPN from his mac.
 I have looked around IMHO, the usage of 'localhost' in the solr code base may 
 be leading to this kind of issues where the resolved IP is not route-able.
 Does it make any sense to replace all usage of 'localhost' in the code base 
 by 127.0.01?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org