[jira] [Commented] (LUCENE-6699) Integrate lat/lon BKD and spatial3d

2015-07-30 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647540#comment-14647540
 ] 

Nicholas Knize commented on LUCENE-6699:


bq. Right, but you'd be comparing 2 sines, 2 cosines, and 1 sqrt against only 
the cost of unpacking
 
Encoding/Decoding ECEF into 96 Bits:

{noformat}
Avg computation: 664.6969666857143 ns  Trials: 3500  Total time: 
23264.393834 ms
Avg computation: 664.829008375 ns  Trials: 4000  Total time: 26593.160335 ms
Avg computation: 667.362547134 ns  Trials: 4500  Total time: 
30031.314621 ms
Avg computation: 668.46880436 ns  Trials: 5000  Total time: 33423.440218 ms
Avg computation: 667.8703028909091 ns  Trials: 5500  Total time: 
36732.866659 ms
Avg computation: 669.375388866 ns  Trials: 6000  Total time: 
40162.523332 ms
Avg computation: 668.4362739230769 ns  Trials: 6500  Total time: 
43448.357805 ms
Avg computation: 667.9539851 ns  Trials: 7000  Total time: 46756.778957 ms
Avg computation: 667.363829733 ns  Trials: 7500  Total time: 
50052.28723 ms
Avg computation: 675.024778375 ns  Trials: 8000  Total time: 54001.98227 ms
Avg computation: 674.1673578352941 ns  Trials: 8500  Total time: 
57304.225416 ms
Avg computation: 673.472343978 ns  Trials: 9000  Total time: 
60612.510958 ms
Avg computation: 673.0372402842105 ns  Trials: 9500  Total time: 
63938.537827 ms
Avg computation: 672.55224382 ns  Trials: 1  Total time: 67255.224382 ms
{noformat}

Compared to packing/unpacking lat/lon into 64 bits using using GeoPointField 
morton bit twiddling:

{noformat}
Avg computation: 60.397136 ns  Trials: 3500  Total time: 2113.89976 ms
Avg computation: 61.6391708 ns  Trials: 4000  Total time: 2465.566832 ms
Avg computation: 62.7440744 ns  Trials: 4500  Total time: 
2823.48334 ms
Avg computation: 63.5108 ns  Trials: 5000  Total time: 3175.54 ms
Avg computation: 64.18207294545455 ns  Trials: 5500  Total time: 
3530.014012 ms
Avg computation: 64.7368465667 ns  Trials: 6000  Total time: 
3884.210794 ms
Avg computation: 65.18073341538461 ns  Trials: 6500  Total time: 
4236.747672 ms
Avg computation: 65.5902512 ns  Trials: 7000  Total time: 4591.317584 ms
Avg computation: 65.0290225333 ns  Trials: 7500  Total time: 4877.17669 
ms
Avg computation: 63.6249806 ns  Trials: 8000  Total time: 5089.998448 ms
Avg computation: 62.4193206 ns  Trials: 8500  Total time: 5305.642251 ms
Avg computation: 61.34443397776 ns  Trials: 9000  Total time: 
5520.999058 ms
Avg computation: 61.402236642105265 ns  Trials: 9500  Total time: 
5833.212481 ms
Avg computation: 61.10019762 ns  Trials: 1  Total time: 6110.019762 ms
{noformat}

So using the 3D BitSet approach is 10 times longer, with the obvious culprit 
being the for loop for each bit. This can be optimized, though, using a 3-way 
bit twiddle and 2 longs if a 64 bit 3D packing yields unacceptable loss of 
precision.

  

 Integrate lat/lon BKD and spatial3d
 ---

 Key: LUCENE-6699
 URL: https://issues.apache.org/jira/browse/LUCENE-6699
 Project: Lucene - Core
  Issue Type: New Feature
Reporter: Michael McCandless
Assignee: Michael McCandless
 Attachments: Geo3DPacking.java


 I'm opening this for discussion, because I'm not yet sure how to do
 this integration, because of my ignorance about spatial in general and
 spatial3d in particular :)
 Our BKD tree impl is very fast at doing lat/lon shape intersection
 (bbox, polygon, soon distance: LUCENE-6698) against previously indexed
 points.
 I think to integrate with spatial3d, we would first need to record
 lat/lon/z into doc values.  Somewhere I saw discussion about how we
 could stuff all 3 into a single long value with acceptable precision
 loss?  Or, we could use BinaryDocValues?  We need all 3 dims available
 to do the fast per-hit query time filtering.
 But, second: what do we index into the BKD tree?  Can we just index
 earth surface lat/lon, and then at query time is spatial3d able to
 give me an enclosing surface lat/lon bbox for a 3d shape?  Or
 ... must we index all 3 dimensions into the BKD tree (seems like this
 could be somewhat wasteful)?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-6625:
-
Attachment: SOLR-6625.patch

fixed the test error


 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-6625:
-
Attachment: SOLR-6625.patch

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-6699) Integrate lat/lon BKD and spatial3d

2015-07-30 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647540#comment-14647540
 ] 

Nicholas Knize edited comment on LUCENE-6699 at 7/30/15 12:23 PM:
--

bq. Right, but you'd be comparing 2 sines, 2 cosines, and 1 sqrt against only 
the cost of unpacking
 
Encoding/Decoding ECEF into 96 Bits:

{noformat}
Avg computation: 664.6969666857143 ns  Trials: 3500  Total time: 
23264.393834 ms
Avg computation: 664.829008375 ns  Trials: 4000  Total time: 26593.160335 ms
Avg computation: 667.362547134 ns  Trials: 4500  Total time: 
30031.314621 ms
Avg computation: 668.46880436 ns  Trials: 5000  Total time: 33423.440218 ms
Avg computation: 667.8703028909091 ns  Trials: 5500  Total time: 
36732.866659 ms
Avg computation: 669.375388866 ns  Trials: 6000  Total time: 
40162.523332 ms
Avg computation: 668.4362739230769 ns  Trials: 6500  Total time: 
43448.357805 ms
Avg computation: 667.9539851 ns  Trials: 7000  Total time: 46756.778957 ms
Avg computation: 667.363829733 ns  Trials: 7500  Total time: 
50052.28723 ms
Avg computation: 675.024778375 ns  Trials: 8000  Total time: 54001.98227 ms
Avg computation: 674.1673578352941 ns  Trials: 8500  Total time: 
57304.225416 ms
Avg computation: 673.472343978 ns  Trials: 9000  Total time: 
60612.510958 ms
Avg computation: 673.0372402842105 ns  Trials: 9500  Total time: 
63938.537827 ms
Avg computation: 672.55224382 ns  Trials: 1  Total time: 67255.224382 ms
{noformat}

Compared to packing/unpacking lat/lon into 64 bits using using GeoPointField 
morton bit twiddling:

{noformat}
Avg computation: 60.397136 ns  Trials: 3500  Total time: 2113.89976 ms
Avg computation: 61.6391708 ns  Trials: 4000  Total time: 2465.566832 ms
Avg computation: 62.7440744 ns  Trials: 4500  Total time: 
2823.48334 ms
Avg computation: 63.5108 ns  Trials: 5000  Total time: 3175.54 ms
Avg computation: 64.18207294545455 ns  Trials: 5500  Total time: 
3530.014012 ms
Avg computation: 64.7368465667 ns  Trials: 6000  Total time: 
3884.210794 ms
Avg computation: 65.18073341538461 ns  Trials: 6500  Total time: 
4236.747672 ms
Avg computation: 65.5902512 ns  Trials: 7000  Total time: 4591.317584 ms
Avg computation: 65.0290225333 ns  Trials: 7500  Total time: 4877.17669 
ms
Avg computation: 63.6249806 ns  Trials: 8000  Total time: 5089.998448 ms
Avg computation: 62.4193206 ns  Trials: 8500  Total time: 5305.642251 ms
Avg computation: 61.34443397776 ns  Trials: 9000  Total time: 
5520.999058 ms
Avg computation: 61.402236642105265 ns  Trials: 9500  Total time: 
5833.212481 ms
Avg computation: 61.10019762 ns  Trials: 1  Total time: 6110.019762 ms
{noformat}

So using the 3D BitSet approach is 10 times longer, with the obvious culprit 
being the for loop for each bit. This can be optimized, though, using a 3-way 
bit twiddle and 2 longs if a 64 bit 3D packing yields unacceptable loss of 
precision.

bq. so I'd think a benchmarking should not overemphasize seeks as being costly

Maybe not. But it does depend on the on-disk representation of the tree (and I 
typically don't use SSDs as an excuse for not paying attention to good file 
layout).  I was mentioning this in the context of index size as a function of a 
wasteful vs. efficient encoding. 


was (Author: nknize):
bq. Right, but you'd be comparing 2 sines, 2 cosines, and 1 sqrt against only 
the cost of unpacking
 
Encoding/Decoding ECEF into 96 Bits:

{noformat}
Avg computation: 664.6969666857143 ns  Trials: 3500  Total time: 
23264.393834 ms
Avg computation: 664.829008375 ns  Trials: 4000  Total time: 26593.160335 ms
Avg computation: 667.362547134 ns  Trials: 4500  Total time: 
30031.314621 ms
Avg computation: 668.46880436 ns  Trials: 5000  Total time: 33423.440218 ms
Avg computation: 667.8703028909091 ns  Trials: 5500  Total time: 
36732.866659 ms
Avg computation: 669.375388866 ns  Trials: 6000  Total time: 
40162.523332 ms
Avg computation: 668.4362739230769 ns  Trials: 6500  Total time: 
43448.357805 ms
Avg computation: 667.9539851 ns  Trials: 7000  Total time: 46756.778957 ms
Avg computation: 667.363829733 ns  Trials: 7500  Total time: 
50052.28723 ms
Avg computation: 675.024778375 ns  Trials: 8000  Total time: 54001.98227 ms
Avg computation: 674.1673578352941 ns  Trials: 8500  Total time: 
57304.225416 ms
Avg computation: 673.472343978 ns  Trials: 9000  Total time: 
60612.510958 ms
Avg computation: 673.0372402842105 ns  Trials: 9500  Total time: 
63938.537827 ms
Avg computation: 672.55224382 ns  Trials: 1  Total time: 67255.224382 ms
{noformat}

Compared to packing/unpacking lat/lon into 64 bits using using GeoPointField 
morton bit twiddling:

{noformat}
Avg computation: 

[jira] [Updated] (SOLR-5894) Speed up high-cardinality facets with sparse counters

2015-07-30 Thread Toke Eskildsen (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Toke Eskildsen updated SOLR-5894:
-
Description: 
Multiple performance enhancements to Solr String faceting.

* Sparse counters, switching the constant time overhead of extracting top-X 
terms with time overhead linear to result set size
* Counter re-use for reduced garbage collection and lower per-call overhead
* Optional counter packing, trading speed for space
* Improved distribution count logic, greatly improving the performance of 
distributed faceting
* In-segment threaded faceting
* Regexp based white- and black-listing of facet terms
* Heuristic faceting for large result sets

Currently implemented for Solr 4.10. Source, detailed description and directly 
usable WAR at http://tokee.github.io/lucene-solr/

This project has grown beyond a simple patch and will require a fair amount of 
co-operation with a committer to get into Solr. Splitting into smaller issues 
is a possibility.

  was:
Multiple performance enhancements to Solr String faceting.

* Sparse counters, switching the constant time overhead of extracting top-X 
terms with time linear to result set size
* Counter re-use for reduced garbage collection and lower per-call overhead
* Optional counter packing, trading speed for space
* Improved distribution count logic, greatly reducing the overhead of 
distributed faceting
* In-segment threaded faceting
* Regexp based white- and black-listing of facet terms
* Heuristic faceting for large result sets

Currently implemented for Solr 4.10 and available as source and directly usable 
WAR at http://tokee.github.io/lucene-solr/




 Speed up high-cardinality facets with sparse counters
 -

 Key: SOLR-5894
 URL: https://issues.apache.org/jira/browse/SOLR-5894
 Project: Solr
  Issue Type: Improvement
  Components: SearchComponents - other
Affects Versions: 4.7.1
Reporter: Toke Eskildsen
Priority: Minor
  Labels: faceted-search, faceting, memory, performance
 Attachments: SOLR-5894.patch, SOLR-5894.patch, SOLR-5894.patch, 
 SOLR-5894.patch, SOLR-5894.patch, SOLR-5894.patch, SOLR-5894.patch, 
 SOLR-5894.patch, SOLR-5894.patch, SOLR-5894_test.zip, SOLR-5894_test.zip, 
 SOLR-5894_test.zip, SOLR-5894_test.zip, SOLR-5894_test.zip, 
 author_7M_tags_1852_logged_queries_warmed.png, 
 sparse_200docs_fc_cutoff_20140403-145412.png, 
 sparse_500docs_20140331-151918_multi.png, 
 sparse_500docs_20140331-151918_single.png, 
 sparse_5051docs_20140328-152807.png


 Multiple performance enhancements to Solr String faceting.
 * Sparse counters, switching the constant time overhead of extracting top-X 
 terms with time overhead linear to result set size
 * Counter re-use for reduced garbage collection and lower per-call overhead
 * Optional counter packing, trading speed for space
 * Improved distribution count logic, greatly improving the performance of 
 distributed faceting
 * In-segment threaded faceting
 * Regexp based white- and black-listing of facet terms
 * Heuristic faceting for large result sets
 Currently implemented for Solr 4.10. Source, detailed description and 
 directly usable WAR at http://tokee.github.io/lucene-solr/
 This project has grown beyond a simple patch and will require a fair amount 
 of co-operation with a committer to get into Solr. Splitting into smaller 
 issues is a possibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6647) Add GeoHash String Utilities to core GeoUtils

2015-07-30 Thread Nicholas Knize (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nicholas Knize updated LUCENE-6647:
---
Attachment: LUCENE-6647.patch

Updated patch that depends on LUCENE-6704 - changes morton encoding to use full 
64 bits, 32 bits per lat/lon.

 Add GeoHash String Utilities to core GeoUtils
 -

 Key: LUCENE-6647
 URL: https://issues.apache.org/jira/browse/LUCENE-6647
 Project: Lucene - Core
  Issue Type: New Feature
Reporter: Nicholas Knize
 Attachments: LUCENE-6647.patch, LUCENE-6647.patch, LUCENE-6647.patch


 GeoPointField uses morton encoding to efficiently pack lat/lon values into a 
 single long. GeoHashing effectively does the same thing but uses base 32 
 encoding to represent this long value as a human readable string.  Many 
 user applications already use the string representation of the hash. This 
 issue simply adds the base32 string representation of the already computed 
 morton code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 752 - Still Failing

2015-07-30 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/752/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=23498, name=collection0, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=23498, name=collection0, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:38139/f_mmi: collection already exists: 
awholynewstresscollection_collection0_6
at __randomizedtesting.SeedInfo.seed([6EE885A312A59D56]:0)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1572)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:887)


REGRESSION:  org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest.test

Error Message:
commitWithin did not work on node: http://127.0.0.1:53847/vg_zj/collection1 
expected:68 but was:67

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: 
http://127.0.0.1:53847/vg_zj/collection1 expected:68 but was:67
at 
__randomizedtesting.SeedInfo.seed([6EE885A312A59D56:E6BCBA79BC59F0AE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at 
org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:332)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 

[jira] [Assigned] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Noble Paul (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul reassigned SOLR-6625:


Assignee: Noble Paul  (was: Gregory Chanan)

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13662 - Failure!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13662/
Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
Timeout while trying to assert update logs @ collection=source_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert update logs @ 
collection=source_collection
at 
__randomizedtesting.SeedInfo.seed([DBDE1E937ECAD389:D3BE6BBF71C4FB82]:0)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.assertNumberOfTlogFiles(CdcrReplicationDistributedZkTest.java:644)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestUpdateLogSynchronisation(CdcrReplicationDistributedZkTest.java:384)
at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[jira] [Comment Edited] (SOLR-7833) Add new Solr book 'Apache Solr 3.1 Cookbook' to selection of Solr books and news.

2015-07-30 Thread Zico Fernandes (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647492#comment-14647492
 ] 

Zico Fernandes edited comment on SOLR-7833 at 7/30/15 11:37 AM:


[~gro] Will you be able to create a patch for this?


was (Author: zico):
[~gro] Can you create a patch for this?

 Add new Solr book 'Apache Solr 3.1 Cookbook' to selection of Solr books and 
 news.
 -

 Key: SOLR-7833
 URL: https://issues.apache.org/jira/browse/SOLR-7833
 Project: Solr
  Issue Type: Task
Reporter: Zico Fernandes
 Attachments: Solr Cookbook_Third Edition.jpg


 Rafał Kuć is proud to finally announce the book Solr Cookbook - Third Edition 
 by Packt Publishing. This edition will specifically appeal to developers who 
 wish to quickly get to grips with the changes and new features of Apache Solr 
 5. 
 Solr Cookbook - Third Edition has over 100 easy to follow recipes to solve 
 real-time problems related to Apache Solr 4.x and 5.0 effectively. Starting 
 with vital information on setting up Solr, the developer will quickly 
 progress to analyzing their text data through querying and performance 
 improvement. Finally, they will explore real-life situations, where Solr can 
 be used to simplify daily collection handling.
 With numerous practical chapters centered on important Solr techniques and 
 methods Solr Cookbook - Third Edition will guide intermediate Solr Developers 
 who are willing to learn and implement Pro-level practices, techniques, and 
 solutions.
 Click here to read more about the Solr Cookbook - Third Edition: 
 https://www.packtpub.com/big-data-and-business-intelligence/solr-cookbook-third-edition



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: numberOfDocuments in SimilarityBase

2015-07-30 Thread Robert Muir
I think so. When adding this statistic (lucene 4.0), personally I
really wanted to fix it everywhere. But we had the problem of
backwards compatibility, and its bad to use different formulas for
different segments even if it works...

Nowadays we dont have lucene 3 segments around anymore, so I think we
should fix this. Want to open an issue?

On Wed, Jul 29, 2015 at 10:45 AM, Ahmet Arslan
iori...@yahoo.com.invalid wrote:
 Hello List,

 SimilarityBase uses CollectionStatistics#maxDoc() for numberOfDocuments.
 Shouldn't it be field-based CollectionStatistics#docCount()?

 --- core/src/java/org/apache/lucene/search/similarities/SimilarityBase.java   
   (revision 1693268)
 +++ core/src/java/org/apache/lucene/search/similarities/SimilarityBase.java   
   (working copy)
 @@ -102,7 +102,7 @@
 protected void fillBasicStats(BasicStats stats, CollectionStatistics 
 collectionStats, TermStatistics termStats) {
 // #positions(field) must be = #positions(term)
 assert collectionStats.sumTotalTermFreq() == -1 || 
 collectionStats.sumTotalTermFreq() = termStats.totalTermFreq();
 -long numberOfDocuments = collectionStats.maxDoc();
 +long numberOfDocuments = collectionStats.docCount();


 Thanks,
 Ahmet

 -
 To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
 For additional commands, e-mail: dev-h...@lucene.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7833) Add new Solr book 'Apache Solr 3.1 Cookbook' to selection of Solr books and news.

2015-07-30 Thread Zico Fernandes (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647492#comment-14647492
 ] 

Zico Fernandes commented on SOLR-7833:
--

[~gro] Can you create a patch for this?

 Add new Solr book 'Apache Solr 3.1 Cookbook' to selection of Solr books and 
 news.
 -

 Key: SOLR-7833
 URL: https://issues.apache.org/jira/browse/SOLR-7833
 Project: Solr
  Issue Type: Task
Reporter: Zico Fernandes
 Attachments: Solr Cookbook_Third Edition.jpg


 Rafał Kuć is proud to finally announce the book Solr Cookbook - Third Edition 
 by Packt Publishing. This edition will specifically appeal to developers who 
 wish to quickly get to grips with the changes and new features of Apache Solr 
 5. 
 Solr Cookbook - Third Edition has over 100 easy to follow recipes to solve 
 real-time problems related to Apache Solr 4.x and 5.0 effectively. Starting 
 with vital information on setting up Solr, the developer will quickly 
 progress to analyzing their text data through querying and performance 
 improvement. Finally, they will explore real-life situations, where Solr can 
 be used to simplify daily collection handling.
 With numerous practical chapters centered on important Solr techniques and 
 methods Solr Cookbook - Third Edition will guide intermediate Solr Developers 
 who are willing to learn and implement Pro-level practices, techniques, and 
 solutions.
 Click here to read more about the Solr Cookbook - Third Edition: 
 https://www.packtpub.com/big-data-and-business-intelligence/solr-cookbook-third-edition



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Comment Edited] (LUCENE-6699) Integrate lat/lon BKD and spatial3d

2015-07-30 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647128#comment-14647128
 ] 

Nicholas Knize edited comment on LUCENE-6699 at 7/30/15 12:00 PM:
--

bq. The obvious alternative would be to store just lat/lon, exactly like is 
done for Nicholas's code

Just to clarify, so there's no confusion, the attached code converts from 
lat/lon to ECEF (either full range in meters, or scaled to the unit spheroid) 
and stores the result in a 96 bit BitSet. GeoPointField stores encoded lat/lon 
(if that's what you were referring to).  The attached was intended to be used 
for a Geo3d integration w/ GeoPointField.

bq.  I expect the conversion for every record would turn out to be more 
expensive.

Just to note again, the conversion from lat/lon to ECEF XYZ is a non-iterative 
conversion (2 sines, 2 cosines, 1 sqrt).  Conversion cost vs. wateful 
representation is the interesting question, so I threw together a quick 
encoding/decoding benchmark (on my i7 16GB System76) and ran it on 100M points 
(converting from lla to ECEF and back). The law of large numbers took over at 
around 35M. For interest the results are provided:

{noformat}
Avg computation: 620.431975767 ns  Trials: 3000  Total time: 
18612.959273 ms
Avg computation: 621.3008362285715 ns  Trials: 3500  Total time: 
21745.529268 ms
Avg computation: 621.582647925 ns  Trials: 4000  Total time: 24863.305917 ms
Avg computation: 621.372458955 ns  Trials: 4500  Total time: 
27961.760653 ms
Avg computation: 621.16271364 ns  Trials: 5000  Total time: 31058.135682 ms
Avg computation: 621.3857686909091 ns  Trials: 5500  Total time: 
34176.217278 ms
Avg computation: 621.8110524 ns  Trials: 6000  Total time: 37308.663144 ms
Avg computation: 621.6768083230769 ns  Trials: 6500  Total time: 
40408.992541 ms
Avg computation: 621.5324306714285 ns  Trials: 7000  Total time: 
43507.270147 ms
Avg computation: 621.444053693 ns  Trials: 7500  Total time: 
46608.304027 ms
Avg computation: 621.7594845875 ns  Trials: 8000  Total time: 49740.758767 
ms
Avg computation: 621.9327540705882 ns  Trials: 8500  Total time: 
52864.284096 ms
Avg computation: 621.942943456 ns  Trials: 9000  Total time: 
55974.864911 ms
Avg computation: 621.8868688947368 ns  Trials: 9500  Total time: 
59079.252545 ms
Avg computation: 621.98037608 ns  Trials: 1  Total time: 62198.037608 ms
{noformat}

Again, those are both conversions to ECEF and back to LLA.  So roughly 1 minute 
for 100M points.  Halve those numbers and you have the cost for converting 
either direction. 

Next we could benchmark tree access and compare?  I suspect traversal cost 
should be a function of the on-disk representation and chosen split method 
(that's where RTrees tend to become costly). Since BKD splits a sorted space, 
and it can exploit file system cache? I suspect there aren't many random seeks? 
Seems benchmarking might be relatively straightforward?


was (Author: nknize):
bq. The obvious alternative would be to store just lat/lon, exactly like is 
done for Nicholas's code

Just to clarify, so there's no confusion, the attached code converts from 
lat/lon to ECEF (either full range in meters, or scaled to the unit spheroid) 
and stores the result in a 96 bit BitSet. GeoPointField stores encoded lat/lon 
(if that's what you were referring to).  The attached was intended to be used 
for a Geo3d integration w/ GeoPointField.

bq.  I expect the conversion for every record would turn out to be more 
expensive.

Just to note again, the conversion from lat/lon to ECEF XYZ is a non-iterative 
conversion (2 sines, 2 cosines, 1 sqrt).  Conversion cost vs. wateful 
representation is the interesting question, so I threw together a quick 
encoding/decoding benchmark (on my i7 16GB System76) and ran it on 1B points 
(converting from lla to ECEF and back). The law of large numbers took over at 
around 350M. For interest the results are provided:

{noformat}
Avg computation: 620.431975767 ns  Trials: 3000  Total time: 
18612.959273 ms
Avg computation: 621.3008362285715 ns  Trials: 3500  Total time: 
21745.529268 ms
Avg computation: 621.582647925 ns  Trials: 4000  Total time: 24863.305917 ms
Avg computation: 621.372458955 ns  Trials: 4500  Total time: 
27961.760653 ms
Avg computation: 621.16271364 ns  Trials: 5000  Total time: 31058.135682 ms
Avg computation: 621.3857686909091 ns  Trials: 5500  Total time: 
34176.217278 ms
Avg computation: 621.8110524 ns  Trials: 6000  Total time: 37308.663144 ms
Avg computation: 621.6768083230769 ns  Trials: 6500  Total time: 
40408.992541 ms
Avg computation: 621.5324306714285 ns  Trials: 7000  Total time: 
43507.270147 ms
Avg computation: 621.444053693 ns  Trials: 7500  Total time: 
46608.304027 ms
Avg computation: 

[jira] [Updated] (SOLR-5894) Speed up high-cardinality facets with sparse counters

2015-07-30 Thread Toke Eskildsen (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Toke Eskildsen updated SOLR-5894:
-
Description: 
Multiple performance enhancements to Solr String faceting.

* Sparse counters, switching the constant time overhead of extracting top-X 
terms with time linear to result set size
* Counter re-use for reduced garbage collection and lower per-call overhead
* Optional counter packing, trading speed for space
* Improved distribution count logic, greatly reducing the overhead of 
distributed faceting
* In-segment threaded faceting
* Regexp based white- and black-listing of facet terms
* Heuristic faceting for large result sets

Currently implemented for Solr 4.10 and available as source and directly usable 
WAR at http://tokee.github.io/lucene-solr/



  was:
Field based faceting in Solr has two phases: Collecting counts for tags in 
facets and extracting the requested tags.

The execution time for the collecting phase is approximately linear to the 
number of hits and the number of references from hits to tags. This phase is 
not the focus here.

The extraction time scales with the number of unique tags in the search result, 
but is also heavily influenced by the total number of unique tags in the facet 
as every counter, 0 or not, is visited by the extractor (at least for count 
order). For fields with millions of unique tag values this means 10s of 
milliseconds added to the minimum response time (see 
https://sbdevel.wordpress.com/2014/03/18/sparse-facet-counting-on-a-real-index/ 
for a test on a corpus with 7M unique values in the facet).

The extractor needs to visit every counter due to the current counter structure 
being a plain int-array of size #unique_tags. Switching to a sparse structure, 
where only the tag counters  0 are visited, makes the extraction time linear 
to the number of unique tags in the result set.

Unfortunately the number of unique tags in the result set is unknown at collect 
time, so it is not possible to reliably select sparse counting vs. full 
counting up front. Luckily there exists solutions for sparse sets that has the 
property of switching to non-sparse-mode without a switch-penalty, when the 
sparse-threshold is exceeded (see 
http://programmingpraxis.com/2012/03/09/sparse-sets/ for an example). This JIRA 
aims to implement this functionality in Solr.

Current status: Sparse counting is implemented for field cache faceting, both 
single- and multi-value, with and without doc-values. Sort by count only. The 
patch applies cleanly to Solr 4.6.1 and should integrate well with everything 
as all functionality is unchanged. After patching, the following new parameters 
are possible:

* facet.sparse=true enables sparse faceting.
* facet.sparse.mintags=1 the minimum amount of unique tags in the given 
field for sparse faceting to be active. This is used for auto-selecting whether 
sparse should be used or not.
* facet.sparse.fraction=0.08 the overhead used for the sparse tracker. Setting 
this too low means that only very small result sets are handled as sparse. 
Setting this too high will result in a large performance penalty if the result 
set blows the sparse tracker. Values between 0.04 and 0.1 seems to work well.
* facet.sparse.packed=true use PackecInts for counters instead of int[]. This 
saves memory, but performance will differ. Whether performance will be better 
or worse depends on the corpus. Experiment with it.
* facet.sparse.cutoff=0.90 if the estimated number (based on hitcount) of 
unique tags in the search result exceeds this fraction of the sparse tracker, 
do not perform sparse tracking. The estimate is based on the assumption that 
references from documents to tags are distributed randomly.
* facet.sparse.pool.size=2 the maximum amount of sparse trackers to clear and 
keep in memory, ready for usage. Clearing and re-using a counter is faster that 
allocating it fresh from the heap. Setting the pool size to 0 means than a new 
sparse counter will be allocated each time, just as standard Solr faceting 
works.

* facet.sparse.stats=true adds a special tag with timing statistics for sparse 
faceting.
* facet.sparse.stats.reset=true resets the timing statistics and clears the 
pool.

The parameters needs to be given together with standard faceting parameters, 
such as facet=truefacet.field=myfieldfacet.mincount=1facet.sort=true. The 
defaults should be usable, so simply appending facet.sparse=true to the URL is 
a good start.


 Speed up high-cardinality facets with sparse counters
 -

 Key: SOLR-5894
 URL: https://issues.apache.org/jira/browse/SOLR-5894
 Project: Solr
  Issue Type: Improvement
  Components: SearchComponents - other
Affects Versions: 4.7.1
Reporter: Toke Eskildsen
Priority: Minor
  

[jira] [Commented] (LUCENE-6699) Integrate lat/lon BKD and spatial3d

2015-07-30 Thread Karl Wright (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647584#comment-14647584
 ] 

Karl Wright commented on LUCENE-6699:
-

If the decision is made to use (x,y,z) encoding rather than (lat,lon), then 
FWIW I think the right way forward with spatial3d would be to extend the 
current Bounds infrastructure to allow the finding of x,y,z bounds for a shape, 
rather than just lat/lon. I've thought about this for a day and have concluded 
it would be far and away the fastest solution, since computing the Bounds for 
any shape would need to be done only once.

Once x, y, and z bounds are known for a shape, the BKD code itself can make 
most of its decisions itself, without much computation at all, for most of the 
recursive steps.  Only when descending *within* the computed bounds would it be 
necessary to construct a GeoArea XYZArea object to determine the exact 
relationship between a 3d rectangle and the specified GeoShape.


 Integrate lat/lon BKD and spatial3d
 ---

 Key: LUCENE-6699
 URL: https://issues.apache.org/jira/browse/LUCENE-6699
 Project: Lucene - Core
  Issue Type: New Feature
Reporter: Michael McCandless
Assignee: Michael McCandless
 Attachments: Geo3DPacking.java


 I'm opening this for discussion, because I'm not yet sure how to do
 this integration, because of my ignorance about spatial in general and
 spatial3d in particular :)
 Our BKD tree impl is very fast at doing lat/lon shape intersection
 (bbox, polygon, soon distance: LUCENE-6698) against previously indexed
 points.
 I think to integrate with spatial3d, we would first need to record
 lat/lon/z into doc values.  Somewhere I saw discussion about how we
 could stuff all 3 into a single long value with acceptable precision
 loss?  Or, we could use BinaryDocValues?  We need all 3 dims available
 to do the fast per-hit query time filtering.
 But, second: what do we index into the BKD tree?  Can we just index
 earth surface lat/lon, and then at query time is spatial3d able to
 give me an enclosing surface lat/lon bbox for a 3d shape?  Or
 ... must we index all 3 dimensions into the BKD tree (seems like this
 could be somewhat wasteful)?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6531) Make PhraseQuery immutable

2015-07-30 Thread Terry Smith (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647690#comment-14647690
 ] 

Terry Smith commented on LUCENE-6531:
-

[~jpountz] The PhraseQuery.Builder setter methods are all void, where as the 
ones for BooleanQuery and BlendedTermQuery return the Builder itself.

Can the set/add methods on PhraseQuery.Builder return this to make the various 
Query builders consistent with each other?


 Make PhraseQuery immutable
 --

 Key: LUCENE-6531
 URL: https://issues.apache.org/jira/browse/LUCENE-6531
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3, 6.0

 Attachments: LUCENE-6531.patch, LUCENE-6531.patch


 Mutable queries are an issue for automatic filter caching since modifying a 
 query after it has been put into the cache will corrupt the cache. We should 
 make all queries immutable (up to the boost) to avoid this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6704) GeoPointInBBox/Distance queries can throw OOME

2015-07-30 Thread Nicholas Knize (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647749#comment-14647749
 ] 

Nicholas Knize commented on LUCENE-6704:


bq. Can you add a dedicated standalone test that today hits OOME and then with 
this patch doesn't?

Sure thing!  I'll isolate one of the OOME failures from testRandom() so 
before/after patch validation can be run.

bq. Why is GeoPointDistanceQuery not final anymore? Seems like nothing wants to 
extend it...

That was a change intended for a new issue. I've added a 
GeoPointDistanceRangeQuery that extends GeoPointDistanceQuery. I'll remove it 
from this patch and apply it in a new issue. Sorry for that confusion :)


 GeoPointInBBox/Distance queries can throw OOME
 --

 Key: LUCENE-6704
 URL: https://issues.apache.org/jira/browse/LUCENE-6704
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Nicholas Knize
 Attachments: LUCENE-6704.patch


 After investigating LUCENE-6685 the performance issues and improvements 
 related to GeoPointInBBox/Distance queries could be categorized into two 
 separate issues:
  
 1. OOME caused by an unnecessary number of ranges computed for Point Distance 
 Queries (bug in the GeoPointTermEnum base class where the bounding box was 
 used for intersections instead of the point radius)
 2. API improvements providing configurable detail parameters.
 This issue addresses 1.  LUCENE-6685 will further investigate the need for 2 
 (after working 1 and correcting for unnecessary range detail, it looks like 2 
 may not be needed) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6631) Lucene Document Classification

2015-07-30 Thread Tommaso Teofili (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647770#comment-14647770
 ] 

Tommaso Teofili commented on LUCENE-6631:
-

Alessandro, thanks for your patch, I'll take a look and let you know shortly.

 Lucene Document Classification
 --

 Key: LUCENE-6631
 URL: https://issues.apache.org/jira/browse/LUCENE-6631
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
  Labels: classification
 Attachments: LUCENE-6631.patch


 Currently the Lucene Classification module supports the classification for an 
 input text using the Lucene index as a trained model.
 This improvement is adding to the module a set of components to provide 
 Document classification ( where the Document is a Lucene document ).
 All selected fields from the Document will have their part in the 
 classification ( including the use of the proper Analyzer per field).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7739) Lucene Classification Integration - UpdateRequestProcessor

2015-07-30 Thread Tommaso Teofili (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647768#comment-14647768
 ] 

Tommaso Teofili commented on SOLR-7739:
---

Alessandro, thanks for your patch, I'll take a look and let you know shortly.

 Lucene Classification Integration - UpdateRequestProcessor
 --

 Key: SOLR-7739
 URL: https://issues.apache.org/jira/browse/SOLR-7739
 Project: Solr
  Issue Type: New Feature
  Components: update
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, index-time, update.chain, 
 updateProperties
 Attachments: SOLR-7739.patch


 It would be nice to have an UpdateRequestProcessor to interact with the 
 Lucene Classification Module and provide an easy way of auto classifying Solr 
 Documents on indexing.
 Documentation will be provided with the patch
 A first design will be provided soon.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6531) Make PhraseQuery immutable

2015-07-30 Thread Terry Smith (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647701#comment-14647701
 ] 

Terry Smith commented on LUCENE-6531:
-

Awesome, you rock!


 Make PhraseQuery immutable
 --

 Key: LUCENE-6531
 URL: https://issues.apache.org/jira/browse/LUCENE-6531
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3, 6.0

 Attachments: LUCENE-6531.patch, LUCENE-6531.patch


 Mutable queries are an issue for automatic filter caching since modifying a 
 query after it has been put into the cache will corrupt the cache. We should 
 make all queries immutable (up to the boost) to avoid this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6707) PhraseQuery.Builder methods should return this to allow chaining

2015-07-30 Thread Uwe Schindler (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647713#comment-14647713
 ] 

Uwe Schindler commented on LUCENE-6707:
---

+1


--
Uwe Schindler
H.-H.-Meier-Allee 63, 28213 Bremen
http://www.thetaphi.de


 PhraseQuery.Builder methods should return this to allow chaining
 

 Key: LUCENE-6707
 URL: https://issues.apache.org/jira/browse/LUCENE-6707
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6707.patch


 Currently they return void, so you can't chain. Returning this would make it 
 consistent with BooleanQuery.Builder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6631) Lucene Document Classification

2015-07-30 Thread Alessandro Benedetti (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647757#comment-14647757
 ] 

Alessandro Benedetti commented on LUCENE-6631:
--

Any feedback on this guys ?

Cheers

 Lucene Document Classification
 --

 Key: LUCENE-6631
 URL: https://issues.apache.org/jira/browse/LUCENE-6631
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
  Labels: classification
 Attachments: LUCENE-6631.patch


 Currently the Lucene Classification module supports the classification for an 
 input text using the Lucene index as a trained model.
 This improvement is adding to the module a set of components to provide 
 Document classification ( where the Document is a Lucene document ).
 All selected fields from the Document will have their part in the 
 classification ( including the use of the proper Analyzer per field).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7739) Lucene Classification Integration - UpdateRequestProcessor

2015-07-30 Thread Alessandro Benedetti (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647752#comment-14647752
 ] 

Alessandro Benedetti commented on SOLR-7739:


Any feedback guys ?

 Lucene Classification Integration - UpdateRequestProcessor
 --

 Key: SOLR-7739
 URL: https://issues.apache.org/jira/browse/SOLR-7739
 Project: Solr
  Issue Type: New Feature
  Components: update
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, index-time, update.chain, 
 updateProperties
 Attachments: SOLR-7739.patch


 It would be nice to have an UpdateRequestProcessor to interact with the 
 Lucene Classification Module and provide an easy way of auto classifying Solr 
 Documents on indexing.
 Documentation will be provided with the patch
 A first design will be provided soon.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6654) KNearestNeighborClassifier not taking in consideration Class ranking

2015-07-30 Thread Tommaso Teofili (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647769#comment-14647769
 ] 

Tommaso Teofili commented on LUCENE-6654:
-

Alessandro, thanks for your patch, I'll take a look and let you know shortly.

 KNearestNeighborClassifier not taking in consideration Class ranking
 

 Key: LUCENE-6654
 URL: https://issues.apache.org/jira/browse/LUCENE-6654
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, knn
 Attachments: LUCENE-6654.patch


 Currently the KNN Classifier assign the score for a ClassificationResult, 
 based only on the frequency of the class in the top K results.
 This is conceptually a simplification.
 Actually the ranking must take a part.
 If not this can happen :
 Top 4
 1) Class1
 2) Class1
 3) Class2
 4) Class2
 As a result of this Top 4 , both the classes will have the same score.
 But the expected result is that Class1 has a better score, as the MLT score 
 the documents accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6699) Integrate lat/lon BKD and spatial3d

2015-07-30 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647778#comment-14647778
 ] 

Michael McCandless commented on LUCENE-6699:


I can't follow all the spatial-heavy discussion here, but:

bq. Since BKD splits a sorted space, and it can exploit file system cache?

BKD tree's tree (the internal nodes) is already forced into heap, at least in 
the current impl.  So walking that tree should always be fast, and then there's 
only seeking once we hit the leaf nodes.  But that seeking should be sequential 
walk through the file...

bq. If the decision is made to use (x,y,z) encoding rather than (lat,lon),

bq. So, if you turn the BKD descent into something other than (x,y,z), it would 
imply that you store points for records in something other than (x,y,z) too, no?

I think the encoding for each point's value can be different from what the BKD 
tree uses?

I suspect the points shoudl use (x,y,z) encoding when stored in doc-values per 
document, because when we need to filter hits for the BKD leaf cells 
overlapping the shape's boundary, we want to take advantage of the fast math in 
(x,y,z) space that spatial3d gives us?

But then, for the inner-nodes (split values) for the BKD tree, we could use 
either (lat,lon) or (x,y,z), whichever gives us fastest shape relation 
computations?  At each step in the recursion, BKD tree must check a split in 
one dimension against the query shape.

 Integrate lat/lon BKD and spatial3d
 ---

 Key: LUCENE-6699
 URL: https://issues.apache.org/jira/browse/LUCENE-6699
 Project: Lucene - Core
  Issue Type: New Feature
Reporter: Michael McCandless
Assignee: Michael McCandless
 Attachments: Geo3DPacking.java


 I'm opening this for discussion, because I'm not yet sure how to do
 this integration, because of my ignorance about spatial in general and
 spatial3d in particular :)
 Our BKD tree impl is very fast at doing lat/lon shape intersection
 (bbox, polygon, soon distance: LUCENE-6698) against previously indexed
 points.
 I think to integrate with spatial3d, we would first need to record
 lat/lon/z into doc values.  Somewhere I saw discussion about how we
 could stuff all 3 into a single long value with acceptable precision
 loss?  Or, we could use BinaryDocValues?  We need all 3 dims available
 to do the fast per-hit query time filtering.
 But, second: what do we index into the BKD tree?  Can we just index
 earth surface lat/lon, and then at query time is spatial3d able to
 give me an enclosing surface lat/lon bbox for a 3d shape?  Or
 ... must we index all 3 dimensions into the BKD tree (seems like this
 could be somewhat wasteful)?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.7.0_80) - Build # 13482 - Failure!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13482/
Java: 64bit/jdk1.7.0_80 -XX:-UseCompressedOops -XX:+UseSerialGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.rule.RulesTest

Error Message:
ERROR: SolrIndexSearcher opens=25 closes=24

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=25 closes=24
at __randomizedtesting.SeedInfo.seed([8924B6740E1CF03E]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:467)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:233)
at sun.reflect.GeneratedMethodAccessor50.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.rule.RulesTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.rule.RulesTest: 
1) Thread[id=10232, name=searcherExecutor-5601-thread-1, state=WAITING, 
group=TGRP-RulesTest] at sun.misc.Unsafe.park(Native Method) at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
 at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) 
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)   
  at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
at java.lang.Thread.run(Thread.java:745)2) Thread[id=10204, 
name=qtp742053195-10204, state=RUNNABLE, group=TGRP-RulesTest] at 
java.util.WeakHashMap.get(WeakHashMap.java:471) at 
org.apache.solr.servlet.cache.HttpCacheHeaderUtil.calcEtag(HttpCacheHeaderUtil.java:101)
 at 
org.apache.solr.servlet.cache.HttpCacheHeaderUtil.doCacheHeaderValidation(HttpCacheHeaderUtil.java:219)
 at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:444)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
 at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
 at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
 at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
 at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
 at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364) 
at 

[jira] [Created] (LUCENE-6707) PhraseQuery.Builder methods should return this to allow chaining

2015-07-30 Thread Adrien Grand (JIRA)
Adrien Grand created LUCENE-6707:


 Summary: PhraseQuery.Builder methods should return this to allow 
chaining
 Key: LUCENE-6707
 URL: https://issues.apache.org/jira/browse/LUCENE-6707
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Adrien Grand


Currently they return void, so you can't chain. Returning this would make it 
consistent with BooleanQuery.Builder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6707) PhraseQuery.Builder methods should return this to allow chaining

2015-07-30 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand updated LUCENE-6707:
-
Priority: Minor  (was: Major)

 PhraseQuery.Builder methods should return this to allow chaining
 

 Key: LUCENE-6707
 URL: https://issues.apache.org/jira/browse/LUCENE-6707
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Adrien Grand
Priority: Minor

 Currently they return void, so you can't chain. Returning this would make it 
 consistent with BooleanQuery.Builder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6704) GeoPointInBBox/Distance queries can throw OOME

2015-07-30 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647739#comment-14647739
 ] 

Michael McCandless commented on LUCENE-6704:


I'm a little lost on this issue.  It's focusing on fixing the OOME?  But the 
patch seems to do much more (good things!).

Can you add a dedicated standalone test that today hits OOME and then with this 
patch doesn't?  To confirm the patch is fixing OOMEs in both 
GeoPointInBBoxQuery and GeoPointDistanceQuery...

Why is GeoPointDistanceQuery not final anymore?  Seems like nothing wants to 
extend it...

I like the added javadocs, and BigInteger usage is always fun :)

 GeoPointInBBox/Distance queries can throw OOME
 --

 Key: LUCENE-6704
 URL: https://issues.apache.org/jira/browse/LUCENE-6704
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Nicholas Knize
 Attachments: LUCENE-6704.patch


 After investigating LUCENE-6685 the performance issues and improvements 
 related to GeoPointInBBox/Distance queries could be categorized into two 
 separate issues:
  
 1. OOME caused by an unnecessary number of ranges computed for Point Distance 
 Queries (bug in the GeoPointTermEnum base class where the bounding box was 
 used for intersections instead of the point radius)
 2. API improvements providing configurable detail parameters.
 This issue addresses 1.  LUCENE-6685 will further investigate the need for 2 
 (after working 1 and correcting for unnecessary range detail, it looks like 2 
 may not be needed) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3386 - Failure

2015-07-30 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3386/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
Didn't see replicas [core_node1, core_node3] come up within 9 ms! 
ClusterState: DocCollection(c8n_1x3_lf)={   router:{name:compositeId},   
maxShardsPerNode:1,   replicationFactor:3,   autoAddReplicas:false, 
  shards:{shard1:{   range:8000-7fff,   
state:active,   replicas:{ core_node1:{   
state:recovering,   node_name:127.0.0.1:51965_mu%2Ftq,  
 base_url:http://127.0.0.1:51965/mu/tq;,   
core:c8n_1x3_lf_shard1_replica3}, core_node2:{   
state:down,   node_name:127.0.0.1:49657_mu%2Ftq,   
base_url:http://127.0.0.1:49657/mu/tq;,   
core:c8n_1x3_lf_shard1_replica2}, core_node3:{   
state:active,   node_name:127.0.0.1:54737_mu%2Ftq,   
base_url:http://127.0.0.1:54737/mu/tq;,   
core:c8n_1x3_lf_shard1_replica1,   leader:true}

Stack Trace:
java.lang.AssertionError: Didn't see replicas [core_node1, core_node3] come up 
within 9 ms! ClusterState: DocCollection(c8n_1x3_lf)={
  router:{name:compositeId},
  maxShardsPerNode:1,
  replicationFactor:3,
  autoAddReplicas:false,
  shards:{shard1:{
  range:8000-7fff,
  state:active,
  replicas:{
core_node1:{
  state:recovering,
  node_name:127.0.0.1:51965_mu%2Ftq,
  base_url:http://127.0.0.1:51965/mu/tq;,
  core:c8n_1x3_lf_shard1_replica3},
core_node2:{
  state:down,
  node_name:127.0.0.1:49657_mu%2Ftq,
  base_url:http://127.0.0.1:49657/mu/tq;,
  core:c8n_1x3_lf_shard1_replica2},
core_node3:{
  state:active,
  node_name:127.0.0.1:54737_mu%2Ftq,
  base_url:http://127.0.0.1:54737/mu/tq;,
  core:c8n_1x3_lf_shard1_replica1,
  leader:true}
at 
__randomizedtesting.SeedInfo.seed([34533157CDBD13BD:BC070E8D63417E45]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.HttpPartitionTest.waitToSeeReplicasActive(HttpPartitionTest.java:565)
at 
org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:178)
at 
org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
 

[jira] [Updated] (LUCENE-6706) Support Payload scoring for SpanOrQuery

2015-07-30 Thread Alan Woodward (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alan Woodward updated LUCENE-6706:
--
Attachment: LUCENE-6706.patch

Here's a patch adding a new PayloadScoreQuery that takes a SpanQuery and a 
PayloadFunction.  PayloadTermQuery and PayloadNearQuery are deprecated.

 Support Payload scoring for SpanOrQuery
 ---

 Key: LUCENE-6706
 URL: https://issues.apache.org/jira/browse/LUCENE-6706
 Project: Lucene - Core
  Issue Type: New Feature
  Components: core/query/scoring
Affects Versions: 5.2.1
Reporter: Jamie Johnson
Assignee: Alan Woodward
Priority: Minor
 Attachments: LUCENE-6706.patch, PayloadSpanOrQuery.java


 I need a way to have payloads influence the score of SpanOrQuery's.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647678#comment-14647678
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693432 from [~noble.paul] in branch 'dev/trunk'
[ https://svn.apache.org/r1693432 ]

SOLR-6625: Enable registering interceptors for the calls made using HttpClient 
and make the
  request object available at the interceptor context

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6707) PhraseQuery.Builder methods should return this to allow chaining

2015-07-30 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand updated LUCENE-6707:
-
Attachment: LUCENE-6707.patch

Here is a patch.

 PhraseQuery.Builder methods should return this to allow chaining
 

 Key: LUCENE-6707
 URL: https://issues.apache.org/jira/browse/LUCENE-6707
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6707.patch


 Currently they return void, so you can't chain. Returning this would make it 
 consistent with BooleanQuery.Builder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647704#comment-14647704
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693434 from [~noble.paul] in branch 'dev/trunk'
[ https://svn.apache.org/r1693434 ]

SOLR-6625: formatting fixed

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Reopened] (SOLR-7719) Suggester Component results parsing

2015-07-30 Thread Tommaso Teofili (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tommaso Teofili reopened SOLR-7719:
---

Alessandro, I'd like to backport the fix to 5.x branch in order to have this 
included in next 5.x release, thus reopening.

 Suggester Component results parsing
 ---

 Key: SOLR-7719
 URL: https://issues.apache.org/jira/browse/SOLR-7719
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: queryResponse, suggester, suggestions
 Fix For: Trunk

 Attachments: SOLR-7719.patch, SOLR-7719.patch

   Original Estimate: 24h
  Remaining Estimate: 24h

 Currently SolrJ org.apache.solr.client.solrj.response.QueryResponse is not 
 managing suggestions coming from the Suggest Component .
 It would be nice to have the suggestions properly managed and returned with 
 simply getter methods.
 Current Json :
 lst name=suggest
 lst name=dictionary1
 lst name=queryTerm
 int name=numFound2/int
 arr name=suggestions
lst
str name=termsuggestion1/str..
str name=termsuggestion2/str…
/lst
/arr
/lst
/lst..
 This will be parsed accordingly .
 Producing an easy to use Java Map.
 Dictionary2suggestions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (LUCENE-6708) TopFieldCollector sometimes calls Scorer.score() several times on the same doc

2015-07-30 Thread Adrien Grand (JIRA)
Adrien Grand created LUCENE-6708:


 Summary: TopFieldCollector sometimes calls Scorer.score() several 
times on the same doc
 Key: LUCENE-6708
 URL: https://issues.apache.org/jira/browse/LUCENE-6708
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor


If the sort spec includes a sort field that needs scores, and if trackDocScores 
or trackMaxScore is set, then TopFieldCollectors may compute the score several 
times on the same document, once to check whether the hit is competitive, and 
once to update maxScore or to set the score on the ScoreDoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6531) Make PhraseQuery immutable

2015-07-30 Thread Adrien Grand (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647699#comment-14647699
 ] 

Adrien Grand commented on LUCENE-6531:
--

Thanks Terry for catching this. This issue was discussed for BooleanQuery after 
PhraseQuery had already been checked in, and I didn't think of changing 
PhraseQuery.Builder methods to return this afterwards. I'll do it now.

 Make PhraseQuery immutable
 --

 Key: LUCENE-6531
 URL: https://issues.apache.org/jira/browse/LUCENE-6531
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Fix For: 5.3, 6.0

 Attachments: LUCENE-6531.patch, LUCENE-6531.patch


 Mutable queries are an issue for automatic filter caching since modifying a 
 query after it has been put into the cache will corrupt the cache. We should 
 make all queries immutable (up to the boost) to avoid this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6654) KNearestNeighborClassifier not taking in consideration Class ranking

2015-07-30 Thread Alessandro Benedetti (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647756#comment-14647756
 ] 

Alessandro Benedetti commented on LUCENE-6654:
--

Any feedback on this ?

Cheers

 KNearestNeighborClassifier not taking in consideration Class ranking
 

 Key: LUCENE-6654
 URL: https://issues.apache.org/jira/browse/LUCENE-6654
 Project: Lucene - Core
  Issue Type: Improvement
  Components: modules/classification
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: classification, knn
 Attachments: LUCENE-6654.patch


 Currently the KNN Classifier assign the score for a ClassificationResult, 
 based only on the frequency of the class in the top K results.
 This is conceptually a simplification.
 Actually the ranking must take a part.
 If not this can happen :
 Top 4
 1) Class1
 2) Class1
 3) Class2
 4) Class2
 As a result of this Top 4 , both the classes will have the same score.
 But the expected result is that Class1 has a better score, as the MLT score 
 the documents accordingly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Closed] (SOLR-7719) Suggester Component results parsing

2015-07-30 Thread Alessandro Benedetti (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alessandro Benedetti closed SOLR-7719.
--
Resolution: Fixed

Tommaso committed the patch involved!

 Suggester Component results parsing
 ---

 Key: SOLR-7719
 URL: https://issues.apache.org/jira/browse/SOLR-7719
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Affects Versions: 5.2.1
Reporter: Alessandro Benedetti
Assignee: Tommaso Teofili
Priority: Minor
  Labels: queryResponse, suggester, suggestions
 Fix For: Trunk

 Attachments: SOLR-7719.patch, SOLR-7719.patch

   Original Estimate: 24h
  Remaining Estimate: 24h

 Currently SolrJ org.apache.solr.client.solrj.response.QueryResponse is not 
 managing suggestions coming from the Suggest Component .
 It would be nice to have the suggestions properly managed and returned with 
 simply getter methods.
 Current Json :
 lst name=suggest
 lst name=dictionary1
 lst name=queryTerm
 int name=numFound2/int
 arr name=suggestions
lst
str name=termsuggestion1/str..
str name=termsuggestion2/str…
/lst
/arr
/lst
/lst..
 This will be parsed accordingly .
 Producing an easy to use Java Map.
 Dictionary2suggestions



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647819#comment-14647819
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693442 from [~noble.paul] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693442 ]

SOLR-6625: Enable registering interceptors for the calls made using HttpClient 
and make the request object available at the interceptor context

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648171#comment-14648171
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693484 from [~anshumg] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693484 ]

SOLR-6625: Set HttpClientImpl in SolrTestCaseJ4 for tests(merge from trunk)

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7851) Angular analysis tab tweaks

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648177#comment-14648177
 ] 

ASF subversion and git services commented on SOLR-7851:
---

Commit 1693486 from [~upayavira] in branch 'dev/trunk'
[ https://svn.apache.org/r1693486 ]

SOLR-7851 Angular analysis tab tweaks

 Angular analysis tab tweaks
 ---

 Key: SOLR-7851
 URL: https://issues.apache.org/jira/browse/SOLR-7851
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7851.patch


 The angular analysis tab lacks support for verbose and has a few other 
 issues - e.g. the schema browser link does not work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6621) two unused variables in analysis/stempel/src/java/org/egothor/stemmer/Compile.java

2015-07-30 Thread Christine Poerschke (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Christine Poerschke updated LUCENE-6621:

Summary: two unused variables in 
analysis/stempel/src/java/org/egothor/stemmer/Compile.java  (was: Unused 
variables)

 two unused variables in 
 analysis/stempel/src/java/org/egothor/stemmer/Compile.java
 --

 Key: LUCENE-6621
 URL: https://issues.apache.org/jira/browse/LUCENE-6621
 Project: Lucene - Core
  Issue Type: Bug
  Components: modules/analysis
Affects Versions: Trunk
Reporter: Rishabh Patel
Assignee: Christine Poerschke
Priority: Trivial
 Fix For: 5.3, Trunk


 {code:title=Compile.java|borderStyle=solid}
 public static void main(java.lang.String[] args) throws Exception {
 ...
   for (int i = 1; i  args.length; i++) {
   // System.out.println([ + args[i] + ]);
   Diff diff = new Diff();
   int stems = 0;
   int words = 0;
 ...
 {code}
 In the file {{Compile.java}}, the variables {{stems}} and {{words}} are 
 unused.
 Although {{words}} gets incremented further in the file, it does not get 
 referenced or used elsewhere.
 {{stems}} is neither incremented nor used elsewhere in the project.
 Are these variables redundant?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6629) Random 7200 seconds build timeouts / infinite loops in Lucene tests?

2015-07-30 Thread Michael McCandless (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648195#comment-14648195
 ] 

Michael McCandless commented on LUCENE-6629:


Maybe another example: 
https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/915/console

{noformat}
Suite: org.apache.lucene.codecs.simpletext.TestSimpleTextTermVectorsFormat
   [junit4]   2 jul 30, 2015 2:46:47 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2 WARNING: Suite execution timed out: 
org.apache.lucene.codecs.simpletext.TestSimpleTextTermVectorsFormat
   [junit4]   21) Thread[id=147, 
name=TEST-TestSimpleTextTermVectorsFormat.testRamBytesUsed-seed#[4AF0D6F4E5896BB7],
 state=RUNNABLE, group=TGRP-TestSimpleTextTermVectorsFormat]
   [junit4]   2 at 
org.apache.lucene.store.MockIndexInputWrapper.readByte(MockIndexInputWrapper.java:132)
   [junit4]   2 at 
org.apache.lucene.codecs.simpletext.SimpleTextUtil.readLine(SimpleTextUtil.java:60)
   [junit4]   2 at 
org.apache.lucene.codecs.simpletext.SimpleTextTermVectorsReader.readLine(SimpleTextTermVectorsReader.java:234)
   [junit4]   2 at 
org.apache.lucene.codecs.simpletext.SimpleTextTermVectorsReader.get(SimpleTextTermVectorsReader.java:141)
   [junit4]   2 at 
org.apache.lucene.codecs.TermVectorsWriter.merge(TermVectorsWriter.java:194)
   [junit4]   2 at 
org.apache.lucene.index.SegmentMerger.mergeVectors(SegmentMerger.java:187)
   [junit4]   2 at 
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:127)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4089)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3664)
   [junit4]   2 at 
org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1929)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4731)
   [junit4]   2 at 
org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:695)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4757)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4748)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1476)
   [junit4]   2 at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1254)
   [junit4]   2 at 
org.apache.lucene.index.BaseIndexFileFormatTestCase.testRamBytesUsed(BaseIndexFileFormatTestCase.java:260)
   [junit4]   2 at 
org.apache.lucene.index.BaseTermVectorsFormatTestCase.testRamBytesUsed(BaseTermVectorsFormatTestCase.java:74)
   [junit4]   2 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2 at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
   [junit4]   2 at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2 at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2 at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2 at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2 at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2 at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2 at 

[jira] [Commented] (SOLR-4787) Join Contrib

2015-07-30 Thread Gopal Patwa (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648285#comment-14648285
 ] 

Gopal Patwa commented on SOLR-4787:
---

if this is not committed to solr 5.x, does anyone has this join patch for solr 
5.x ?

 Join Contrib
 

 Key: SOLR-4787
 URL: https://issues.apache.org/jira/browse/SOLR-4787
 Project: Solr
  Issue Type: New Feature
  Components: search
Affects Versions: 4.2.1
Reporter: Joel Bernstein
Priority: Minor
 Fix For: Trunk

 Attachments: SOLR-4787-deadlock-fix.patch, 
 SOLR-4787-pjoin-long-keys.patch, SOLR-4787-with-testcase-fix.patch, 
 SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, 
 SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, 
 SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, 
 SOLR-4787.patch, SOLR-4787.patch, SOLR-4787.patch, 
 SOLR-4797-hjoin-multivaluekeys-nestedJoins.patch, 
 SOLR-4797-hjoin-multivaluekeys-trunk.patch


 This contrib provides a place where different join implementations can be 
 contributed to Solr. This contrib currently includes 3 join implementations. 
 The initial patch was generated from the Solr 4.3 tag. Because of changes in 
 the FieldCache API this patch will only build with Solr 4.2 or above.
 *HashSetJoinQParserPlugin aka hjoin*
 The hjoin provides a join implementation that filters results in one core 
 based on the results of a search in another core. This is similar in 
 functionality to the JoinQParserPlugin but the implementation differs in a 
 couple of important ways.
 The first way is that the hjoin is designed to work with int and long join 
 keys only. So, in order to use hjoin, int or long join keys must be included 
 in both the to and from core.
 The second difference is that the hjoin builds memory structures that are 
 used to quickly connect the join keys. So, the hjoin will need more memory 
 then the JoinQParserPlugin to perform the join.
 The main advantage of the hjoin is that it can scale to join millions of keys 
 between cores and provide sub-second response time. The hjoin should work 
 well with up to two million results from the fromIndex and tens of millions 
 of results from the main query.
 The hjoin supports the following features:
 1) Both lucene query and PostFilter implementations. A *cost*  99 will 
 turn on the PostFilter. The PostFilter will typically outperform the Lucene 
 query when the main query results have been narrowed down.
 2) With the lucene query implementation there is an option to build the 
 filter with threads. This can greatly improve the performance of the query if 
 the main query index is very large. The threads parameter turns on 
 threading. For example *threads=6* will use 6 threads to build the filter. 
 This will setup a fixed threadpool with six threads to handle all hjoin 
 requests. Once the threadpool is created the hjoin will always use it to 
 build the filter. Threading does not come into play with the PostFilter.
 3) The *size* local parameter can be used to set the initial size of the 
 hashset used to perform the join. If this is set above the number of results 
 from the fromIndex then the you can avoid hashset resizing which improves 
 performance.
 4) Nested filter queries. The local parameter fq can be used to nest a 
 filter query within the join. The nested fq will filter the results of the 
 join query. This can point to another join to support nested joins.
 5) Full caching support for the lucene query implementation. The filterCache 
 and queryResultCache should work properly even with deep nesting of joins. 
 Only the queryResultCache comes into play with the PostFilter implementation 
 because PostFilters are not cacheable in the filterCache.
 The syntax of the hjoin is similar to the JoinQParserPlugin except that the 
 plugin is referenced by the string hjoin rather then join.
 fq=\{!hjoin fromIndex=collection2 from=id_i to=id_i threads=6 
 fq=$qq\}user:customer1qq=group:5
 The example filter query above will search the fromIndex (collection2) for 
 user:customer1 applying the local fq parameter to filter the results. The 
 lucene filter query will be built using 6 threads. This query will generate a 
 list of values from the from field that will be used to filter the main 
 query. Only records from the main query, where the to field is present in 
 the from list will be included in the results.
 The solrconfig.xml in the main query core must contain the reference to the 
 hjoin.
 queryParser name=hjoin 
 class=org.apache.solr.joins.HashSetJoinQParserPlugin/
 And the join contrib lib jars must be registed in the solrconfig.xml.
  lib dir=../../../contrib/joins/lib regex=.*\.jar /
 After issuing the ant dist command from inside the solr directory the joins 
 contrib jar will 

[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648332#comment-14648332
 ] 

Steve Rowe commented on SOLR-6625:
--

I tried all of the seeds my Jenkins found today and none of them reproduce for 
me on OS X after Anshum's r1693498 commit.

Here are the ones for trunk:

{noformat}
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=F852018ABA4ECDFF -Dtests.slow=true -Dtests.locale=nl 
-Dtests.timezone=Asia/Gaza -Dtests.asserts=true -Dtests.file.encoding=UTF-8
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=36C935176479F04C -Dtests.slow=true -Dtests.locale=ar_YE 
-Dtests.timezone=Australia/Adelaide -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=D555CA223513ED3F -Dtests.slow=true -Dtests.locale=tr 
-Dtests.timezone=Antarctica/Syowa -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=C37B717A18417443 -Dtests.slow=true -Dtests.locale=bg_BG 
-Dtests.timezone=SystemV/HST10 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
{noformat}

For branch_5x/Java8:

{noformat}
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=FC64970124605306 -Dtests.slow=true -Dtests.locale=ar_LY 
-Dtests.timezone=Asia/Vientiane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=4A4BDF1F10B61D9 -Dtests.slow=true -Dtests.locale=hu_HU 
-Dtests.timezone=Pacific/Fiji -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=E4714ED097B4D0A7 -Dtests.slow=true -Dtests.locale= 
-Dtests.timezone=Etc/GMT-5 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=E0C2EF677FA5EC03 -Dtests.slow=true -Dtests.locale=it_CH 
-Dtests.timezone=America/New_York -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=7F8305E670B947FE -Dtests.slow=true -Dtests.locale=fr_CH 
-Dtests.timezone=Europe/Skopje -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=30D63D1BAD373514 -Dtests.slow=true -Dtests.locale=it 
-Dtests.timezone=America/Iqaluit -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
{noformat}

And for branch_5x/Java7:

{noformat}
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=98C4B653C6DE38C9 -Dtests.slow=true -Dtests.locale=it 
-Dtests.timezone=America/Havana -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
ant test  -Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=27A47BFC57FF783D -Dtests.slow=true -Dtests.locale=en_SG 
-Dtests.timezone=Pacific/Chatham -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
{noformat} 

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  

[jira] [Commented] (LUCENE-6621) Unused variables

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648173#comment-14648173
 ] 

ASF subversion and git services commented on LUCENE-6621:
-

Commit 1693485 from [~cpoerschke] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693485 ]

LUCENE-6621: Removed two unused variables in 
analysis/stempel/src/java/org/egothor/stemmer/Compile.java

 Unused variables
 

 Key: LUCENE-6621
 URL: https://issues.apache.org/jira/browse/LUCENE-6621
 Project: Lucene - Core
  Issue Type: Bug
  Components: modules/analysis
Affects Versions: Trunk
Reporter: Rishabh Patel
Assignee: Christine Poerschke
Priority: Trivial

 {code:title=Compile.java|borderStyle=solid}
 public static void main(java.lang.String[] args) throws Exception {
 ...
   for (int i = 1; i  args.length; i++) {
   // System.out.println([ + args[i] + ]);
   Diff diff = new Diff();
   int stems = 0;
   int words = 0;
 ...
 {code}
 In the file {{Compile.java}}, the variables {{stems}} and {{words}} are 
 unused.
 Although {{words}} gets incremented further in the file, it does not get 
 referenced or used elsewhere.
 {{stems}} is neither incremented nor used elsewhere in the project.
 Are these variables redundant?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648172#comment-14648172
 ] 

Anshum Gupta commented on SOLR-6625:


I've committed the patch as that would be required anyways. It doesn't fix the 
NPE issue though.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6621) Unused variables

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648162#comment-14648162
 ] 

ASF subversion and git services commented on LUCENE-6621:
-

Commit 1693482 from [~cpoerschke] in branch 'dev/trunk'
[ https://svn.apache.org/r1693482 ]

LUCENE-6621: Removed two unused variables in 
analysis/stempel/src/java/org/egothor/stemmer/Compile.java

 Unused variables
 

 Key: LUCENE-6621
 URL: https://issues.apache.org/jira/browse/LUCENE-6621
 Project: Lucene - Core
  Issue Type: Bug
  Components: modules/analysis
Affects Versions: Trunk
Reporter: Rishabh Patel
Assignee: Christine Poerschke
Priority: Trivial

 {code:title=Compile.java|borderStyle=solid}
 public static void main(java.lang.String[] args) throws Exception {
 ...
   for (int i = 1; i  args.length; i++) {
   // System.out.println([ + args[i] + ]);
   Diff diff = new Diff();
   int stems = 0;
   int words = 0;
 ...
 {code}
 In the file {{Compile.java}}, the variables {{stems}} and {{words}} are 
 unused.
 Although {{words}} gets incremented further in the file, it does not get 
 referenced or used elsewhere.
 {{stems}} is neither incremented nor used elsewhere in the project.
 Are these variables redundant?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6621) Unused variables

2015-07-30 Thread Christine Poerschke (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Christine Poerschke updated LUCENE-6621:

Fix Version/s: Trunk
   5.3

 Unused variables
 

 Key: LUCENE-6621
 URL: https://issues.apache.org/jira/browse/LUCENE-6621
 Project: Lucene - Core
  Issue Type: Bug
  Components: modules/analysis
Affects Versions: Trunk
Reporter: Rishabh Patel
Assignee: Christine Poerschke
Priority: Trivial
 Fix For: 5.3, Trunk


 {code:title=Compile.java|borderStyle=solid}
 public static void main(java.lang.String[] args) throws Exception {
 ...
   for (int i = 1; i  args.length; i++) {
   // System.out.println([ + args[i] + ]);
   Diff diff = new Diff();
   int stems = 0;
   int words = 0;
 ...
 {code}
 In the file {{Compile.java}}, the variables {{stems}} and {{words}} are 
 unused.
 Although {{words}} gets incremented further in the file, it does not get 
 referenced or used elsewhere.
 {{stems}} is neither incremented nor used elsewhere in the project.
 Are these variables redundant?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.7.0_80) - Build # 4956 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4956/
Java: 32bit/jdk1.7.0_80 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testAll

Error Message:
There are still nodes recoverying - waited for 30 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 30 
seconds
at 
__randomizedtesting.SeedInfo.seed([CCF5D99500A74DC2:80ABF7EC7B371207]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:834)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1391)
at 
org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testAll(StreamExpressionTest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 

[jira] [Resolved] (LUCENE-5868) JoinUtil support for NUMERIC docValues fields

2015-07-30 Thread Mikhail Khludnev (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-5868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mikhail Khludnev resolved LUCENE-5868.
--
Resolution: Won't Fix
  Assignee: Mikhail Khludnev

It seems nobody cares. Closing so far. 

 JoinUtil support for NUMERIC docValues fields 
 --

 Key: LUCENE-5868
 URL: https://issues.apache.org/jira/browse/LUCENE-5868
 Project: Lucene - Core
  Issue Type: New Feature
Reporter: Mikhail Khludnev
Assignee: Mikhail Khludnev
Priority: Minor

 while polishing SOLR-6234 I found that JoinUtil can't join int dv fields at 
 least. 
 I plan to provide test/patch. It might be important, because Solr's join can 
 do that. Please vote if you care! 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648168#comment-14648168
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693483 from [~anshumg] in branch 'dev/trunk'
[ https://svn.apache.org/r1693483 ]

SOLR-6625: Set HttpClientImpl in SolrTestCaseJ4 for tests

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-5.x-Linux (32bit/jdk1.9.0-ea-b60) - Build # 13485 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/13485/
Java: 32bit/jdk1.9.0-ea-b60 -client -XX:+UseConcMarkSweepGC 
-Djava.locale.providers=JRE,SPI

2 tests failed.
FAILED:  
org.apache.solr.client.solrj.impl.TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp

Error Message:
java.lang.NullPointerException

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: java.lang.NullPointerException
at 
__randomizedtesting.SeedInfo.seed([7D4C1691741CE71D:66A095312600C2D8]:0)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:414)
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at 
org.apache.solr.client.solrj.impl.TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp(TestCloudSolrClientConnections.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:502)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 

[jira] [Commented] (SOLR-7729) ConcurrentUpdateSolrClient ignoring the collection parameter in some methods

2015-07-30 Thread Jorge Luis Betancourt Gonzalez (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648187#comment-14648187
 ] 

Jorge Luis Betancourt Gonzalez commented on SOLR-7729:
--

I'm going to give it a try to your patch, I was also working on a fix for this, 
but I'm out on holidays :) nevertheless I'm going to give it a try. 

 ConcurrentUpdateSolrClient ignoring the collection parameter in some methods
 

 Key: SOLR-7729
 URL: https://issues.apache.org/jira/browse/SOLR-7729
 Project: Solr
  Issue Type: Bug
  Components: SolrJ
Affects Versions: 5.1
Reporter: Jorge Luis Betancourt Gonzalez
  Labels: client, solrj
 Attachments: SOLR-7729-ConcurrentUpdateSolrClient-collection.patch


 Some of the methods in {{ConcurrentUpdateSolrClient}} accept an aditional 
 {{collection}} parameter, some of this methods are: {{add(String collection, 
 SolrInputDocument doc)}} and {{request(SolrRequest, String collection)}}. 
 This collection parameter is being ignored in this cases but works for others 
 like {{commit(String collection)}}.
 [~elyograg] noted that:
 {quote} 
 Looking into how an update request actually gets added to the background
 queue in ConcurrentUpdateSolrClient, it appears that the collection
 information is ignored before the request is added to the queue.
 {quote}
 From the source, when a commit is issued or the 
 {{UpdateParams.WAIT_SEARCHER}} is set in the request params the collection 
 parameter is used, otherwise the request {{UpdateRequest req}} is queued 
 without any regarding of the collection.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: cwiki.a.org edit right for mkhludnev

2015-07-30 Thread Steve Rowe
Hi Mikhail,

I’ve added you here: 
https://cwiki.apache.org/confluence/spaces/spacepermissions.action?key=solr - 
you should now have edit rights.

Steve

 On Jul 30, 2015, at 3:42 PM, Mikhail Khludnev mkhlud...@griddynamics.com 
 wrote:
 
 Hello,
 Would you let mkhludnev (not mkhl) to edit 
 https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide 
 ? 
 Thanks!
 
 -- 
 Sincerely yours
 Mikhail Khludnev
 Principal Engineer,
 Grid Dynamics
 
 


-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-7852) Angular main tab does not collapse cores menu

2015-07-30 Thread Upayavira (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Upayavira updated SOLR-7852:

Attachment: SOLR-7852.patch

trivial fix

 Angular main tab does not collapse cores menu
 -

 Key: SOLR-7852
 URL: https://issues.apache.org/jira/browse/SOLR-7852
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7852.patch


 A previous fix resolved the issue where main menu tabs (java properties, 
 logging, core admin/etc) where not hiding the per-core menu when clicked. 
 The fix was not applied to the topmost link.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (LUCENE-6702) [suggest] Make Context Query and Field extensible

2015-07-30 Thread Areek Zillur (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Areek Zillur resolved LUCENE-6702.
--
Resolution: Fixed

 [suggest] Make Context Query and Field extensible
 -

 Key: LUCENE-6702
 URL: https://issues.apache.org/jira/browse/LUCENE-6702
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/other
Affects Versions: Trunk
Reporter: Areek Zillur
Assignee: Areek Zillur
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6702.patch, LUCENE-6702.patch


 ContextSuggestField indexes context information along with 
 suggestions, which can be used to filter and/or boost suggestions using 
 ContextQuery.
 It would be useful to make ContextSuggestField extensible such that 
 subclasses 
 can inject context values at index-time, without having to specify the 
 contexts in its ctor.
 ContextQuery can be made extensible by allowing sub-classes to override
 how context automaton is created from provided query contexts. 
 Currently, ContextQuery uses a context value of * to consider all context 
 values, 
 It makes sense to have a dedicated {{addAllContexts()}} instead.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648280#comment-14648280
 ] 

Anshum Gupta commented on SOLR-6625:


That looks like it should have been interfering and would solve the problem. 
I'll commit this.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7851) Angular analysis tab tweaks

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648199#comment-14648199
 ] 

ASF subversion and git services commented on SOLR-7851:
---

Commit 1693489 from [~upayavira] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693489 ]

SOLR-7851 Angular analysis tab tweaks

 Angular analysis tab tweaks
 ---

 Key: SOLR-7851
 URL: https://issues.apache.org/jira/browse/SOLR-7851
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7851.patch


 The angular analysis tab lacks support for verbose and has a few other 
 issues - e.g. the schema browser link does not work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_51) - Build # 5084 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/5084/
Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testAll

Error Message:
There are still nodes recoverying - waited for 30 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 30 
seconds
at 
__randomizedtesting.SeedInfo.seed([537BF64616D14F4B:1F25D83F6D41108E]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:834)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1391)
at 
org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testAll(StreamExpressionTest.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 

[jira] [Created] (SOLR-7852) Angular main tab does not collapse cores menu

2015-07-30 Thread Upayavira (JIRA)
Upayavira created SOLR-7852:
---

 Summary: Angular main tab does not collapse cores menu
 Key: SOLR-7852
 URL: https://issues.apache.org/jira/browse/SOLR-7852
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3


A previous fix resolved the issue where main menu tabs (java properties, 
logging, core admin/etc) where not hiding the per-core menu when clicked. 

The fix was not applied to the topmost link.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6702) [suggest] Make Context Query and Field extensible

2015-07-30 Thread Areek Zillur (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Areek Zillur updated LUCENE-6702:
-
Fix Version/s: 5.3

 [suggest] Make Context Query and Field extensible
 -

 Key: LUCENE-6702
 URL: https://issues.apache.org/jira/browse/LUCENE-6702
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/other
Affects Versions: Trunk
Reporter: Areek Zillur
Assignee: Areek Zillur
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6702.patch, LUCENE-6702.patch


 ContextSuggestField indexes context information along with 
 suggestions, which can be used to filter and/or boost suggestions using 
 ContextQuery.
 It would be useful to make ContextSuggestField extensible such that 
 subclasses 
 can inject context values at index-time, without having to specify the 
 contexts in its ctor.
 ContextQuery can be made extensible by allowing sub-classes to override
 how context automaton is created from provided query contexts. 
 Currently, ContextQuery uses a context value of * to consider all context 
 values, 
 It makes sense to have a dedicated {{addAllContexts()}} instead.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6702) [suggest] Make Context Query and Field extensible

2015-07-30 Thread Areek Zillur (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648239#comment-14648239
 ] 

Areek Zillur commented on LUCENE-6702:
--

Thanks [~mikemccand] for the review!

 [suggest] Make Context Query and Field extensible
 -

 Key: LUCENE-6702
 URL: https://issues.apache.org/jira/browse/LUCENE-6702
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/other
Affects Versions: Trunk
Reporter: Areek Zillur
Assignee: Areek Zillur
 Fix For: 5.3, Trunk

 Attachments: LUCENE-6702.patch, LUCENE-6702.patch


 ContextSuggestField indexes context information along with 
 suggestions, which can be used to filter and/or boost suggestions using 
 ContextQuery.
 It would be useful to make ContextSuggestField extensible such that 
 subclasses 
 can inject context values at index-time, without having to specify the 
 contexts in its ctor.
 ContextQuery can be made extensible by allowing sub-classes to override
 how context automaton is created from provided query contexts. 
 Currently, ContextQuery uses a context value of * to consider all context 
 values, 
 It makes sense to have a dedicated {{addAllContexts()}} instead.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648288#comment-14648288
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693497 from [~anshumg] in branch 'dev/trunk'
[ https://svn.apache.org/r1693497 ]

SOLR-6625: Remove RequestInterceptor at the end of the test in 
BasicHttpSolrClientTest. It was interfering with other tests running the same 
JVM.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS] Lucene-Solr-Tests-trunk-Java8 - Build # 252 - Failure

2015-07-30 Thread Apache Jenkins Server
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java8/252/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
expected:0 but was:1

Stack Trace:
java.lang.AssertionError: expected:0 but was:1
at 
__randomizedtesting.SeedInfo.seed([B1F9B6FF303C45E4:39AD89259EC0281C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at 
org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:156)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 

[jira] [Commented] (SOLR-6234) Scoring modes for query time join

2015-07-30 Thread Mikhail Khludnev (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648326#comment-14648326
 ] 

Mikhail Khludnev commented on SOLR-6234:


[~jpountz][~thetaphi] thanks for your help!
[~thelabdude],[~ctargett], I hit cwiki, would you mind to check:
* 
https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=32604257selectedPageVersions=50selectedPageVersions=49
* 
https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=32604277selectedPageVersions=71selectedPageVersions=70


 Scoring modes for query time join 
 --

 Key: SOLR-6234
 URL: https://issues.apache.org/jira/browse/SOLR-6234
 Project: Solr
  Issue Type: New Feature
  Components: query parsers
Affects Versions: 5.3
Reporter: Mikhail Khludnev
Assignee: Mikhail Khludnev
  Labels: features, patch, test
 Fix For: 5.3

 Attachments: SOLR-6234-javadocsfix.patch, SOLR-6234.patch, 
 SOLR-6234.patch, SOLR-6234.patch, SOLR-6234.patch, SOLR-6234.patch, 
 SOLR-6234.patch, SOLR-6234.patch, otherHandler.patch


 it adds ability to call Lucene's JoinUtil by specifying local param, ie  
 \{!join score=...} It supports:
 - {{score=none|avg|max|total}} local param (passed as ScoreMode to JoinUtil)
 - -supports {{b=100}} param to pass {{Query.setBoost()}}- postponed till 
 SOLR-7814.
 - -{{multiVals=true|false}} is introduced- YAGNI, let me know otherwise. 
 - there is a test coverage for cross core join case. 
 - so far it joins string and multivalue string fields (Sorted, SortedSet, 
 Binary), but not Numerics DVs. follow-up LUCENE-5868  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7852) Angular main tab does not collapse cores menu

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648212#comment-14648212
 ] 

ASF subversion and git services commented on SOLR-7852:
---

Commit 1693490 from [~upayavira] in branch 'dev/trunk'
[ https://svn.apache.org/r1693490 ]

SOLR-7852 Hide cores menu when dashboard link clicked

 Angular main tab does not collapse cores menu
 -

 Key: SOLR-7852
 URL: https://issues.apache.org/jira/browse/SOLR-7852
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7852.patch


 A previous fix resolved the issue where main menu tabs (java properties, 
 logging, core admin/etc) where not hiding the per-core menu when clicked. 
 The fix was not applied to the topmost link.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b60) - Build # 13666 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13666/
Java: 64bit/jdk1.9.0-ea-b60 -XX:+UseCompressedOops -XX:+UseSerialGC 
-Djava.locale.providers=JRE,SPI

1 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamingTest.streamTests

Error Message:
There are still nodes recoverying - waited for 30 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 30 
seconds
at 
__randomizedtesting.SeedInfo.seed([26626501524AFACF:DA394285F86303BA]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:834)
at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1391)
at 
org.apache.solr.client.solrj.io.stream.StreamingTest.streamTests(StreamingTest.java:1059)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:502)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 

[jira] [Updated] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Ishan Chattopadhyaya (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ishan Chattopadhyaya updated SOLR-6625:
---
Attachment: SOLR-6625-testfix.patch

Removing the interceptors that were added during the BasicHttpSolrClientTest. 
This was interfering with the other tests, viz. TestSolrCloudClientConnections.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



cwiki.a.org edit right for mkhludnev

2015-07-30 Thread Mikhail Khludnev
Hello,
Would you let mkhludnev (not mkhl) to edit
https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide
?
Thanks!

-- 
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dynamics

http://www.griddynamics.com
mkhlud...@griddynamics.com


[jira] [Resolved] (SOLR-7851) Angular analysis tab tweaks

2015-07-30 Thread Upayavira (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Upayavira resolved SOLR-7851.
-
Resolution: Fixed

 Angular analysis tab tweaks
 ---

 Key: SOLR-7851
 URL: https://issues.apache.org/jira/browse/SOLR-7851
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7851.patch


 The angular analysis tab lacks support for verbose and has a few other 
 issues - e.g. the schema browser link does not work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7852) Angular main tab does not collapse cores menu

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648214#comment-14648214
 ] 

ASF subversion and git services commented on SOLR-7852:
---

Commit 1693491 from [~upayavira] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693491 ]

SOLR-7852 Hide cores menu when dashboard link clicked

 Angular main tab does not collapse cores menu
 -

 Key: SOLR-7852
 URL: https://issues.apache.org/jira/browse/SOLR-7852
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7852.patch


 A previous fix resolved the issue where main menu tabs (java properties, 
 logging, core admin/etc) where not hiding the per-core menu when clicked. 
 The fix was not applied to the topmost link.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6702) [suggest] Make Context Query and Field extensible

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648228#comment-14648228
 ] 

ASF subversion and git services commented on LUCENE-6702:
-

Commit 1693493 from [~areek] in branch 'dev/trunk'
[ https://svn.apache.org/r1693493 ]

LUCENE-6702: Add a method to inject context values at index time in 
ContextSuggestField and simplify ContextQuery and add dedicated method to 
consider all contexts at query time

 [suggest] Make Context Query and Field extensible
 -

 Key: LUCENE-6702
 URL: https://issues.apache.org/jira/browse/LUCENE-6702
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/other
Affects Versions: Trunk
Reporter: Areek Zillur
Assignee: Areek Zillur
 Fix For: Trunk

 Attachments: LUCENE-6702.patch, LUCENE-6702.patch


 ContextSuggestField indexes context information along with 
 suggestions, which can be used to filter and/or boost suggestions using 
 ContextQuery.
 It would be useful to make ContextSuggestField extensible such that 
 subclasses 
 can inject context values at index-time, without having to specify the 
 contexts in its ctor.
 ContextQuery can be made extensible by allowing sub-classes to override
 how context automaton is created from provided query contexts. 
 Currently, ContextQuery uses a context value of * to consider all context 
 values, 
 It makes sense to have a dedicated {{addAllContexts()}} instead.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-7852) Angular main tab does not collapse cores menu

2015-07-30 Thread Upayavira (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Upayavira resolved SOLR-7852.
-
Resolution: Fixed

 Angular main tab does not collapse cores menu
 -

 Key: SOLR-7852
 URL: https://issues.apache.org/jira/browse/SOLR-7852
 Project: Solr
  Issue Type: Bug
  Components: web gui
Affects Versions: 5.2.1
Reporter: Upayavira
Assignee: Upayavira
Priority: Minor
 Fix For: 5.3

 Attachments: SOLR-7852.patch


 A previous fix resolved the issue where main menu tabs (java properties, 
 logging, core admin/etc) where not hiding the per-core menu when clicked. 
 The fix was not applied to the topmost link.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648345#comment-14648345
 ] 

Anshum Gupta commented on SOLR-6625:


Thanks for confirming that Steve.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Resolved] (SOLR-7808) MorphlineGoLiveMiniMRTest fails using YARN

2015-07-30 Thread Mike Drob (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mike Drob resolved SOLR-7808.
-
Resolution: Cannot Reproduce

No longer seems to be an issue... some other change in the past 2 weeks might 
have taken care of it.

 MorphlineGoLiveMiniMRTest fails using YARN
 --

 Key: SOLR-7808
 URL: https://issues.apache.org/jira/browse/SOLR-7808
 Project: Solr
  Issue Type: Bug
  Components: contrib - MapReduce
Reporter: Mike Drob

 {noformat}
[junit4] Throwable #1: java.io.IOException: Failed on local 
 exception: java.io.IOException: Connection reset by peer; Host Details : 
 local host is: drob-rhel/172.25.10.46; destination host is: 
 drob-rhel:52807; 
[junit4]  at 
 __randomizedtesting.SeedInfo.seed([4D93EC191980246A:C5C7D3C3B77C4992]:0)
[junit4]  at 
 org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
[junit4]  at org.apache.hadoop.ipc.Client.call(Client.java:1472)
[junit4]  at org.apache.hadoop.ipc.Client.call(Client.java:1399)
[junit4]  at 
 org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
[junit4]  at com.sun.proxy.$Proxy111.getClusterMetrics(Unknown 
 Source)
[junit4]  at 
 org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
[junit4]  at 
 org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
[junit4]  at 
 org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
[junit4]  at com.sun.proxy.$Proxy112.getClusterMetrics(Unknown 
 Source)
[junit4]  at 
 org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
[junit4]  at 
 org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
[junit4]  at 
 org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
[junit4]  at 
 org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
[junit4]  at 
 org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
[junit4]  at 
 org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
[junit4]  at java.security.AccessController.doPrivileged(Native 
 Method)
[junit4]  at javax.security.auth.Subject.doAs(Subject.java:422)
[junit4]  at 
 org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
[junit4]  at 
 org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
[junit4]  at 
 org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
[junit4]  at 
 org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
[junit4]  at 
 org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
[junit4]  at 
 org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:400)
[junit4]  at 
 org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4]  at 
 org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4]  at java.lang.Thread.run(Thread.java:745)
[junit4] Caused by: java.io.IOException: Connection reset by peer
[junit4]  at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
[junit4]  at 
 sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
[junit4]  at 
 sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
[junit4]  at sun.nio.ch.IOUtil.write(IOUtil.java:65)
[junit4]  at 
 sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
[junit4]  at 
 org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:63)
[junit4]  at 
 org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
[junit4]  at 
 org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:159)
[junit4]  at 
 org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:117)
[junit4]  at 
 java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
[junit4]  at 
 java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
[junit4]  at 
 java.io.DataOutputStream.flush(DataOutputStream.java:123)
[junit4]  at 
 org.apache.hadoop.ipc.Client$Connection$3.run(Client.java:1030)
[junit4] 

[jira] [Commented] (LUCENE-6702) [suggest] Make Context Query and Field extensible

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648231#comment-14648231
 ] 

ASF subversion and git services commented on LUCENE-6702:
-

Commit 1693494 from [~areek] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693494 ]

LUCENE-6702: Add a method to inject context values at index time in 
ContextSuggestField and simplify ContextQuery and add dedicated method to 
consider all contexts at query time

 [suggest] Make Context Query and Field extensible
 -

 Key: LUCENE-6702
 URL: https://issues.apache.org/jira/browse/LUCENE-6702
 Project: Lucene - Core
  Issue Type: Improvement
  Components: core/other
Affects Versions: Trunk
Reporter: Areek Zillur
Assignee: Areek Zillur
 Fix For: Trunk

 Attachments: LUCENE-6702.patch, LUCENE-6702.patch


 ContextSuggestField indexes context information along with 
 suggestions, which can be used to filter and/or boost suggestions using 
 ContextQuery.
 It would be useful to make ContextSuggestField extensible such that 
 subclasses 
 can inject context values at index-time, without having to specify the 
 contexts in its ctor.
 ContextQuery can be made extensible by allowing sub-classes to override
 how context automaton is created from provided query contexts. 
 Currently, ContextQuery uses a context value of * to consider all context 
 values, 
 It makes sense to have a dedicated {{addAllContexts()}} instead.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648289#comment-14648289
 ] 

ASF subversion and git services commented on SOLR-6625:
---

Commit 1693498 from [~anshumg] in branch 'dev/branches/branch_5x'
[ https://svn.apache.org/r1693498 ]

SOLR-6625: Remove RequestInterceptor at the end of the test in 
BasicHttpSolrClientTest. It was interfering with other tests running the same 
JVM.(merge from trunk)

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-2522) add syntax for selecting the min or max of a multivalued field in value source functions

2015-07-30 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man updated SOLR-2522:
---
Description: 
Initial request...

bq. Switch max() and min() functions to work on multiValued fields so we can 
do sort=min(fieldname) asc and the sort would work on multiValued fields...

...this specific syntax has been spun off into SOLR-7853, but the underlying 
functionality s being implemented here using a new optional second argument to 
the {{field()}} function: {{field(multivalued_field_name,min)}} and 
{{field(multivalued_field_name,max)}}.


  was:
Switch max() and min() functions to work on multiValued fields so we can 
do sort=min(fieldname) asc and the sort would work on multiValued fields...



Summary: add syntax for selecting the min or max of a multivalued field 
in value source functions  (was: Change max() and min() to work on multiValued 
fields )

 add syntax for selecting the min or max of a multivalued field in value 
 source functions
 

 Key: SOLR-2522
 URL: https://issues.apache.org/jira/browse/SOLR-2522
 Project: Solr
  Issue Type: Improvement
Reporter: Bill Bell
Assignee: Hoss Man
 Attachments: SOLR-2522.patch, SOLR-2522.patch, SOLR-2522.patch


 Initial request...
 bq. Switch max() and min() functions to work on multiValued fields so we can 
 do sort=min(fieldname) asc and the sort would work on multiValued fields...
 ...this specific syntax has been spun off into SOLR-7853, but the underlying 
 functionality s being implemented here using a new optional second argument 
 to the {{field()}} function: {{field(multivalued_field_name,min)}} and 
 {{field(multivalued_field_name,max)}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5756) A utility API to move collections from internal to external

2015-07-30 Thread Scott Blum (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648469#comment-14648469
 ] 

Scott Blum commented on SOLR-5756:
--

Also, what branch should I be working against?  I have something in a basically 
working state I'd like feedback on.

 A utility API to move collections from internal to external
 ---

 Key: SOLR-5756
 URL: https://issues.apache.org/jira/browse/SOLR-5756
 Project: Solr
  Issue Type: Bug
Reporter: Noble Paul
Assignee: Noble Paul

 SOLR-5473 allows creation of collection with state stored outside of 
 clusterstate.json. We would need an API to  move existing 'internal' 
 collections outside



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13667 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13667/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
Didn't see replicas [core_node1, core_node3] come up within 9 ms! 
ClusterState: DocCollection(c8n_1x3_lf)={   replicationFactor:3,   
shards:{shard1:{   range:8000-7fff,   state:active, 
  replicas:{ core_node1:{   
core:c8n_1x3_lf_shard1_replica2,   
base_url:http://127.0.0.1:42710/_tg;,   
node_name:127.0.0.1:42710__tg,   state:recovering}, 
core_node2:{   core:c8n_1x3_lf_shard1_replica1,   
base_url:http://127.0.0.1:38967/_tg;,   
node_name:127.0.0.1:38967__tg,   state:down}, 
core_node3:{   core:c8n_1x3_lf_shard1_replica3,   
base_url:http://127.0.0.1:57256/_tg;,   
node_name:127.0.0.1:57256__tg,   state:active,   
leader:true,   router:{name:compositeId},   
maxShardsPerNode:1,   autoAddReplicas:false}

Stack Trace:
java.lang.AssertionError: Didn't see replicas [core_node1, core_node3] come up 
within 9 ms! ClusterState: DocCollection(c8n_1x3_lf)={
  replicationFactor:3,
  shards:{shard1:{
  range:8000-7fff,
  state:active,
  replicas:{
core_node1:{
  core:c8n_1x3_lf_shard1_replica2,
  base_url:http://127.0.0.1:42710/_tg;,
  node_name:127.0.0.1:42710__tg,
  state:recovering},
core_node2:{
  core:c8n_1x3_lf_shard1_replica1,
  base_url:http://127.0.0.1:38967/_tg;,
  node_name:127.0.0.1:38967__tg,
  state:down},
core_node3:{
  core:c8n_1x3_lf_shard1_replica3,
  base_url:http://127.0.0.1:57256/_tg;,
  node_name:127.0.0.1:57256__tg,
  state:active,
  leader:true,
  router:{name:compositeId},
  maxShardsPerNode:1,
  autoAddReplicas:false}
at 
__randomizedtesting.SeedInfo.seed([F286CE0F22D44ACD:7AD2F1D58C282735]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.cloud.HttpPartitionTest.waitToSeeReplicasActive(HttpPartitionTest.java:565)
at 
org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:178)
at 
org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:966)
at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:941)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at 

[jira] [Commented] (SOLR-7853) support min(multivalued_field_name) and max(multivalued_field_name) syntax

2015-07-30 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648602#comment-14648602
 ] 

Hoss Man commented on SOLR-7853:


My Comments from SOLR-2522...


{quote}
The root complexity is that the ValueSourceParsers all delegate to 
FunctionQParser.parseValueSource() (or parseValueSourceList()) when expecting 
an argument that can be an arbitrary (nested) ValueSource -- this is how min  
max work now.  FQP.parseValueSource() handles the logic of figuring out what 
hte argument is (literal, nested function, $variable, field name, etc...) and 
if it's a field name, calls {{f.getType().getValueSource(f, this)}} on the 
associated SchemaField -- which for multivalued fields throws an exception that 
gets propogated up.

My initial thinking was that i could refactor parseValueSource() to support 
another flag for either specifying the MultiValueSelector, or indicating that 
we want a defered evaluation of the underlying SchemaFields (ie: return some 
mock FieldBasedValueSource that doesn't call FieldType.getValueSource until 
used, so the min/max functions can explicitly call getSingleValueSource() 
instead if they encounter a single argument) but then i realized that because 
of how FunctionQParser deals with $variable derefrencing -- and the QParser 
abstraction (variables might refer to other queries, which get automatically 
unwrapped if they are FunctionQueries) then even that type of refacotring 
solution wouldn't work in simple use cases like this...

{noformat}
...
 fl=id,min($my_f)
 my_f=some_multi_valued_field_name
{noformat}

So I'm going to punt on getting the {{min(some_multi_valued_field_name)}} (and 
{{max(some_multi_valued_field_name)}}) syntax working, and leave that as a 
usibillitiy improvement for the future.
{quote}

 support min(multivalued_field_name) and max(multivalued_field_name) syntax
 --

 Key: SOLR-7853
 URL: https://issues.apache.org/jira/browse/SOLR-7853
 Project: Solr
  Issue Type: Improvement
Reporter: Hoss Man

 The changes in SOLR-2522 are adding support for using 
 {{field(field_name,'min')}} and {{field(field_name,'max')}} as a way to use 
 the min/max of a multivalued docvalues field in functions at query time.
 The ideal syntax would be to support this as a varient on the existing 
 {{min()}} and {{max()}} functions -- which would be more intuitive for users, 
 but getting this to work is non trivial, so it's been split out as a distinct 
 issue for future improvement.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-2522) Change max() and min() to work on multiValued fields

2015-07-30 Thread Hoss Man (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hoss Man updated SOLR-2522:
---
Attachment: SOLR-2522.patch


This patch cleans up the remaining nocommits in the test (ie: adding randomized 
tests and tests for good errors in unsupported situations).

I plan on committing  backporting tommorow unless anyone has any concerns


 Change max() and min() to work on multiValued fields 
 -

 Key: SOLR-2522
 URL: https://issues.apache.org/jira/browse/SOLR-2522
 Project: Solr
  Issue Type: Improvement
Reporter: Bill Bell
Assignee: Hoss Man
 Attachments: SOLR-2522.patch, SOLR-2522.patch, SOLR-2522.patch


 Switch max() and min() functions to work on multiValued fields so we can 
 do sort=min(fieldname) asc and the sort would work on multiValued fields...



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (SOLR-7853) support min(multivalued_field_name) and max(multivalued_field_name) syntax

2015-07-30 Thread Hoss Man (JIRA)
Hoss Man created SOLR-7853:
--

 Summary: support min(multivalued_field_name) and 
max(multivalued_field_name) syntax
 Key: SOLR-7853
 URL: https://issues.apache.org/jira/browse/SOLR-7853
 Project: Solr
  Issue Type: Improvement
Reporter: Hoss Man


The changes in SOLR-2522 are adding support for using 
{{field(field_name,'min')}} and {{field(field_name,'max')}} as a way to use the 
min/max of a multivalued docvalues field in functions at query time.

The ideal syntax would be to support this as a varient on the existing 
{{min()}} and {{max()}} functions -- which would be more intuitive for users, 
but getting this to work is non trivial, so it's been split out as a distinct 
issue for future improvement.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-5756) A utility API to move collections from internal to external

2015-07-30 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648608#comment-14648608
 ] 

Anshum Gupta commented on SOLR-5756:


[~dragonsinth] people generally work on trunk and then merge/backport it to 
branch_5x.

 A utility API to move collections from internal to external
 ---

 Key: SOLR-5756
 URL: https://issues.apache.org/jira/browse/SOLR-5756
 Project: Solr
  Issue Type: Bug
Reporter: Noble Paul
Assignee: Noble Paul

 SOLR-5473 allows creation of collection with state stored outside of 
 clusterstate.json. We would need an API to  move existing 'internal' 
 collections outside



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[JENKINS-EA] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_60-ea-b24) - Build # 13670 - Failure!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13670/
Java: 32bit/jdk1.8.0_60-ea-b24 -client -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.TestDistributedSearch.test

Error Message:
Error from server at https://127.0.0.1:59243//collection1: 
java.lang.NullPointerException  at 
org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:42)
  at 
org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:748)
  at 
org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:731)
  at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:410)
  at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2068)  at 
org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:649)  at 
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:453)  at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:229)
  at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:198)
  at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
  at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
  at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
  at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)  
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)  at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
  at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) 
 at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
  at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
  at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)  
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
  at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
  at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)  
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)  
at org.eclipse.jetty.server.Server.handle(Server.java:499)  at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)  at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)  at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)  at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
  at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) 
 at java.lang.Thread.run(Thread.java:745) 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:59243//collection1: 
java.lang.NullPointerException
at 
org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:42)
at 
org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:748)
at 
org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:731)
at 
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:410)
at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2068)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:649)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:453)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:229)
at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:198)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at 

[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13671 - Still Failing!

2015-07-30 Thread Policeman Jenkins Server
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13671/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:+UseCompressedOops -XX:+UseParallelGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ERROR: SolrIndexSearcher opens=51 closes=50

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)
at org.junit.Assert.fail(Assert.java:93)
at 
org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:472)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 1) 
Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, 
group=TGRP-TestLazyCores] at sun.misc.Unsafe.park(Native Method)
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) 
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
 at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) 
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
  at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:1) 
Thread[id=5416, 

[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Anshum Gupta (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648129#comment-14648129
 ] 

Anshum Gupta commented on SOLR-6625:


I think in LBHttpSolrClient.java (L326)
{code}
HttpSolrClient client = makeSolrClient(serverStr);
{code}

for some reason fails to instantiate and return the SolrClient. Could be 
because of systemDefaultHttpClientClass being not set for 
HttpClientUtil.createHttpClient to construct the client.

Noble/Ishan: can you take a look? If there are a lot more test failures @ 
Jenkins, I suggest it'd be better to Ignore the test while actively working on 
a fix.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-7795) Fold Interval Faceting into Range Faceting

2015-07-30 Thread Zack Liang (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647273#comment-14647273
 ] 

Zack Liang commented on SOLR-7795:
--

I prevented both of them to be used at the same time for the same field in case 
people misuse facet.range.set with other range params. I think we could support 
both in the same request, but the documentation will need to be clear that 
facet.range.set does not use any range param. I'll look into this.

For the response syntax, I was thinking of bringing this feature without 
modifying too much code so I made use of the previous syntax. I agree it is 
confusing, and I am glad to fix it.

Thanks for your feedback, Tomás! 

 Fold Interval Faceting into Range Faceting
 --

 Key: SOLR-7795
 URL: https://issues.apache.org/jira/browse/SOLR-7795
 Project: Solr
  Issue Type: Task
Reporter: Tomás Fernández Löbbe
 Fix For: 5.3, Trunk


 Now that range faceting supports a filter and a dv method, and that 
 interval faceting is supported on fields with {{docValues=false}}, I think we 
 should make it so that interval faceting is just a different way of 
 specifying ranges in range faceting, allowing users to indicate specific 
 ranges.
 I propose we use the same syntax for intervals, but under the range 
 parameter family:
 {noformat}
 facet.range=price
 f.price.facet.range.set=[0,10]
 f.price.facet.range.set=(10,100]
 {noformat}
 The counts for those ranges would come in the response also inside of the 
 range_facets section. I'm not sure if it's better to include the ranges in 
 the counts section, or in a different section (intervals?sets?buckets?). 
 I'm open to suggestions. 
 {code}
 facet_ranges:{
   price:{
 counts:[
   [0,10],3,
   (10,100],2]
}
 }
 {code}
 or…
 {code}
 facet_ranges:{
   price:{
 intervals:[
   [0,10],3,
   (10,100],2]
}
 }
 {code}
 We should support people specifying both things on the same field.
 Once this is done, interval faceting could be deprecated, as all it's 
 functionality is now possible through range queries. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Ishan Chattopadhyaya (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ishan Chattopadhyaya updated SOLR-6625:
---
Attachment: SOLR-6625_interceptor.patch

Updated the patch, using the SolrRequestInfo from previous patch (thanks 
[~noble.paul]). Now, instead of enforcing httpclient.execute(req, context), 
added a SolrHttpClient (and within it SolrDefaultHttpClient and 
SolrSystemDefaultHttpClient) that adds the request object from the 
SolrRequestInfo into an overridden execute() method transparently.

[~noble.paul], in your previous patch (the SolrRequestInfo part), there are a 
few exceptions/assertions logged:
{noformat}
6564 ERROR (searcherExecutor-17-thread-1-processing-x:collection1 
snapshot.20150730163745674 
//tmp//solr.handler.TestRestoreCore_21A69B2D533EDA15-001//tempDir-002 
collection1) [x:collection1] o.a.s.c.SolrCore Previous SolrRequestInfo was 
not closed!  
req=location=/tmp/solr.handler.TestRestoreCore_21A69B2D533EDA15-001/tempDir-002command=restore
6564 ERROR (searcherExecutor-17-thread-1-processing-x:collection1 
snapshot.20150730163745674 
//tmp//solr.handler.TestRestoreCore_21A69B2D533EDA15-001//tempDir-002 
collection1) [x:collection1] o.a.s.c.SolrCore java.lang.AssertionError
at 
org.apache.solr.request.SolrRequestInfo.setRequestInfo(SolrRequestInfo.java:58)
at 
org.apache.solr.search.SolrIndexSearcher.warm(SolrIndexSearcher.java:2206)
at org.apache.solr.core.SolrCore$4.call(SolrCore.java:1817)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:198)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}
Can you please have look at it? I've included it as is in this current patch, 
and haven't looked into why this is happening, since the tests are passing 
anyway.

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Gregory Chanan
Priority: Minor
 Attachments: SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



Re: Strange comment in CdcrReplicationHandlerTest.java

2015-07-30 Thread Renaud Delbru
Yes, my apologies for this, I didn't catch this one when I reviewed the 
code before commit.

--
Renaud Delbru

On 29/07/15 23:29, Erick Erickson wrote:

Standard apache license, this was just a couple of erroneous lines at the top,
I suspect auto-added to by his IDE, I messed it too.

Will fix this in the next week, I'm traveling right now.

To Whit.

/*
  * Licensed to the Apache Software Foundation (ASF) under one or more
  * contributor license agreements.  See the NOTICE file distributed with
  * this work for additional information regarding copyright ownership.
  * The ASF licenses this file to You under the Apache License, Version 2.0
  * (the License); you may not use this file except in compliance with
  * the License.  You may obtain a copy of the License at
  *
  * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
  * distributed under the License is distributed on an AS IS BASIS,
  * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  * See the License for the specific language governing permissions and
  * limitations under the License.
  */

On Wed, Jul 29, 2015 at 4:27 PM, Uwe Schindler u...@thetaphi.de wrote:

RAT would only fail if the license header is missing completely. I don't think it checks 
for copyright notices.

If there is no license header, we should check our RAT config! What does it 
list as license for that file?

Uwe

-
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de
eMail: u...@thetaphi.de



-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com]
Sent: Wednesday, July 29, 2015 7:36 PM
To: dev@lucene.apache.org
Subject: Re: Strange comment in CdcrReplicationHandlerTest.java

Yeah, I wondered that myself.

On Wed, Jul 29, 2015 at 1:35 PM, Ramkumar R. Aiyengar
andyetitmo...@gmail.com wrote:

Hmm.. I would have expected rat to fail this in precommit actually..

On 29 Jul 2015 18:01, Timothy Potter thelabd...@gmail.com wrote:


Why is this in the code?

/**
  * Copyright (c) 2015 Renaud Delbru. All Rights Reserved.
  */
package org.apache.solr.cloud;

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For
additional commands, e-mail: dev-h...@lucene.apache.org





-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional
commands, e-mail: dev-h...@lucene.apache.org



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org




-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6707) PhraseQuery.Builder methods should return this to allow chaining

2015-07-30 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647863#comment-14647863
 ] 

ASF subversion and git services commented on LUCENE-6707:
-

Commit 1693448 from [~jpountz] in branch 'dev/trunk'
[ https://svn.apache.org/r1693448 ]

LUCENE-6707: Make PhraseQuery.Builder methods return this to allow chaining.

 PhraseQuery.Builder methods should return this to allow chaining
 

 Key: LUCENE-6707
 URL: https://issues.apache.org/jira/browse/LUCENE-6707
 Project: Lucene - Core
  Issue Type: Bug
Reporter: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6707.patch


 Currently they return void, so you can't chain. Returning this would make it 
 consistent with BooleanQuery.Builder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Steve Rowe (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647874#comment-14647874
 ] 

Steve Rowe commented on SOLR-6625:
--

I'm seeing reproducible {{TestCloudSolrClientConnections}} failures on trunk 
and branch_5x on my Jenkins after commits on this issue.  Here's the trunk one 
([http://jenkins.sarowe.net/job/Lucene-Solr-tests-trunk/1152/]):

{noformat}
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=C37B717A18417443 -Dtests.slow=true -Dtests.locale=bg_BG 
-Dtests.timezone=SystemV/HST10 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   7.12s J1 | 
TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp 
   [junit4] Throwable #1: org.apache.solr.common.SolrException: A 
SolrHttpContext object must be passed in as context. Context: 
{http.request=org.apache.http.impl.client.RequestWrapper@eddf10a, 
http.request-config=[expectContinueEnabled=false, proxy=null, 
localAddress=null, cookieSpec=null, redirectsEnabled=true, 
relativeRedirectsAllowed=true, maxRedirects=50, circularRedirectsAllowed=false, 
authenticationEnabled=true, targetPreferredAuthSchemes=null, 
proxyPreferredAuthSchemes=null, connectionRequestTimeout=0, connectTimeout=0, 
socketTimeout=0, decompressionEnabled=true], 
http.auth.proxy-scope=state:UNCHALLENGED;, http.auth.credentials-provider={}, 
http.scheme-registry=org.apache.http.conn.scheme.SchemeRegistry@4861e7d6, 
http.cookie-spec=best-match, http.cookie-store=[], 
http.connection=org.apache.http.impl.conn.ManagedClientConnectionImpl@771b321c, 
http.auth.target-scope=state:UNCHALLENGED;, 
http.cookiespec-registry=org.apache.http.cookie.CookieSpecRegistry@1b78f4d2, 
http.target_host=https://127.0.0.1:51727, 
http.route={s}-https://127.0.0.1:51727, 
http.cookie-origin=[(secure)127.0.0.1:51727/solr/admin/collections], 
http.authscheme-registry=org.apache.http.auth.AuthSchemeRegistry@7acc1316}
   [junit4]at 
__randomizedtesting.SeedInfo.seed([C37B717A18417443:D897F2DA4A5D5186]:0)
   [junit4]at 
org.apache.solr.client.solrj.impl.HttpClientConfigurer$1.process(HttpClientConfigurer.java:92)
   [junit4]at 
org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:132)
   [junit4]at 
org.apache.http.protocol.HttpRequestExecutor.preProcess(HttpRequestExecutor.java:166)
   [junit4]at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:485)
   [junit4]at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:465)
   [junit4]at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
   [junit4]at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
   [junit4]at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
   [junit4]at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
   [junit4]at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]at 
org.apache.solr.client.solrj.impl.TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp(TestCloudSolrClientConnections.java:57)
   [junit4]at java.lang.Thread.run(Thread.java:745)
{noformat}

and the branch_5x one 
([http://jenkins.sarowe.net/job/Lucene-Solr-tests-5.x-Java8/892/]):

{noformat}
   [junit4]   2 NOTE: reproduce with: ant test  
-Dtestcase=TestCloudSolrClientConnections 
-Dtests.method=testCloudClientCanConnectAfterClusterComesUp 
-Dtests.seed=FC64970124605306 -Dtests.slow=true -Dtests.locale=ar_LY 
-Dtests.timezone=Asia/Vientiane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   1.84s J1 | 
TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp 
   [junit4] Throwable #1: 

[jira] [Comment Edited] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Ishan Chattopadhyaya (JIRA)

[ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647887#comment-14647887
 ] 

Ishan Chattopadhyaya edited comment on SOLR-6625 at 7/30/15 4:24 PM:
-

Attaching the patch to fix it. 


was (Author: ichattopadhyaya):
[~sar...@syr.edu] Thanks for the pointer (and to the super fast sarowe 
jenkins). I had missed it. Attaching the patch to fix it. 

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfix.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625_SolrReqPropogate.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_r1654079.patch, 
 SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (LUCENE-6708) TopFieldCollector sometimes calls Scorer.score() several times on the same doc

2015-07-30 Thread Adrien Grand (JIRA)

 [ 
https://issues.apache.org/jira/browse/LUCENE-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adrien Grand updated LUCENE-6708:
-
Attachment: LUCENE-6708.patch

Here is a patch. I also took opportunity of this change to reduce 
over-specialization of our 3 top-field collectors (non-scoring, scoring-no-max 
and scoring-max) by merging them into a single class.

 TopFieldCollector sometimes calls Scorer.score() several times on the same doc
 --

 Key: LUCENE-6708
 URL: https://issues.apache.org/jira/browse/LUCENE-6708
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Adrien Grand
Assignee: Adrien Grand
Priority: Minor
 Attachments: LUCENE-6708.patch


 If the sort spec includes a sort field that needs scores, and if 
 trackDocScores or trackMaxScore is set, then TopFieldCollectors may compute 
 the score several times on the same document, once to check whether the hit 
 is competitive, and once to update maxScore or to set the score on the 
 ScoreDoc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6609) FieldCacheSource (or it's subclasses) should override getSortField

2015-07-30 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648066#comment-14648066
 ] 

Hoss Man commented on LUCENE-6609:
--

I think the same thing would make sense for 
{{SortedSetFieldSource.getSortField()}} -- it can return an instance of 
{{SortedSetSortField}}.

 FieldCacheSource (or it's subclasses) should override getSortField
 --

 Key: LUCENE-6609
 URL: https://issues.apache.org/jira/browse/LUCENE-6609
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man

 {{ValueSource}} defines the following method...
 {code}
   public SortField getSortField(boolean reverse) {
 return new ValueSourceSortField(reverse);
   }
 {code}
 ...where {{ValueSourceSortField}} builds up a {{ValueSourceComparator}} 
 containing a {{double[]}} based on the {{FunctionValues}} of the original 
 {{ValueSource}}.
 meanwhile, the abstract {{FieldCacheSource}} exists as a base implementation 
 for classes like {{IntFieldSource}} and {{DoubleFieldSource}} which wrap a 
 {{ValueSource}} around {{DocValues}} for the specified field.
 But neither {{FieldCacheSource}} nor any of it's subclasses override the 
 {{getSortField(boolean)}} method -- so attempting to sort on something like 
 an {{IntFieldSource}} winds up using a bunch of ram to build that 
 {{double[]}} to give users a less accurate sort (because of casting) then if 
 they just sorted directly on the field.
 is there any good reason why {{FieldCacheSource}} subclases like 
 {{IntFieldSource}} shouldn't all override {{getSortField}} with something 
 like...
 {code}
   public SortField getSortField(boolean reverse) {
 return new SortField(field, Type.INT, reverse);
   }
 {code}
 ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Created] (LUCENE-6709) Add RandomAccessOrds support to UninvertedReader's SortedSetDocValues impl (DocTermOrds.Iterator)

2015-07-30 Thread Hoss Man (JIRA)
Hoss Man created LUCENE-6709:


 Summary: Add RandomAccessOrds support to UninvertedReader's 
SortedSetDocValues impl (DocTermOrds.Iterator)
 Key: LUCENE-6709
 URL: https://issues.apache.org/jira/browse/LUCENE-6709
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man


UninvertedReader's SortedSetDocValues impl doesn't implement the 
RandomAccessOrds API, so it can't be used with SortedSetSelector.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Updated] (SOLR-6625) HttpClient callback in HttpSolrServer

2015-07-30 Thread Anshum Gupta (JIRA)

 [ 
https://issues.apache.org/jira/browse/SOLR-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anshum Gupta updated SOLR-6625:
---
Attachment: SOLR-6625-testfailure.log

I got an NPE with the patch (log attached).

 HttpClient callback in HttpSolrServer
 -

 Key: SOLR-6625
 URL: https://issues.apache.org/jira/browse/SOLR-6625
 Project: Solr
  Issue Type: Improvement
  Components: SolrJ
Reporter: Gregory Chanan
Assignee: Noble Paul
Priority: Minor
 Attachments: SOLR-6625-testfailure.log, SOLR-6625-testfix.patch, 
 SOLR-6625-testfix.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, SOLR-6625.patch, 
 SOLR-6625.patch, SOLR-6625_SolrReqPropogate.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_interceptor.patch, SOLR-6625_interceptor.patch, 
 SOLR-6625_r1654079.patch, SOLR-6625_r1654079.patch


 Some of our setups use Solr in a SPNego/kerberos setup (we've done this by 
 adding our own filters to the web.xml).  We have an issue in that SPNego 
 requires a negotiation step, but some HttpSolrServer requests are not 
 repeatable, notably the PUT/POST requests.  So, what happens is, 
 HttpSolrServer sends the requests, the server responds with a negotiation 
 request, and the request fails because the request is not repeatable.  We've 
 modified our code to send a repeatable request beforehand in these cases.
 It would be nicer if HttpSolrServer provided a pre/post callback when it was 
 making an httpclient request.  This would allow administrators to make 
 changes to the request for authentication purposes, and would allow users to 
 make per-request changes to the httpclient calls (i.e. modify httpclient 
 requestconfig to modify the timeout on a per-request basis).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



[jira] [Commented] (LUCENE-6709) Add RandomAccessOrds support to UninvertedReader's SortedSetDocValues impl (DocTermOrds.Iterator)

2015-07-30 Thread Hoss Man (JIRA)

[ 
https://issues.apache.org/jira/browse/LUCENE-6709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648077#comment-14648077
 ] 

Hoss Man commented on LUCENE-6709:
--

NOTE: I have no idea if/how feasible this is, i mainly just wanted to file it 
as an open issue for linking as a blocker to some other issues.

 Add RandomAccessOrds support to UninvertedReader's SortedSetDocValues impl 
 (DocTermOrds.Iterator)
 -

 Key: LUCENE-6709
 URL: https://issues.apache.org/jira/browse/LUCENE-6709
 Project: Lucene - Core
  Issue Type: Improvement
Reporter: Hoss Man

 UninvertedReader's SortedSetDocValues impl doesn't implement the 
 RandomAccessOrds API, so it can't be used with SortedSetSelector.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org



  1   2   >