[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533735#comment-13533735 ] Dawid Weiss commented on SOLR-4205: --- This definitely looks like a bug in the runner although I have no idea how to reproduce this or what may be causing it. The symptoms are: truncated events file: {code} [ SUITE_FAILURE {code} and the main test thread gone. This is very weird. Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533737#comment-13533737 ] Uwe Schindler commented on SOLR-4205: - Do you flush the event file? Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533738#comment-13533738 ] Dawid Weiss commented on SOLR-4205: --- Sure. Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533820#comment-13533820 ] Dawid Weiss commented on SOLR-4205: --- I pushed yet another minor release (it's damn hard to test against third party libraries with ivy...) -- 2.0.7. It just contains an explicit flush but I don't think this will make a difference. Uwe, could you upgrade the ivy files and enable the build again? we'll see if this helps or changes the behavior anyhow. I'm busy for the rest of the day but I'll take a look at the results in the evening. Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533822#comment-13533822 ] Uwe Schindler commented on SOLR-4205: - Updated in trunk revision: 1422836, 4.x revision: 1422837 Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688)
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533823#comment-13533823 ] Commit Tag Bot commented on SOLR-4205: -- [trunk commit] Uwe Schindler http://svn.apache.org/viewvc?view=revisionrevision=1422836 SOLR-4205: Update randomized-testing framework to 2.0.7 Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533826#comment-13533826 ] Uwe Schindler commented on SOLR-4205: - I triggered a new trunk clover build. Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533827#comment-13533827 ] Commit Tag Bot commented on SOLR-4205: -- [branch_4x commit] Uwe Schindler http://svn.apache.org/viewvc?view=revisionrevision=1422837 Merged revision(s) 1422836 from lucene/dev/trunk: SOLR-4205: Update randomized-testing framework to 2.0.7 Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189)
[jira] [Commented] (SOLR-3925) Expose SpanFirst in eDismax
[ https://issues.apache.org/jira/browse/SOLR-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533926#comment-13533926 ] Vlado Kurelec commented on SOLR-3925: - Hi, at first, thanks a lot for this patch. I've built it on a rev. 1406758 and found following issues: - edismax query throws an exception when there's no sf parameter - SpanFirst doesn't process the search term through the query anayzer defined on that field - if search term is enclosed in (), they are not striped but passed as part of the term How come it is not included in night build? Is there another way to do boost by position? Expose SpanFirst in eDismax --- Key: SOLR-3925 URL: https://issues.apache.org/jira/browse/SOLR-3925 Project: Solr Issue Type: Improvement Components: query parsers Affects Versions: 4.0-BETA Environment: solr-spec 5.0.0.2012.10.09.19.29.59 solr-impl 5.0-SNAPSHOT 1366361:1396116M - markus - 2012-10-09 19:29:59 Reporter: Markus Jelsma Fix For: 4.1, 5.0 Attachments: SOLR-3925-trunk-1.patch, SOLR-3925-trunk-2.patch Expose Lucene's SpanFirst capability in Solr's extended Dismax query parser. This issue adds the SF-parameter (SpanFirst) and takes a FIELD~DISTANCE^BOOST formatted value. For example, sf=title~5^2 will give a boost of 2 if one of the normal clauses, originally generated for automatic phrase queries, is located within five positions from the field's start. Unit test is included and all tests pass. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-3925) Expose SpanFirst in eDismax
[ https://issues.apache.org/jira/browse/SOLR-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533926#comment-13533926 ] Vlado Kurelec edited comment on SOLR-3925 at 12/17/12 2:01 PM: --- Hi, at first, thanks a lot for this patch. I've built it on a rev. 1406758 and found following issues: - edismax query throws an exception when there's no sf parameter - SpanFirst doesn't process the search term through the query anayzer defined on that field - if search term is enclosed in (), they are not striped but passed as part of the term p.s. how come it is not included in night build? Is there another way to do boost by position? was (Author: celeruk): Hi, at first, thanks a lot for this patch. I've built it on a rev. 1406758 and found following issues: - edismax query throws an exception when there's no sf parameter - SpanFirst doesn't process the search term through the query anayzer defined on that field - if search term is enclosed in (), they are not striped but passed as part of the term How come it is not included in night build? Is there another way to do boost by position? Expose SpanFirst in eDismax --- Key: SOLR-3925 URL: https://issues.apache.org/jira/browse/SOLR-3925 Project: Solr Issue Type: Improvement Components: query parsers Affects Versions: 4.0-BETA Environment: solr-spec 5.0.0.2012.10.09.19.29.59 solr-impl 5.0-SNAPSHOT 1366361:1396116M - markus - 2012-10-09 19:29:59 Reporter: Markus Jelsma Fix For: 4.1, 5.0 Attachments: SOLR-3925-trunk-1.patch, SOLR-3925-trunk-2.patch Expose Lucene's SpanFirst capability in Solr's extended Dismax query parser. This issue adds the SF-parameter (SpanFirst) and takes a FIELD~DISTANCE^BOOST formatted value. For example, sf=title~5^2 will give a boost of 2 if one of the normal clauses, originally generated for automatic phrase queries, is located within five positions from the field's start. Unit test is included and all tests pass. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_09) - Build # 2202 - Failure!
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/2202/ Java: 64bit/jdk1.7.0_09 -XX:+UseParallelGC 1 tests failed. REGRESSION: org.apache.solr.spelling.SpellCheckCollatorTest.testContextSensitiveCollate Error Message: Exception during query Stack Trace: java.lang.RuntimeException: Exception during query at __randomizedtesting.SeedInfo.seed([AAE77DE58B4DA823:A82E76185711F752]:0) at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:515) at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:482) at org.apache.solr.spelling.SpellCheckCollatorTest.testContextSensitiveCollate(SpellCheckCollatorTest.java:380) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) at java.lang.Thread.run(Thread.java:722) Caused by: java.lang.RuntimeException: REQUEST FAILED:
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13533972#comment-13533972 ] Yonik Seeley commented on SOLR-4143: bq. I think the right way to go about this would be to have a method that will change the URL path but just leave out the query parameter entirely This seems like the right approach (as opposed to adding more parameters). Isn't the fix for this entirely on the client side (i.e. if qt starts with slash, remove it and set the URL path)? setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2592) Custom Hashing
[ https://issues.apache.org/jira/browse/SOLR-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534003#comment-13534003 ] Markus Jelsma commented on SOLR-2592: - Additional note for anyone: you will also see a similar exception with an older SolrJ application: {code} java.lang.ClassCastException: java.lang.String cannot be cast to java.util.Map at org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:291) at org.apache.solr.common.cloud.ClusterState.load(ClusterState.java:263) at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:274) at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:142) at org.apache.nutch.indexer.solr.SolrUtils.getCloudServer(SolrUtils.java:107) at org.apache.nutch.indexer.solr.SolrUtils.getSolrServers(SolrUtils.java:65) at org.apache.nutch.indexer.solr.SolrWriter.open(SolrWriter.java:65) at org.apache.nutch.indexer.IndexerOutputFormat.getRecordWriter(IndexerOutputFormat.java:42) at org.apache.hadoop.mapred.ReduceTask$OldTrackingRecordWriter.init(ReduceTask.java:448) at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:490) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260) {code} Custom Hashing -- Key: SOLR-2592 URL: https://issues.apache.org/jira/browse/SOLR-2592 Project: Solr Issue Type: New Feature Components: SolrCloud Affects Versions: 4.0-ALPHA Reporter: Noble Paul Assignee: Yonik Seeley Fix For: 4.1 Attachments: dbq_fix.patch, pluggable_sharding.patch, pluggable_sharding_V2.patch, SOLR-2592_collectionProperties.patch, SOLR-2592_collectionProperties.patch, SOLR-2592.patch, SOLR-2592_progress.patch, SOLR-2592_query_try1.patch, SOLR-2592_r1373086.patch, SOLR-2592_r1384367.patch, SOLR-2592_rev_2.patch, SOLR_2592_solr_4_0_0_BETA_ShardPartitioner.patch If the data in a cloud can be partitioned on some criteria (say range, hash, attribute value etc) It will be easy to narrow down the search to a smaller subset of shards and in effect can achieve more efficient search. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-4207) Links to lucene in wiki are broken
Aldo Stracquadanio created SOLR-4207: Summary: Links to lucene in wiki are broken Key: SOLR-4207 URL: https://issues.apache.org/jira/browse/SOLR-4207 Project: Solr Issue Type: Bug Components: documentation Reporter: Aldo Stracquadanio Since 4.0.0 has been released there are all links pointing to the lucene.apache.org domain are broken. Some examples: On the SolrQuerySyntax page selecting a link to any function or to either DateField or DateMath will result in a 404. On the SearchComponent page selecting any link to a specific component in the first list wil result in a 404. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4157) Add more conventional search functionality to the Admin UI
[ https://issues.apache.org/jira/browse/SOLR-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534038#comment-13534038 ] Ryan McKinley commented on SOLR-4157: - bq. It'd be really cool to have JSON and XML be formatted in the pane by default, they're ugly as it stands. But only if it's really, really easy. What about using something like: http://google-code-prettify.googlecode.com/svn/trunk/tests/prettify_test.html#xml http://google-code-prettify.googlecode.com/svn/trunk/tests/prettify_test.html#javascript Add more conventional search functionality to the Admin UI -- Key: SOLR-4157 URL: https://issues.apache.org/jira/browse/SOLR-4157 Project: Solr Issue Type: Improvement Components: web gui Reporter: Upayavira Priority: Minor Attachments: SOLR-4157.patch The admin UI has a 'query' pane which allows searching the index. However, this is currently an 'expert' level feature, as you must specify exact request parameters and interpret output XML or JSON. I suggest we add simple versions of each. A simple query pane would give a more conventional search interface for running queries. A simple results pane would give HTML formatted results with features to nicely display hightlighting, explains, etc. To give an idea of what this might look like, I've attached a rudimentary patch that gives an HTML option for wt which formats the query results as (somewhat minimal) HTML. The challenge will be in producing a search interface that is schema agnostic, as to be really useful, it should work with any index, and not just with the fields in the default schema (perhaps Erik Hatcher is right, this should be backed by the velocityResponseWriter). Thoughts welcome. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
DocsEnum.freq()
Hi While migrating code to Lucene 4.0, I noticed that I have an assert on a field that is indexed with DOCS_ONLY that DocsEnum.freq() == 1. This got me thinking ... why? If you index w/ DOCS_ONLY, or ask for DocsEnum with FLAG_NONE, why do we lie to the consumer? Rather, we could just return 0 or -1? I personally don't mind if we continue to return 1, if there's a real reason to. I don't think that anyone should call freq() if he asked for DocsEnum with FLAG_NONE. But if we do keep the current behavior, can we at least document it? E.g., something like this patch: Index: lucene/core/src/java/org/apache/lucene/index/DocsEnum.java === --- lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (revision 1422804) +++ lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (working copy) @@ -47,10 +47,16 @@ protected DocsEnum() { } - /** Returns term frequency in the current document. Do - * not call this before {@link #nextDoc} is first called, - * nor after {@link #nextDoc} returns NO_MORE_DOCS. - **/ + /** + * Returns term frequency in the current document, or 1 if the + * {@link DocsEnum} was obtained with {@link #FLAG_NONE}. Do not call this + * before {@link #nextDoc} is first called, nor after {@link #nextDoc} returns + * {@link DocIdSetIterator#NO_MORE_DOCS}. + * + * p + * bNOTE:/b if the {@link DocsEnum} was obtain with {@link #FLAG_NONE}, + * this method returns 1. + */ public abstract int freq() throws IOException; /** Returns the related attributes. */ Shai
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534046#comment-13534046 ] Shawn Heisey commented on SOLR-4143: bq. This seems like the right approach (as opposed to adding more parameters). Isn't the fix for this entirely on the client side (i.e. if qt starts with slash, remove it and set the URL path)? I do like that idea. It would be a lot cleaner than my fix, as it wouldn't involve any new methods or parameters. A quick mental review doesn't find anything wrong with it, but my knowledge may not be deep enough. If you also don't see any potential fallout, I can make a new patch that would just nuke CommonParams.QT from the final request whenever it starts with slash. My current fix is also entirely on the client side. This latest version of setRequestHandler adds qt.pathonly=true as a parameter to the request if you pass it a true boolean. If that parameter is present when the request is actually made by implementations of SolrServer, then it is removed, along with qt, after the request path is set. As far as I can tell, nothing behaves any differently on the server side in the latest patch version. With earlier versions, the server side did behave differently, which is bad. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: DocsEnum.freq()
On Mon, Dec 17, 2012 at 11:24 AM, Shai Erera ser...@gmail.com wrote: Hi While migrating code to Lucene 4.0, I noticed that I have an assert on a field that is indexed with DOCS_ONLY that DocsEnum.freq() == 1. This got me thinking ... why? 1 is pretty intuitive i think. i think of omitting freqs for things like super-short fields where the frequency is expected to be 1 anyway. I see your point about lying, but if we change this, we have to change all code using it like TermQuery to not call freqs if they are unavailable: i think this makes the apis pretty difficult to use. But if we do keep the current behavior, can we at least document it? E.g., something like this patch: +1 to the patch. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534046#comment-13534046 ] Shawn Heisey commented on SOLR-4143: bq. This seems like the right approach (as opposed to adding more parameters). Isn't the fix for this entirely on the client side (i.e. if qt starts with slash, remove it and set the URL path)? I do like that idea. It would be a lot cleaner than my fix, as it wouldn't involve any new methods or parameters. A quick mental review doesn't find anything wrong with it, but my knowledge may not be deep enough. If you also don't see any potential fallout, I can make a new patch that would just nuke CommonParams.QT from the final request whenever it starts with slash. My current fix is also entirely on the client side. This latest version of setRequestHandler adds qt.pathonly=true as a parameter to the request if you pass it a true boolean. If that parameter is present when the request is actually made by implementations of SolrServer, then it is removed, along with qt, after the request path is set. As far as I can tell, nothing behaves any differently on the server side in the latest patch version. With earlier versions, the server side did behave differently, which is bad. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534046#comment-13534046 ] Shawn Heisey commented on SOLR-4143: bq. This seems like the right approach (as opposed to adding more parameters). Isn't the fix for this entirely on the client side (i.e. if qt starts with slash, remove it and set the URL path)? I do like that idea. It would be a lot cleaner than my fix, as it wouldn't involve any new methods or parameters. A quick mental review doesn't find anything wrong with it, but my knowledge may not be deep enough. If you also don't see any potential fallout, I can make a new patch that would just nuke CommonParams.QT from the final request whenever it starts with slash. My current fix is also entirely on the client side. This latest version of setRequestHandler adds qt.pathonly=true as a parameter to the request if you pass it a true boolean. If that parameter is present when the request is actually made by implementations of SolrServer, then it is removed, along with qt, after the request path is set. As far as I can tell, nothing behaves any differently on the server side in the latest patch version. With earlier versions, the server side did behave differently, which is bad. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (LUCENE-4258) Incremental Field Updates through Stacked Segments
[ https://issues.apache.org/jira/browse/LUCENE-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sivan Yogev updated LUCENE-4258: Attachment: LUCENE-4258.r1423010.patch New patch, concurrency bugs fixed. All tests pass. Incremental Field Updates through Stacked Segments -- Key: LUCENE-4258 URL: https://issues.apache.org/jira/browse/LUCENE-4258 Project: Lucene - Core Issue Type: Improvement Components: core/index Reporter: Sivan Yogev Attachments: IncrementalFieldUpdates.odp, LUCENE-4258-API-changes.patch, LUCENE-4258.r1410593.patch, LUCENE-4258.r1412262.patch, LUCENE-4258.r1416438.patch, LUCENE-4258.r1416617.patch, LUCENE-4258.r1422495.patch, LUCENE-4258.r1423010.patch Original Estimate: 2,520h Remaining Estimate: 2,520h Shai and I would like to start working on the proposal to Incremental Field Updates outlined here (http://markmail.org/message/zhrdxxpfk6qvdaex). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4110) Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter
[ https://issues.apache.org/jira/browse/SOLR-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Siebel updated SOLR-4110: - Attachment: SOLR-4110_trunk.patch SOLR-4110_branch_4x.patch Patch to make Content-Type header configurable in PHPResponseWriters. Had to add two patches for trunk and branch_4x separately, due to changes in trunk (missing @Overrides). Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter Key: SOLR-4110 URL: https://issues.apache.org/jira/browse/SOLR-4110 Project: Solr Issue Type: Improvement Components: Response Writers Affects Versions: 4.0 Reporter: Dominik Siebel Assignee: Mark Miller Priority: Minor Labels: 4.0.1_Candidate Fix For: 4.1, 5.0 Attachments: SOLR-4110_branch_4x.patch, SOLR-4110.patch, SOLR-4110_trunk.patch The *PHPResponseWriter* and *PHPSerializedResponseWriter* currently send a hard coded Content-Type header of _text/plain; charset=UTF-8_ although there are constants defining _text/x-php;charset=UTF-8_ and _text/x-php-serialized;charset=UTF-8_ which remain unused. This makes content type guessing on the client side quite complicated. I already created a patch (from the branch_4x github branch) to use the respective constants and also added the possibility to configure the Content-Type header via solrconfig.xml (like in JSONResponseWriter). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4110) Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter
[ https://issues.apache.org/jira/browse/SOLR-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dominik Siebel updated SOLR-4110: - Attachment: SOLR-4110_trunk.patch SOLR-4110_branch_4x.patch Patch to make Content-Type header configurable in PHPResponseWriters. Had to add two patches for trunk and branch_4x separately, due to changes in trunk (missing @Overrides). Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter Key: SOLR-4110 URL: https://issues.apache.org/jira/browse/SOLR-4110 Project: Solr Issue Type: Improvement Components: Response Writers Affects Versions: 4.0 Reporter: Dominik Siebel Assignee: Mark Miller Priority: Minor Labels: 4.0.1_Candidate Fix For: 4.1, 5.0 Attachments: SOLR-4110_branch_4x.patch, SOLR-4110.patch, SOLR-4110_trunk.patch The *PHPResponseWriter* and *PHPSerializedResponseWriter* currently send a hard coded Content-Type header of _text/plain; charset=UTF-8_ although there are constants defining _text/x-php;charset=UTF-8_ and _text/x-php-serialized;charset=UTF-8_ which remain unused. This makes content type guessing on the client side quite complicated. I already created a patch (from the branch_4x github branch) to use the respective constants and also added the possibility to configure the Content-Type header via solrconfig.xml (like in JSONResponseWriter). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: DocsEnum.freq()
I think the FLAG_NONE (I don't need/want freqs when reading the index) and the DOCS_ONLY (Do not index freqs) are two different cases? I think for DOCS_ONLY it makes sense that we lie (say freq=1 when we don't know): lots of places would otherwise have to be special cased for when they consume DOCS_ONLY vs DOCS_AND_POSITIONS. But, for FLAG_NONE, when the caller passes this it means they have no intention of using/calling freq() right? Eg MultiTermQueryWrapperFilter would pass this. For that case I'm not sure we should promise / require that codecs return 1 always? EG what if the index does has freqs? I think in that case the codec shouldn't be required to go out of its way and return 1? I'm also not sure that all codecs return 1 today if the fields was indexed with DOCS_ONLY ... Mike McCandless http://blog.mikemccandless.com On Mon, Dec 17, 2012 at 11:24 AM, Shai Erera ser...@gmail.com wrote: Hi While migrating code to Lucene 4.0, I noticed that I have an assert on a field that is indexed with DOCS_ONLY that DocsEnum.freq() == 1. This got me thinking ... why? If you index w/ DOCS_ONLY, or ask for DocsEnum with FLAG_NONE, why do we lie to the consumer? Rather, we could just return 0 or -1? I personally don't mind if we continue to return 1, if there's a real reason to. I don't think that anyone should call freq() if he asked for DocsEnum with FLAG_NONE. But if we do keep the current behavior, can we at least document it? E.g., something like this patch: Index: lucene/core/src/java/org/apache/lucene/index/DocsEnum.java === --- lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (revision 1422804) +++ lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (working copy) @@ -47,10 +47,16 @@ protected DocsEnum() { } - /** Returns term frequency in the current document. Do - * not call this before {@link #nextDoc} is first called, - * nor after {@link #nextDoc} returns NO_MORE_DOCS. - **/ + /** + * Returns term frequency in the current document, or 1 if the + * {@link DocsEnum} was obtained with {@link #FLAG_NONE}. Do not call this + * before {@link #nextDoc} is first called, nor after {@link #nextDoc} returns + * {@link DocIdSetIterator#NO_MORE_DOCS}. + * + * p + * bNOTE:/b if the {@link DocsEnum} was obtain with {@link #FLAG_NONE}, + * this method returns 1. + */ public abstract int freq() throws IOException; /** Returns the related attributes. */ Shai - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4111) Context-Sensitive SpellCheck Collation is not really being tested on IndexBasedSpellChecker
[ https://issues.apache.org/jira/browse/SOLR-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534133#comment-13534133 ] Commit Tag Bot commented on SOLR-4111: -- [trunk commit] James Dyer http://svn.apache.org/viewvc?view=revisionrevision=1423067 SOLR-4111: fix occasional failures Context-Sensitive SpellCheck Collation is not really being tested on IndexBasedSpellChecker --- Key: SOLR-4111 URL: https://issues.apache.org/jira/browse/SOLR-4111 Project: Solr Issue Type: Bug Affects Versions: 4.0 Reporter: Tomás Fernández Löbbe Assignee: James Dyer Priority: Trivial Fix For: 4.1, 5.0 Attachments: SOLR-4111.patch Looks like a typo in the code. SpellCheckCollatorTest.testContextSensitiveCollate() has: {code:java} // DirectSolrSpellChecker IndexBasedSpellChecker String[] dictionary = {direct,default_teststop }; for(int i=0 ; i1 ; i++) { ... test stuff using dictionary[i]... } {code} where it should be {code:java} // DirectSolrSpellChecker IndexBasedSpellChecker String[] dictionary = {direct,default_teststop }; for(int i=0 ; i=1 ; i++) { ... test stuff using dictionary[i]... } {code} due to this, the tests are not being run with a IndexBasedSpellChecker. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [Solr Wiki] Update of SolrCloud by EricPugh
On Dec 17, 2012, at 1:02 PM, Apache Wiki wikidi...@apache.org wrote: Should I say this is a Solr 4.1 change? I really think we need to version the SolrCloud page. I think we need to version our docs in general, but the SolrCloud page already needs to be broken up I think. I'm just waiting until we start on a better docs route. But until then, it seems to crazy to litter it with if(thisversion) then. I think we should make a 4.0 version and then copy it and tweak to a 4.1 version. There are tradeoffs to this, but in my opinion its the only way to keep things sane. - Mark - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [Solr Wiki] Update of SolrCloud by EricPugh
I agree with the SolrCloud page specifically. SolrCloud has so many changes between 4.0 and 4.1. I am guessing that by the time we get to 4.2 or 4.3 that it will all be much more stable and then going back to marking it with a revision will work like the other wiki pages have. On Dec 17, 2012, at 1:46 PM, Mark Miller wrote: On Dec 17, 2012, at 1:02 PM, Apache Wiki wikidi...@apache.org wrote: Should I say this is a Solr 4.1 change? I really think we need to version the SolrCloud page. I think we need to version our docs in general, but the SolrCloud page already needs to be broken up I think. I'm just waiting until we start on a better docs route. But until then, it seems to crazy to litter it with if(thisversion) then. I think we should make a 4.0 version and then copy it and tweak to a 4.1 version. There are tradeoffs to this, but in my opinion its the only way to keep things sane. - Mark - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - Eric Pugh | Principal | OpenSource Connections, LLC | 434.466.1467 | http://www.opensourceconnections.com Co-Author: Apache Solr 3 Enterprise Search Server available from http://www.packtpub.com/apache-solr-3-enterprise-search-server/book This e-mail and all contents, including attachments, is considered to be Company Confidential unless explicitly stated otherwise, regardless of whether attachments are marked as such. - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4111) Context-Sensitive SpellCheck Collation is not really being tested on IndexBasedSpellChecker
[ https://issues.apache.org/jira/browse/SOLR-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534167#comment-13534167 ] Commit Tag Bot commented on SOLR-4111: -- [branch_4x commit] James Dyer http://svn.apache.org/viewvc?view=revisionrevision=1423093 SOLR-4111: fix occasional failures Context-Sensitive SpellCheck Collation is not really being tested on IndexBasedSpellChecker --- Key: SOLR-4111 URL: https://issues.apache.org/jira/browse/SOLR-4111 Project: Solr Issue Type: Bug Affects Versions: 4.0 Reporter: Tomás Fernández Löbbe Assignee: James Dyer Priority: Trivial Fix For: 4.1, 5.0 Attachments: SOLR-4111.patch Looks like a typo in the code. SpellCheckCollatorTest.testContextSensitiveCollate() has: {code:java} // DirectSolrSpellChecker IndexBasedSpellChecker String[] dictionary = {direct,default_teststop }; for(int i=0 ; i1 ; i++) { ... test stuff using dictionary[i]... } {code} where it should be {code:java} // DirectSolrSpellChecker IndexBasedSpellChecker String[] dictionary = {direct,default_teststop }; for(int i=0 ; i=1 ; i++) { ... test stuff using dictionary[i]... } {code} due to this, the tests are not being run with a IndexBasedSpellChecker. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4207) Links to lucene in wiki are broken
[ https://issues.apache.org/jira/browse/SOLR-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534190#comment-13534190 ] Steven Rowe commented on SOLR-4207: --- Hi Aldo, The wiki can be edited by anybody - when you see broken links like this, please go ahead and fix them yourself. Until recently, the Solr API docs hosted on the website were not versioned - they were changed to reflect the latest release. Now that they are versioned, links will need to be repaired to go to a specific version. For example, the DateField link on the SolrQuerySyntax page is currently {noformat} http://lucene.apache.org/solr/api/org/apache/solr/schema/DateField.html {noformat} but should be {noformat} http://lucene.apache.org/solr/4_0_0/solr-core/org/apache/solr/schema/DateField.html {noformat} Just replace {{api/}} with {{4_0_0/solr-core/}}. See http://lucene.apache.org/solr/4_0_0/ for other modules' base URLs. Links to lucene in wiki are broken -- Key: SOLR-4207 URL: https://issues.apache.org/jira/browse/SOLR-4207 Project: Solr Issue Type: Bug Components: documentation Reporter: Aldo Stracquadanio Labels: documentation Since 4.0.0 has been released there are all links pointing to the lucene.apache.org domain are broken. Some examples: On the SolrQuerySyntax page selecting a link to any function or to either DateField or DateMath will result in a 404. On the SearchComponent page selecting any link to a specific component in the first list wil result in a 404. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-2894) Implement distributed pivot faceting
[ https://issues.apache.org/jira/browse/SOLR-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534219#comment-13534219 ] Chris Russell commented on SOLR-2894: - Thanks Shahar. In regard to #1, there is (count) and there are tests that cover that in DistributedFacetPivotTest.java. Are you sure the patch applied correctly to your version of solr? In regard to #2, that is correct. Does per field sorting work with non-distributed pivots? I guess it was never implemented by the original author. Implement distributed pivot faceting Key: SOLR-2894 URL: https://issues.apache.org/jira/browse/SOLR-2894 Project: Solr Issue Type: Improvement Reporter: Erik Hatcher Fix For: 4.1 Attachments: SOLR-2894.patch, SOLR-2894.patch, SOLR-2894.patch, SOLR-2894-reworked.patch Following up on SOLR-792, pivot faceting currently only supports undistributed mode. Distributed pivot faceting needs to be implemented. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4207) Links to lucene in wiki are broken
[ https://issues.apache.org/jira/browse/SOLR-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534236#comment-13534236 ] Yonik Seeley commented on SOLR-4207: I brought this up a while back: http://lucene.472066.n3.nabble.com/links-to-javadoc-are-broken-td4020294.html This isn't due to a lack of versioning (there's a redirect from api currently), but that the redirect no longer works because of a change of the structure of the javadocs (inserting a solr-core in the middle of the path). That redirect needs to be fixed. If I knew where it was, I'd do it. Links to lucene in wiki are broken -- Key: SOLR-4207 URL: https://issues.apache.org/jira/browse/SOLR-4207 Project: Solr Issue Type: Bug Components: documentation Reporter: Aldo Stracquadanio Labels: documentation Since 4.0.0 has been released there are all links pointing to the lucene.apache.org domain are broken. Some examples: On the SolrQuerySyntax page selecting a link to any function or to either DateField or DateMath will result in a 404. On the SearchComponent page selecting any link to a specific component in the first list wil result in a 404. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-4207) Links to lucene in wiki are broken
[ https://issues.apache.org/jira/browse/SOLR-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534236#comment-13534236 ] Yonik Seeley edited comment on SOLR-4207 at 12/17/12 8:01 PM: -- I brought this up a while back: http://lucene.472066.n3.nabble.com/links-to-javadoc-are-broken-td4020294.html This isn't due to a lack of versioning (there's a redirect from api currently), but that the redirect no longer works because of a change of the structure of the javadocs (inserting a solr-core in the middle of the path). That redirect needs to be fixed. If I knew where it was, I'd do it. edit: I just found it (I hadn't realized it was under the cms). I'll try a fix. was (Author: ysee...@gmail.com): I brought this up a while back: http://lucene.472066.n3.nabble.com/links-to-javadoc-are-broken-td4020294.html This isn't due to a lack of versioning (there's a redirect from api currently), but that the redirect no longer works because of a change of the structure of the javadocs (inserting a solr-core in the middle of the path). That redirect needs to be fixed. If I knew where it was, I'd do it. Links to lucene in wiki are broken -- Key: SOLR-4207 URL: https://issues.apache.org/jira/browse/SOLR-4207 Project: Solr Issue Type: Bug Components: documentation Reporter: Aldo Stracquadanio Labels: documentation Since 4.0.0 has been released there are all links pointing to the lucene.apache.org domain are broken. Some examples: On the SolrQuerySyntax page selecting a link to any function or to either DateField or DateMath will result in a 404. On the SearchComponent page selecting any link to a specific component in the first list wil result in a 404. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Heisey updated SOLR-4143: --- Attachment: SOLR-4143-alternate-testsfailing.patch Alternate patch as discussed (against branch_4x) with a test. This one no longer does extensive code reformatting. The changes turned up a problem in BasicDistributedZkTest, where qt was being used for additional parameters: params.set(qt, /admin/mbeans?key=updateHandlerstats=true); I fixed that in the patch by assigning the parameters separately. There is still one test failing for sure (actually failing to fail) with this alternate patch, and I'm not sure how to fix it. I am doing a run where I force this test to pass, to see if there are any other failures. Test that's failing: -Dtestcase=TestRemoteStreaming -Dtests.method=testQtUpdateFails Is there a way to examine the response to determine that it did not update any documents? If the qt=/update were to successfully override the /select, would numFound be in the response? I had the test add echoParams=all and print out the response as a string: {noformat} {responseHeader={status=0,QTime=5,handler=org.apache.solr.handler.StandardRequestHandler,params={stream.body=deletequery*:*/query/delete,echoParams=all,q=*:*,echoHandler=true,wt=javabin,version=2}},response={numFound=1,start=0,docs=[SolrDocument{id=1234, range_facet_si=1234, range_facet_l=[1234], range_facet_sl=[1234], timestamp=Tue Dec 18 06:01:24 KOST 2012, multiDefault=[muLti-Default], intDefault=42}]}} {noformat} setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate-testsfailing.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534257#comment-13534257 ] Shawn Heisey commented on SOLR-4143: If the alternate patch is fixed and deemed the right way to go, this issue should be renamed: setRequestHandler - remove qt parameter from final request when it starts with slash setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate-testsfailing.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4110) Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter
[ https://issues.apache.org/jira/browse/SOLR-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534268#comment-13534268 ] Commit Tag Bot commented on SOLR-4110: -- [trunk commit] Mark Robert Miller http://svn.apache.org/viewvc?view=revisionrevision=1423121 SOLR-4110: Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter. Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter Key: SOLR-4110 URL: https://issues.apache.org/jira/browse/SOLR-4110 Project: Solr Issue Type: Improvement Components: Response Writers Affects Versions: 4.0 Reporter: Dominik Siebel Assignee: Mark Miller Priority: Minor Labels: 4.0.1_Candidate Fix For: 4.1, 5.0 Attachments: SOLR-4110_branch_4x.patch, SOLR-4110.patch, SOLR-4110_trunk.patch The *PHPResponseWriter* and *PHPSerializedResponseWriter* currently send a hard coded Content-Type header of _text/plain; charset=UTF-8_ although there are constants defining _text/x-php;charset=UTF-8_ and _text/x-php-serialized;charset=UTF-8_ which remain unused. This makes content type guessing on the client side quite complicated. I already created a patch (from the branch_4x github branch) to use the respective constants and also added the possibility to configure the Content-Type header via solrconfig.xml (like in JSONResponseWriter). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4110) Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter
[ https://issues.apache.org/jira/browse/SOLR-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534279#comment-13534279 ] Commit Tag Bot commented on SOLR-4110: -- [branch_4x commit] Mark Robert Miller http://svn.apache.org/viewvc?view=revisionrevision=1423123 SOLR-4110: Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter. Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter Key: SOLR-4110 URL: https://issues.apache.org/jira/browse/SOLR-4110 Project: Solr Issue Type: Improvement Components: Response Writers Affects Versions: 4.0 Reporter: Dominik Siebel Assignee: Mark Miller Priority: Minor Labels: 4.0.1_Candidate Fix For: 4.1, 5.0 Attachments: SOLR-4110_branch_4x.patch, SOLR-4110.patch, SOLR-4110_trunk.patch The *PHPResponseWriter* and *PHPSerializedResponseWriter* currently send a hard coded Content-Type header of _text/plain; charset=UTF-8_ although there are constants defining _text/x-php;charset=UTF-8_ and _text/x-php-serialized;charset=UTF-8_ which remain unused. This makes content type guessing on the client side quite complicated. I already created a patch (from the branch_4x github branch) to use the respective constants and also added the possibility to configure the Content-Type header via solrconfig.xml (like in JSONResponseWriter). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534282#comment-13534282 ] Dawid Weiss commented on SOLR-4205: --- There is definitely a bug -- something I don't fully comprehend at the moment. It seems it may be related to running in very low-memory conditions (permgen exhausted, memory exhausted). I'll keep digging but I have some urgent stuff to do -- can we increase permgen limits, at least temporarily, on nightlies and clover builds? Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534284#comment-13534284 ] Uwe Schindler commented on SOLR-4205: - I will look into this! Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:688) [junit4:junit4] at
[jira] [Updated] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Heisey updated SOLR-4143: --- Attachment: SOLR-4143-alternate.patch From what I can tell, a response to an update request will be missing the entire results section. Looking at QueryResponse.java, when that is missing, getResults() will return null. I believe I have a fully functioning patch now. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate.patch, SOLR-4143-alternate-testsfailing.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: DocsEnum.freq()
How do these two go together? I think for DOCS_ONLY it makes sense that we lie (say freq=1 when we don't know): lots of places would otherwise have to be special cased for when they consume DOCS_ONLY vs DOCS_AND_POSITIONS. and I'm also not sure that all codecs return 1 today if the fields was indexed with DOCS_ONLY ... That just makes it even worse right? I.e., we have code today that relies no that behavior, but we're not sure it works w/ all Codecs? Remember that DocIdSetIterator.nextDoc() was loosely specified? It was very hard to write a decent DISI consumer. Sometimes calling nextDoc() returned MAX_VAL, sometimes -1, sometimes who knows. When we hardened the spec, it actually made consumers' life easier, I think? It's ok if we say that for DOCS_ONLY you have to return 1. That's even 99.9% of the time the correct value to return (unless someone adds e.g. the same StringField twice to the document). And it's also ok to say that if you passed FLAG_NONE, freq()'s value is unspecified. I think it would be wrong to lie here .. not sure if the consumer always knows how DocsEnum was requested. Not sure if this happens in real life though (consuming a DocsEnum that you didn't obtain yourself), so I'm willing to ignore that case. These two together sound like a reasonable spec to me? Shai On Mon, Dec 17, 2012 at 7:16 PM, Michael McCandless luc...@mikemccandless.com wrote: I think the FLAG_NONE (I don't need/want freqs when reading the index) and the DOCS_ONLY (Do not index freqs) are two different cases? I think for DOCS_ONLY it makes sense that we lie (say freq=1 when we don't know): lots of places would otherwise have to be special cased for when they consume DOCS_ONLY vs DOCS_AND_POSITIONS. But, for FLAG_NONE, when the caller passes this it means they have no intention of using/calling freq() right? Eg MultiTermQueryWrapperFilter would pass this. For that case I'm not sure we should promise / require that codecs return 1 always? EG what if the index does has freqs? I think in that case the codec shouldn't be required to go out of its way and return 1? I'm also not sure that all codecs return 1 today if the fields was indexed with DOCS_ONLY ... Mike McCandless http://blog.mikemccandless.com On Mon, Dec 17, 2012 at 11:24 AM, Shai Erera ser...@gmail.com wrote: Hi While migrating code to Lucene 4.0, I noticed that I have an assert on a field that is indexed with DOCS_ONLY that DocsEnum.freq() == 1. This got me thinking ... why? If you index w/ DOCS_ONLY, or ask for DocsEnum with FLAG_NONE, why do we lie to the consumer? Rather, we could just return 0 or -1? I personally don't mind if we continue to return 1, if there's a real reason to. I don't think that anyone should call freq() if he asked for DocsEnum with FLAG_NONE. But if we do keep the current behavior, can we at least document it? E.g., something like this patch: Index: lucene/core/src/java/org/apache/lucene/index/DocsEnum.java === --- lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (revision 1422804) +++ lucene/core/src/java/org/apache/lucene/index/DocsEnum.java (working copy) @@ -47,10 +47,16 @@ protected DocsEnum() { } - /** Returns term frequency in the current document. Do - * not call this before {@link #nextDoc} is first called, - * nor after {@link #nextDoc} returns NO_MORE_DOCS. - **/ + /** + * Returns term frequency in the current document, or 1 if the + * {@link DocsEnum} was obtained with {@link #FLAG_NONE}. Do not call this + * before {@link #nextDoc} is first called, nor after {@link #nextDoc} returns + * {@link DocIdSetIterator#NO_MORE_DOCS}. + * + * p + * bNOTE:/b if the {@link DocsEnum} was obtain with {@link #FLAG_NONE}, + * this method returns 1. + */ public abstract int freq() throws IOException; /** Returns the related attributes. */ Shai - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-3925) Expose SpanFirst in eDismax
[ https://issues.apache.org/jira/browse/SOLR-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534304#comment-13534304 ] David Smiley commented on SOLR-3925: Cool! Expose SpanFirst in eDismax --- Key: SOLR-3925 URL: https://issues.apache.org/jira/browse/SOLR-3925 Project: Solr Issue Type: Improvement Components: query parsers Affects Versions: 4.0-BETA Environment: solr-spec 5.0.0.2012.10.09.19.29.59 solr-impl 5.0-SNAPSHOT 1366361:1396116M - markus - 2012-10-09 19:29:59 Reporter: Markus Jelsma Fix For: 4.1, 5.0 Attachments: SOLR-3925-trunk-1.patch, SOLR-3925-trunk-2.patch Expose Lucene's SpanFirst capability in Solr's extended Dismax query parser. This issue adds the SF-parameter (SpanFirst) and takes a FIELD~DISTANCE^BOOST formatted value. For example, sf=title~5^2 will give a boost of 2 if one of the normal clauses, originally generated for automatic phrase queries, is located within five positions from the field's start. Unit test is included and all tests pass. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534314#comment-13534314 ] David Smiley commented on SOLR-4197: This sounds like a serious problem, although admittedly I can't think of how an attacker could subvert security rules (e.g. an 'fq') or otherwise spy on information that is otherwise concealed. Can you think of something Peter? EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: DocsEnum.freq()
On Mon, Dec 17, 2012 at 4:02 PM, Shai Erera ser...@gmail.com wrote: How do these two go together? I think for DOCS_ONLY it makes sense that we lie (say freq=1 when we don't know): lots of places would otherwise have to be special cased for when they consume DOCS_ONLY vs DOCS_AND_POSITIONS. and I'm also not sure that all codecs return 1 today if the fields was indexed with DOCS_ONLY ... That just makes it even worse right? I.e., we have code today that relies no that behavior, but we're not sure it works w/ all Codecs? Sorry, for my last sentence above I think I meant I'm also not sure that all codecs return 1 today if you ask for FLAG_NONE. Remember that DocIdSetIterator.nextDoc() was loosely specified? It was very hard to write a decent DISI consumer. Sometimes calling nextDoc() returned MAX_VAL, sometimes -1, sometimes who knows. When we hardened the spec, it actually made consumers' life easier, I think? Right, locking down the API makes total sense in general. It's ok if we say that for DOCS_ONLY you have to return 1. That's even 99.9% of the time the correct value to return (unless someone adds e.g. the same StringField twice to the document). Right. And it's also ok to say that if you passed FLAG_NONE, freq()'s value is unspecified. I think it would be wrong to lie here .. not sure if the consumer always knows how DocsEnum was requested. Not sure if this happens in real life though (consuming a DocsEnum that you didn't obtain yourself), so I'm willing to ignore that case. +1: I think FLAG_NONE should remain undefined. I think we have codecs today that will return 1, 0, the actual doc freq (when the field was indexed as = DOCS_AND_FREQS). These two together sound like a reasonable spec to me? +1 So I think just change your javadocs patch to say that FLAG_NONE means freq is not defined, and if field was indexed as DOCS_ONLY and you asked for FLAG_FREQS then we promise to lie and say freq=1? Mike McCandless http://blog.mikemccandless.com - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534335#comment-13534335 ] Yonik Seeley commented on SOLR-4197: bq. Apparently adding a space at the beginning is not a complete solution - I then get an exception when it's the standard lucene parser: A complete solution to what? You *should* get an error since it's not valid lucene syntax. The space did it's job and prevented the localParams from being interpreted as localParams. That's what you were trying to do, right? EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534350#comment-13534350 ] Markus Jelsma commented on SOLR-4197: - I think it's more graceful to ignore or strip local params per configuration instead of throwing an error, even for the user that for some crazy reason inputs a series of characters that is recognized as local params. If edismax is to be advertized as be able to handle direct end-user input it should never throw an error, but to do so developers must either strip it from the input before sending it to Solr or configure Solr to ignore or strip it. I would opt for an option to strip it completely. Right now we have to externally strip everything that looks like \{!.*\} EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-4258) Incremental Field Updates through Stacked Segments
[ https://issues.apache.org/jira/browse/LUCENE-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534352#comment-13534352 ] David Smiley commented on LUCENE-4258: -- Its exciting to see progress here! I too live in the world that Shai speaks of -- DOCS_ONLY (w/ no norms). I don't need to update a title field, I need to update ACLs and various categorical tag fields that will subsequently influence faceting or filtering. Hey Rob, early on you made this excellent point: {quote}A second problem (not solved by the above) is that many people are using scoring factors with a variety of signals and these are changing often. I think unfortunately, people are often putting these in a normal indexed field and uninverting these on the fieldcache, requiring the whole document to be reindexed just because of how they implemented the scoring factor. People could instead solve this by putting their apps primary key into a docvalues field, allowing them to keep these scoring factors completely external to lucene (e.g. their own array or whatever), indexed by their own primary key. But the problem is I think people want lucene to manage this, they don't want to implement themselves whats necessary to make it consistent with commits etc.{quote} So true. What if Lucene had more hooks to make it easier to manage commit-consistency with side-car data? I have no clue what's needed exactly, only that I don't dare do this without such hooks because I fear the complexity. With hooks and documentation, it can become clear how to maintain data alongside Lucene's index, and this opens doors. Like making it easier to store data in something custom (e.g. a DB) instead of stored-fields (won't have to pay needless merge cost), or putting metrics that influence scoring somewhere as you hinted at above. Incremental Field Updates through Stacked Segments -- Key: LUCENE-4258 URL: https://issues.apache.org/jira/browse/LUCENE-4258 Project: Lucene - Core Issue Type: Improvement Components: core/index Reporter: Sivan Yogev Attachments: IncrementalFieldUpdates.odp, LUCENE-4258-API-changes.patch, LUCENE-4258.r1410593.patch, LUCENE-4258.r1412262.patch, LUCENE-4258.r1416438.patch, LUCENE-4258.r1416617.patch, LUCENE-4258.r1422495.patch, LUCENE-4258.r1423010.patch Original Estimate: 2,520h Remaining Estimate: 2,520h Shai and I would like to start working on the proposal to Incremental Field Updates outlined here (http://markmail.org/message/zhrdxxpfk6qvdaex). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-3925) Expose SpanFirst in eDismax
[ https://issues.apache.org/jira/browse/SOLR-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534354#comment-13534354 ] Markus Jelsma commented on SOLR-3925: - Thanks for your comments Vlado. I haven't yet uploaded the patch that doesn't throw an error if it is not configured and haven't come to passing it through the analyzer yet or ignoring special characters. I'm not yet sure if we want to strip parens, i think it's the job of the analyzer. It is not included in a nightly build because it is not committed, for good reasons ;) Expose SpanFirst in eDismax --- Key: SOLR-3925 URL: https://issues.apache.org/jira/browse/SOLR-3925 Project: Solr Issue Type: Improvement Components: query parsers Affects Versions: 4.0-BETA Environment: solr-spec 5.0.0.2012.10.09.19.29.59 solr-impl 5.0-SNAPSHOT 1366361:1396116M - markus - 2012-10-09 19:29:59 Reporter: Markus Jelsma Fix For: 4.1, 5.0 Attachments: SOLR-3925-trunk-1.patch, SOLR-3925-trunk-2.patch Expose Lucene's SpanFirst capability in Solr's extended Dismax query parser. This issue adds the SF-parameter (SpanFirst) and takes a FIELD~DISTANCE^BOOST formatted value. For example, sf=title~5^2 will give a boost of 2 if one of the normal clauses, originally generated for automatic phrase queries, is located within five positions from the field's start. Unit test is included and all tests pass. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534368#comment-13534368 ] Yonik Seeley commented on SOLR-4197: bq. I think it's more graceful to ignore or strip local params per configuration instead of throwing an error, Yes, that's what edismax is for. I think in Peter's example he was using lucene qparser, which has a strict syntax. EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534373#comment-13534373 ] Yonik Seeley commented on SOLR-4197: Options for forcing edismax and prohibiting changing the query type or adding other parameters via localParams (as opposed to just defaulting): 1) prepend a space to the user query 2) prepend {!edismax} to the user query 3) use a different parameter: q={!edismax v=$qq}qq=user_query If you do any of these and get a syntax error back, then it's an edismax escaping bug that we need to handle. EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-4197) EDismax allows end users to use local params in q= to override global params
[ https://issues.apache.org/jira/browse/SOLR-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534373#comment-13534373 ] Yonik Seeley edited comment on SOLR-4197 at 12/17/12 10:19 PM: --- Options for forcing edismax and prohibiting changing the query type or adding other parameters via localParams (as opposed to just defaulting): {code} 1) prepend a space to the user query 2) prepend {!edismax} to the user query 3) use a different parameter: q={!edismax v=$qq}qq=user_query {code} If you do any of these and get a syntax error back, then it's an edismax escaping bug that we need to handle. was (Author: ysee...@gmail.com): Options for forcing edismax and prohibiting changing the query type or adding other parameters via localParams (as opposed to just defaulting): 1) prepend a space to the user query 2) prepend {!edismax} to the user query 3) use a different parameter: q={!edismax v=$qq}qq=user_query If you do any of these and get a syntax error back, then it's an edismax escaping bug that we need to handle. EDismax allows end users to use local params in q= to override global params Key: SOLR-4197 URL: https://issues.apache.org/jira/browse/SOLR-4197 Project: Solr Issue Type: Bug Affects Versions: 3.5, 3.6, 4.0 Reporter: Peter Wolanin Edismax is advertised as suitable to be used to process advanced user input directly. Thus, it would seem reasonable to have an application directly pass user input in the q= parameter to a back-end Solr server. However, it seems that users can enter local params at the start of q= which override the global params that the application (e.g. website) may have set on the query string. Confirmed with Erik Hatcher that this is somewhat unexpected behavior (though one could argue it's an expected feature of any query parser) Proposed fix - add a parameter (e.g. that can be used as an invariant) that can be passed to inhibit Solr from using local params from the q= parameter. This is somewhat related to SOLR-1687 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-4208) Refactor edismax query parser
Tomás Fernández Löbbe created SOLR-4208: --- Summary: Refactor edismax query parser Key: SOLR-4208 URL: https://issues.apache.org/jira/browse/SOLR-4208 Project: Solr Issue Type: Improvement Reporter: Tomás Fernández Löbbe Priority: Minor Fix For: 4.1, 5.0 With successive changes, the edismax query parser has become more complex. It would be nice to refactor it to reduce code complexity, also to allow better extension and code reuse. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4208) Refactor edismax query parser
[ https://issues.apache.org/jira/browse/SOLR-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomás Fernández Löbbe updated SOLR-4208: Attachment: SOLR-4208.patch A possible refactor: * I separated the ExtendedDismaxQParser so it can be extended. * I broke the parse method into smaller methods, easier to read. * Separated the configuration (parsing and all the actual fields) to a different class. DismaxQParser has too many configuration options, I think it's going to be clear if we keep those separately. * Using factory methods for the configuration and the ExtendedSolrQueryParser so that an extending class could change the implementation of those classes. * other minor changes. Thoughts? Refactor edismax query parser - Key: SOLR-4208 URL: https://issues.apache.org/jira/browse/SOLR-4208 Project: Solr Issue Type: Improvement Reporter: Tomás Fernández Löbbe Priority: Minor Fix For: 4.1, 5.0 Attachments: SOLR-4208.patch With successive changes, the edismax query parser has become more complex. It would be nice to refactor it to reduce code complexity, also to allow better extension and code reuse. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Resolved] (SOLR-4110) Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter
[ https://issues.apache.org/jira/browse/SOLR-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Miller resolved SOLR-4110. --- Resolution: Fixed Thanks Dominik! Configurable Content-Type headers for PHPResponseWriters and PHPSerializedResponseWriter Key: SOLR-4110 URL: https://issues.apache.org/jira/browse/SOLR-4110 Project: Solr Issue Type: Improvement Components: Response Writers Affects Versions: 4.0 Reporter: Dominik Siebel Assignee: Mark Miller Priority: Minor Labels: 4.0.1_Candidate Fix For: 4.1, 5.0 Attachments: SOLR-4110_branch_4x.patch, SOLR-4110.patch, SOLR-4110_trunk.patch The *PHPResponseWriter* and *PHPSerializedResponseWriter* currently send a hard coded Content-Type header of _text/plain; charset=UTF-8_ although there are constants defining _text/x-php;charset=UTF-8_ and _text/x-php-serialized;charset=UTF-8_ which remain unused. This makes content type guessing on the client side quite complicated. I already created a patch (from the branch_4x github branch) to use the respective constants and also added the possibility to configure the Content-Type header via solrconfig.xml (like in JSONResponseWriter). -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-3083) all JMX Mbeans are identified as java.lang.String even if numeric
[ https://issues.apache.org/jira/browse/SOLR-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534434#comment-13534434 ] Ryan Josal commented on SOLR-3083: -- I applied this patch to Solr 3.6 - I noticed it missed the hitratio mbean attribute from [Fast]LRUCache. Looks like that attribute is actually calculated into a String and so would have to be fixed by itself. I'm not sure if this is still present in the latest builds though. all JMX Mbeans are identified as java.lang.String even if numeric - Key: SOLR-3083 URL: https://issues.apache.org/jira/browse/SOLR-3083 Project: Solr Issue Type: Bug Components: SearchComponents - other Affects Versions: 4.0-ALPHA Reporter: Tagged Siteops Assignee: Ryan McKinley Priority: Minor Labels: interoperability,, jmx, monitoring, statistics Fix For: 4.0-ALPHA Attachments: Screen shot 2012-01-31 at 2.19.06 PM.png, SOLR-3083-Made-JMX-Mbean-information-use-numeric-typ.patch When trying to monitor our Solr instances with JMXtrans (https://github.com/lookfirst/jmxtrans), we discovered that all the Mbeans were identifying themselves as java.lang.String. This breaks the GangliaWriter in JMXtrans because the software decides it's a string instead of a numeric values and you can't graph a string. Other software we are monitoring with JMXtrans (e.g. Kafka) correctly identify their numeric values as numbers (doubles in this case). For example, avgTimePerRequest in Solr is identified as a string which makes no sense. This behavior makes Solr less interoperable with the rest of the Java ecosystem. The problem code is in JmxMonitoredMap.java NamedList dynamicStats = infoBean.getStatistics(); if (dynamicStats != null) { for (int i = 0; i dynamicStats.size(); i++) { String name = dynamicStats.getName(i); if (!staticStats.contains(name)) attrInfoList.add(new MBeanAttributeInfo(dynamicStats.getName(i), String.class.getName(), null, true, false, false)); } I will try to attach a screenshot. Thanks for Solr! We use the heck out of it, it's awesome. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!
On Dec 17, 2012, at 7:31 PM, Mark Miller markrmil...@gmail.com wrote: Socket read timeouts. I'll raise it for this case. Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long. One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance: [junit4:junit4] 1 Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest] [junit4:junit4] 1 java.lang.Thread.sleep(Native Method) [junit4:junit4] 1 java.lang.Thread.sleep(Thread.java:338) [junit4:junit4] 1 org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78) [junit4:junit4] 1 org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61) [junit4:junit4] 1 org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!
These are the MB/s values I have - I didn't think they would kick in during our tests? double name=maxWriteMBPerSecDefault100/double double name=maxWriteMBPerSecFlush200/double double name=maxWriteMBPerSecMerge300/double double name=maxWriteMBPerSecRead400/double Mark On Dec 17, 2012, at 7:35 PM, Mark Miller markrmil...@gmail.com wrote: On Dec 17, 2012, at 7:31 PM, Mark Miller markrmil...@gmail.com wrote: Socket read timeouts. I'll raise it for this case. Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long. One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance: [junit4:junit4] 1 Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest] [junit4:junit4] 1 java.lang.Thread.sleep(Native Method) [junit4:junit4] 1 java.lang.Thread.sleep(Thread.java:338) [junit4:junit4] 1 org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78) [junit4:junit4] 1 org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61) [junit4:junit4] 1 org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[JENKINS-MAVEN] Lucene-Solr-Maven-trunk #710: POMs out of sync
Build: https://builds.apache.org/job/Lucene-Solr-Maven-trunk/710/ No tests ran. Build Log: [...truncated 11065 lines...] - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534542#comment-13534542 ] Shawn Heisey commented on SOLR-4143: Going back to the OverseerTest that I noted was failing before -- I have been having a lot of nearly identical failures in a lot of programs lately, OOMs when trying to create a thread. One of the programs that is having this failure is a very small servlet (SolrJ-based) that cycles between 15 and 25MB of heap usage, then suddenly it crashes with an OOM, with no changes in access. I am suspecting that the OOM problem might actually be in the jdk 1.7.0_09 (linux x64) that I was using. I have upgraded that to 1.7.0_10 to see if it gets better. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate.patch, SOLR-4143-alternate-testsfailing.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Comment Edited] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534542#comment-13534542 ] Shawn Heisey edited comment on SOLR-4143 at 12/18/12 2:15 AM: -- Going back to the OverseerTest that I noted was failing before -- I have been having a lot of nearly identical failures in a lot of programs lately, OOMs when trying to create a thread. One of the programs that is having this failure is a very small servlet (SolrJ-based) that cycles between 15 and 25MB of heap usage, then suddenly it crashes with an OOM, with no changes in access. The JVM has a 1GB max heap, and jconsole shows no growth pattern in memory usage, then at the crash point it goes down to zero. I am suspecting that the OOM problem might actually be in the jdk 1.7.0_09 (linux x64) that I was using. I have upgraded that to 1.7.0_10 to see if it gets better. was (Author: elyograg): Going back to the OverseerTest that I noted was failing before -- I have been having a lot of nearly identical failures in a lot of programs lately, OOMs when trying to create a thread. One of the programs that is having this failure is a very small servlet (SolrJ-based) that cycles between 15 and 25MB of heap usage, then suddenly it crashes with an OOM, with no changes in access. I am suspecting that the OOM problem might actually be in the jdk 1.7.0_09 (linux x64) that I was using. I have upgraded that to 1.7.0_10 to see if it gets better. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate.patch, SOLR-4143-alternate-testsfailing.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS-MAVEN] Lucene-Solr-Maven-trunk #710: POMs out of sync
I committed a fix for this (missing SHA1 file for randomizedtesting-runner dependency): upgraded to v2.0.7 in trunk and on branch_4x. On Dec 17, 2012, at 8:34 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-Maven-trunk/710/ No tests ran. Build Log: [...truncated 11065 lines...] - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534550#comment-13534550 ] Commit Tag Bot commented on SOLR-4205: -- [trunk commit] Steven Rowe http://svn.apache.org/viewvc?view=revisionrevision=1423252 SOLR-4205: Maven configuration: upgrade randomizedtesting-runner to v2.0.7 Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534551#comment-13534551 ] Commit Tag Bot commented on SOLR-4205: -- [branch_4x commit] Steven Rowe http://svn.apache.org/viewvc?view=revisionrevision=1423253 SOLR-4205: Maven configuration: upgrade randomizedtesting-runner to v2.0.7 (merge trunk r1423252) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189)
[jira] [Comment Edited] (SOLR-3180) ChaosMonkey test failures
[ https://issues.apache.org/jira/browse/SOLR-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534598#comment-13534598 ] Yonik Seeley edited comment on SOLR-3180 at 12/18/12 3:35 AM: -- Unfortunately, the chaos monkey tests have gathered some rust due to not being run regularly. I've added some instrumentation for one particular type of fail (number of docs mismatch between control and collection) and ran into something peculiar. selected lines from test_report_1.txt {code} 6952 T39 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:60440/ij/pf shardId:shard1 9734 T56 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:48048/ij/pf shardId:shard1 12184 T71 oasc.ZkController.register Register shard - core: collection1 address:http://127.0.0.1:33264/ij/pf shardId:shard2 59069 T27 C12 P60440 /update {wt=javabinversion=2} {add=[50067 (1421643212854919168)]} 0 3 89123 T48 C1 P48048 /update {wt=javabinversion=2} {add=[50067 (1421643244360433664)]} 0 10 89354 T25 C12 P60440 /update {wt=javabinversion=2} {delete=[50067 (-1421643244613140480)]} 0 1 89364 T47 C1 P48048 /update {wt=javabinversion=2} {delete=[50067 (-1421643244618383360)]} 0 6 90114 T63 C3 P33264 /update {wt=javabinversion=2} {add=[50067]} 0 31041 217860 T10 oasc.AbstractFullDistribZkTestBase.checkShardConsistency SEVERE document count mismatch. control=1460 sum(shards)=1461 cloudClient=1461 [junit4:junit4] ## Only in cloudDocList: [{id=50067}] {code} The only updates we see from the logs for id 50067 are to collection1 (none to the control shard). Further, grepping for Register shard shows that they are all for collection1 and none for the control collection. Not sure how that's possible and only be off by 1, so I'm probably mis-interpreting the logging somehow... was (Author: ysee...@gmail.com): Unfortunately, the chaos monkey tests have gathered some rust due to not being run regularly. I've added some instrumentation for one particular type of fail (number of docs mismatch between control and collection) and ran into something peculiar. selected lines from test_report_1.txt {code} 6952 T39 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:60440/ij/pf shardId:shard1 9734 T56 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:48048/ij/pf shardId:shard1 12184 T71 oasc.ZkController.register Register shard - core: collection1 address:http://127.0.0.1:33264/ij/pf shardId:shard2 59069 T27 C12 P60440 /update {wt=javabinversion=2} {add=[50067 (1421643212854919168)]} 0 3 89123 T48 C1 P48048 /update {wt=javabinversion=2} {add=[50067 (1421643244360433664)]} 0 10 89354 T25 C12 P60440 /update {wt=javabinversion=2} {delete=[50067 (-1421643244613140480)]} 0 1 89364 T47 C1 P48048 /update {wt=javabinversion=2} {delete=[50067 (-1421643244618383360)]} 0 6 90114 T63 C3 P33264 /update {wt=javabinversion=2} {add=[50067]} 0 31041 217860 T10 oasc.AbstractFullDistribZkTestBase.checkShardConsistency SEVERE document count mismatch. control=1460 sum(shards)=1461 cloudClient=1461 [junit4:junit4] 2 ## Only in cloudDocList: [{id=50067}] {code} The only updates we see from the logs for id 50067 are to collection1 (none to the control shard). Further, grepping for Register shard shows that they are all for collection1 and none for the control collection. Not sure how that's possible and only be off by 1, so I'm probably mis-interpreting the logging somehow... ChaosMonkey test failures - Key: SOLR-3180 URL: https://issues.apache.org/jira/browse/SOLR-3180 Project: Solr Issue Type: Bug Components: SolrCloud Reporter: Yonik Seeley Attachments: test_report_1.txt Handle intermittent failures in the ChaosMonkey tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-3180) ChaosMonkey test failures
[ https://issues.apache.org/jira/browse/SOLR-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yonik Seeley updated SOLR-3180: --- Attachment: test_report_1.txt Unfortunately, the chaos monkey tests have gathered some rust due to not being run regularly. I've added some instrumentation for one particular type of fail (number of docs mismatch between control and collection) and ran into something peculiar. selected lines from test_report_1.txt {code} 6952 T39 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:60440/ij/pf shardId:shard1 9734 T56 oasc.ZkController.register Register shard - core:c ollection1 address:http://127.0.0.1:48048/ij/pf shardId:shard1 12184 T71 oasc.ZkController.register Register shard - core: collection1 address:http://127.0.0.1:33264/ij/pf shardId:shard2 59069 T27 C12 P60440 /update {wt=javabinversion=2} {add=[50067 (1421643212854919168)]} 0 3 89123 T48 C1 P48048 /update {wt=javabinversion=2} {add=[50067 (1421643244360433664)]} 0 10 89354 T25 C12 P60440 /update {wt=javabinversion=2} {delete=[50067 (-1421643244613140480)]} 0 1 89364 T47 C1 P48048 /update {wt=javabinversion=2} {delete=[50067 (-1421643244618383360)]} 0 6 90114 T63 C3 P33264 /update {wt=javabinversion=2} {add=[50067]} 0 31041 217860 T10 oasc.AbstractFullDistribZkTestBase.checkShardConsistency SEVERE document count mismatch. control=1460 sum(shards)=1461 cloudClient=1461 [junit4:junit4] 2 ## Only in cloudDocList: [{id=50067}] {code} The only updates we see from the logs for id 50067 are to collection1 (none to the control shard). Further, grepping for Register shard shows that they are all for collection1 and none for the control collection. Not sure how that's possible and only be off by 1, so I'm probably mis-interpreting the logging somehow... ChaosMonkey test failures - Key: SOLR-3180 URL: https://issues.apache.org/jira/browse/SOLR-3180 Project: Solr Issue Type: Bug Components: SolrCloud Reporter: Yonik Seeley Attachments: test_report_1.txt Handle intermittent failures in the ChaosMonkey tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!
This test only brings servers up at the beginning and that's it (i.e. any recovery would be of an empty index). It feels like we're throwing too many random elements into higher level tests here - introducing too many variables at once (i.e. the random Directory implementations). -Yonik http://lucidworks.com On Mon, Dec 17, 2012 at 7:57 PM, Mark Miller markrmil...@gmail.com wrote: These are the MB/s values I have - I didn't think they would kick in during our tests? double name=maxWriteMBPerSecDefault100/double double name=maxWriteMBPerSecFlush200/double double name=maxWriteMBPerSecMerge300/double double name=maxWriteMBPerSecRead400/double Mark On Dec 17, 2012, at 7:35 PM, Mark Miller markrmil...@gmail.com wrote: On Dec 17, 2012, at 7:31 PM, Mark Miller markrmil...@gmail.com wrote: Socket read timeouts. I'll raise it for this case. Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long. One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance: [junit4:junit4] 1 Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest] [junit4:junit4] 1 java.lang.Thread.sleep(Native Method) [junit4:junit4] 1 java.lang.Thread.sleep(Thread.java:338) [junit4:junit4] 1 org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78) [junit4:junit4] 1 org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61) [junit4:junit4] 1 org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
OOM failures caused by java 1.7.0_09?
I have been seeing a bunch of random failures, both in Solr tests and my own SolrJ programs. They all start with the following in the stacktrace: java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method) at java.lang.Thread.start(Thread.java:691) Common elements: 1) SolrJ/Solr 4.1-SNAPSHOT. 2) G1 garbage collector. 3) Built and run with oracle jdk 1.7.0_09 on CentOS 6 x64, using RPMs created with the following guide: http://www.city-fan.org/tips/OracleJava7OnFedora One of the programs consistently uses less than 25MB of heap, because it uses idle moments to do garbage collection. I have watched the heap with jconsole to verify this. It has been configured with a max heap of 1GB, so I am very sure that there is no actual memory pressure. Since rebooting and upgrading to 1.7.0_10, I have not seen any further OOM problems despite pounding on everything repeatedly. Has anyone else seen anything similar? Thanks, Shawn
Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_09) - Build # 2203 - Failure!
The rate limited dir is not random - its being used in most tests as most tests use the std solrconfig.xml - it's hard coded but it's just using really high values with the idea it would not do any limiting. This was done so I could see it didn't have a bad affect and test that the settings matched what was in the config. The settings are so high I don't think it should ever be sleeping like it is. - Mark On Dec 17, 2012, at 10:45 PM, Yonik Seeley yo...@lucidworks.com wrote: This test only brings servers up at the beginning and that's it (i.e. any recovery would be of an empty index). It feels like we're throwing too many random elements into higher level tests here - introducing too many variables at once (i.e. the random Directory implementations). -Yonik http://lucidworks.com On Mon, Dec 17, 2012 at 7:57 PM, Mark Miller markrmil...@gmail.com wrote: These are the MB/s values I have - I didn't think they would kick in during our tests? double name=maxWriteMBPerSecDefault100/double double name=maxWriteMBPerSecFlush200/double double name=maxWriteMBPerSecMerge300/double double name=maxWriteMBPerSecRead400/double Mark On Dec 17, 2012, at 7:35 PM, Mark Miller markrmil...@gmail.com wrote: On Dec 17, 2012, at 7:31 PM, Mark Miller markrmil...@gmail.com wrote: Socket read timeouts. I'll raise it for this case. Nevermind - it's already at 60 seconds. What's odd is that the commit is taking that long. One of the threads is waiting in the rate limiter - which is weird - I thought I put it absurdly high for tests. I'll dig into it when I get a chance: [junit4:junit4] 1 Thread[qtp29204452-1358,5,TGRP-ShardRoutingTest] [junit4:junit4] 1 java.lang.Thread.sleep(Native Method) [junit4:junit4] 1 java.lang.Thread.sleep(Thread.java:338) [junit4:junit4] 1 org.apache.lucene.store.RateLimiter$SimpleRateLimiter.pause(RateLimiter.java:111) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flushBuffer(RateLimitedIndexOutput.java:45) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:90) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:79) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.flush(RateLimitedIndexOutput.java:69) [junit4:junit4] 1 org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:103) [junit4:junit4] 1 org.apache.lucene.store.RateLimitedIndexOutput.close(RateLimitedIndexOutput.java:78) [junit4:junit4] 1 org.apache.lucene.store.ChecksumIndexOutput.close(ChecksumIndexOutput.java:61) [junit4:junit4] 1 org.apache.lucene.index.SegmentInfos.finishCommit(SegmentInfos.java:927) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.finishCommit(IndexWriter.java:2826) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2815) [junit4:junit4] 1 org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2788) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-3180) ChaosMonkey test failures
[ https://issues.apache.org/jira/browse/SOLR-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534659#comment-13534659 ] Commit Tag Bot commented on SOLR-3180: -- [trunk commit] Yonik Seeley http://svn.apache.org/viewvc?view=revisionrevision=1423275 SOLR-3180: improve logging ChaosMonkey test failures - Key: SOLR-3180 URL: https://issues.apache.org/jira/browse/SOLR-3180 Project: Solr Issue Type: Bug Components: SolrCloud Reporter: Yonik Seeley Attachments: test_report_1.txt Handle intermittent failures in the ChaosMonkey tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-3180) ChaosMonkey test failures
[ https://issues.apache.org/jira/browse/SOLR-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534668#comment-13534668 ] Commit Tag Bot commented on SOLR-3180: -- [branch_4x commit] Yonik Seeley http://svn.apache.org/viewvc?view=revisionrevision=1423276 SOLR-3180: improve logging ChaosMonkey test failures - Key: SOLR-3180 URL: https://issues.apache.org/jira/browse/SOLR-3180 Project: Solr Issue Type: Bug Components: SolrCloud Reporter: Yonik Seeley Attachments: test_report_1.txt Handle intermittent failures in the ChaosMonkey tests. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4143) setRequestHandler - option to not set qt parameter
[ https://issues.apache.org/jira/browse/SOLR-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Heisey updated SOLR-4143: --- Attachment: SOLR-4143-alternate-trunk.patch SOLR-4143-alternate-4x.patch Patches that are completely up to date with newest revisions of 4x and trunk. setRequestHandler - option to not set qt parameter -- Key: SOLR-4143 URL: https://issues.apache.org/jira/browse/SOLR-4143 Project: Solr Issue Type: Improvement Components: clients - java Affects Versions: 4.0 Environment: solr-impl4.1-SNAPSHOT 1416639M - ncindex - 2012-12-03 12:54:38 Reporter: Shawn Heisey Fix For: 4.1, 5.0 Attachments: SOLR-4143-alternate-4x.patch, SOLR-4143-alternate.patch, SOLR-4143-alternate-testsfailing.patch, SOLR-4143-alternate-trunk.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch, SOLR-4143.patch The setRequestHandler method does what I expect in one way - it changes the URL path from /select to the String argument. It is however doing something that I did not expect, which is setting the qt parameter on the query as well. Here is the code: private static final String PING_HANDLER = /admin/ping; query.setRequestHandler(PING_HANDLER); This is resulting in the following exception being logged in my Solr 3.5.0 servers. I am not including the whole exception, because this issue is for SolrJ 4, not Solr 3.5, and the 3.5 version is working as it was designed. {code} Dec 3, 2012 4:04:01 PM org.apache.solr.common.SolrException log SEVERE: org.apache.solr.common.SolrException: Cannot execute the PingRequestHandler recursively at org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:60) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:208) {code} I believe it would be useful to include an alternate setRequestHandler method that includes a boolean option deciding whether or not to also set the qt parameter. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Created] (SOLR-4209) asm-3.1.jar is missing
Shinichiro Abe created SOLR-4209: Summary: asm-3.1.jar is missing Key: SOLR-4209 URL: https://issues.apache.org/jira/browse/SOLR-4209 Project: Solr Issue Type: Bug Components: contrib - Solr Cell (Tika extraction) Affects Versions: 4.0 Reporter: Shinichiro Abe Priority: Minor One of Tika dependency file is missing on Solr 4.0. When posting java class files into Solr via SolrCell, those files can't be indexed without asm-3.1.jar. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Updated] (SOLR-4209) asm-3.1.jar is missing
[ https://issues.apache.org/jira/browse/SOLR-4209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichiro Abe updated SOLR-4209: - Attachment: SOLR-4209.patch Here is a patch. Please apply this. asm-3.1.jar is missing -- Key: SOLR-4209 URL: https://issues.apache.org/jira/browse/SOLR-4209 Project: Solr Issue Type: Bug Components: contrib - Solr Cell (Tika extraction) Affects Versions: 4.0 Reporter: Shinichiro Abe Priority: Minor Attachments: SOLR-4209.patch One of Tika dependency file is missing on Solr 4.0. When posting java class files into Solr via SolrCell, those files can't be indexed without asm-3.1.jar. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-4205) Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor
[ https://issues.apache.org/jira/browse/SOLR-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13534728#comment-13534728 ] Dawid Weiss commented on SOLR-4205: --- Thanks Steve, although 2.0.7 doesn't seem to solve the hang-on-OOM issue :( Clover runs on ASF Jenkins idle dead without a test or any thread running in main() loop waiting for file descriptor Key: SOLR-4205 URL: https://issues.apache.org/jira/browse/SOLR-4205 Project: Solr Issue Type: Bug Components: Tests Environment: FreeBSD Jenkins Reporter: Uwe Schindler Assignee: Dawid Weiss I had to kill ASF Jenkins Clover builds two times after several 10 hours of inactivity in a random Solr test. I requested a stack trace before killing the only running JVM (clover runs with one JVM only, because clover does not like multiple processes writing the same clover metrics file). In both cases (4.x and trunk) the stack trace was looking identical after sending kill -3... https://builds.apache.org/job/Lucene-Solr-Clover-trunk/76/consoleFull (yesterday): {noformat} [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:01:00, stalled for 28447s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:02:00, stalled for 28507s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] HEARTBEAT J0 PID(81...@lucene.zones.apache.org): 2012-12-16T13:03:00, stalled for 28567s at: TestFunctionQuery.testBooleanFunctions [junit4:junit4] JVM J0: stdout was not empty, see: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Clover-trunk/solr/build/solr-core/test/temp/junit4-J0-20121216_044733_583.sysout [junit4:junit4] JVM J0: stdout (verbatim) [junit4:junit4] 2012-12-16 13:03:49 [junit4:junit4] Full thread dump OpenJDK 64-Bit Server VM (20.0-b12 mixed mode): [junit4:junit4] [junit4:junit4] searcherExecutor-2577-thread-1 prio=5 tid=0x00085eb67000 nid=0x61c105b waiting on condition [0x70b0d000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x0008178c9c40 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) [junit4:junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI TCP Accept-0 daemon prio=5 tid=0x000840ce2800 nid=0x61c0aa2 runnable [0x79496000] [junit4:junit4]java.lang.Thread.State: RUNNABLE [junit4:junit4] at java.net.PlainSocketImpl.socketAccept(Native Method) [junit4:junit4] at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:375) [junit4:junit4] at java.net.ServerSocket.implAccept(ServerSocket.java:470) [junit4:junit4] at java.net.ServerSocket.accept(ServerSocket.java:438) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387) [junit4:junit4] at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359) [junit4:junit4] at java.lang.Thread.run(Thread.java:679) [junit4:junit4] [junit4:junit4] RMI Scheduler(0) daemon prio=5 tid=0x000840ce1000 nid=0x61c0969 waiting on condition [0x70f11000] [junit4:junit4]java.lang.Thread.State: WAITING (parking) [junit4:junit4] at sun.misc.Unsafe.park(Native Method) [junit4:junit4] - parking to wait for 0x000814f12f88 (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) [junit4:junit4] at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) [junit4:junit4] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) [junit4:junit4] at java.util.concurrent.DelayQueue.take(DelayQueue.java:189) [junit4:junit4] at