Faceted browsing: status
From the Tasklist wiki: - Simple faceted browsing (grouping) support in the standard query handler - group by field (provide counts for each distinct value in that field) - group by (query1, query2, query3, query4, query5) How far/close is this task to completion? (I'm trying to gauge time/effort here.) -- j
RE: SOlr crashes
Something else to consider is using the compound file format to reduce the number of files for your index. this is mentioned in the Lucen FAQ... http://wiki.apache.org/jakarta-lucene/LuceneFAQ#head-48921635adf2c968f7936dc07d51dfb40d638b82 ...and configurable in solrconfig.xml, search the example for "useCompoundFile" : Date: Mon, 14 Aug 2006 07:36:00 +0100 : From: David Wiblin <[EMAIL PROTECTED]> : Reply-To: solr-user@lucene.apache.org : To: solr-user@lucene.apache.org : Subject: RE: SOlr crashes : : : A common problem with any server running lucene becasue it needs to open lots of file handles - often more than the linux default of 1024. : : Here's the fix for a linux system... : : Edit the file: /etc/security/limits.conf : : Add to the bottom: : : * soft nofile 16384 : * hard nofile 16384 : : Restart any console windows you have open and when you run ulimit -a you should get something like: : : core file size (blocks, -c) 0 : data seg size (kbytes, -d) unlimited : file size (blocks, -f) unlimited : max locked memory (kbytes, -l) unlimited : max memory size (kbytes, -m) unlimited : open files (-n) 16384 : pipe size (512 bytes, -p) 8 : stack size (kbytes, -s) 8192 : cpu time (seconds, -t) unlimited : max user processes (-u) 7168 : virtual memory (kbytes, -v) unlimited : : Restarting Solr... your "too many file handles" crash should be reoslved. : : Best regards, : : David : : : : -Original Message- : From: farhan diwan [mailto:[EMAIL PROTECTED] : Sent: 14 August 2006 07:29 : To: solr-user@lucene.apache.org : Subject: SOlr crashes : : : It crashes giving this output. : : =java.net.SocketException: Too many open files : at java.net.ServerSocket.createImpl(ServerSocket.java:255) : at java.net.ServerSocket.getImpl(ServerSocket.java:205) : at java.net.ServerSocket.bind(ServerSocket.java:319) : at java.net.ServerSocket.(ServerSocket.java:185) : at org.mortbay.util.ThreadedServer.newServerSocket( : ThreadedServer.java:391) : at org.mortbay.util.ThreadedServer.open(ThreadedServer.java:477) : at org.mortbay.util.ThreadedServer.start(ThreadedServer.java:503) : at org.mortbay.http.SocketListener.start(SocketListener.java:204) : at org.mortbay.http.HttpServer.doStart(HttpServer.java:716) : at org.mortbay.util.Container.start(Container.java:72) : at org.mortbay.jetty.Server.main(Server.java:460) : at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) : at sun.reflect.NativeMethodAccessorImpl.invoke( : NativeMethodAccessorImpl.java:39) : at sun.reflect.DelegatingMethodAccessorImpl.invoke( : DelegatingMethodAccessorImpl.java:25) : at java.lang.reflect.Method.invoke(Method.java:585) : at org.mortbay.start.Main.invokeMain(Main.java:151) : at org.mortbay.start.Main.start(Main.java:476) : at org.mortbay.start.Main.main(Main.java:94) : -Hoss
Re: SOlr crashes
On 8/14/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: Something else to consider is using the compound file format to reduce the number of files for your index. this is mentioned in the Lucen FAQ... Yeah, although unless you have a *lot* of fields with norms, I'd sooner reduce the mergeFactor and increase maxBufferedDocs to keep the number of files under control. -Yonik
Re: Faceted browsing: status
:Simple faceted browsing (grouping) support in the standard query :handler : group by field (provide counts for each distinct value in that : field) : group by (query1, query2, query3, query4, query5) : How far/close is this task to completion? (I'm trying to gauge time/effort : here.) I can't commit to anything ... but it's something i'm hoping to impliment in the next few weeks. -Hoss
Mac OSX - error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib
Hi all, I am trying to run Solr on OSX, after a successful installation and tests on Linux, while trying to run with JDK 1.5.0, I am getting the following exception... HTTP ERROR: 500 Unable to compile class for JSP Generated servlet error: error: error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib; java.util.zip.ZipException: error in opening zip file Note: /tmp/Jetty__8983__solr_23999/org/apache/jsp/admin/ index_jsp.java uses unchecked or unsafe operations. I have checked /usr/local/lib and can see that 'libsvnjavahl-1.0.0.0.dylib' is in fact present there, I assume it is probably quite easy to fix this, or that plenty of people are running Solr on OSX, I would appreciate any advice on how to fix this up, thanks for your time, Ross McDonald ___ Inbox full of spam? Get leading spam protection and 1GB storage with All New Yahoo! Mail. http://uk.docs.yahoo.com/nowyoucan.html
Re: Mac OSX - error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib
The older version of Jetty that we are using requires the JDK version, not the JRE version of 'java' so it can compile JSPs via javac. Maybe that's be the problem? Try typing the full path to the java executable to verify. -Yonik On 8/14/06, Ross McDonald <[EMAIL PROTECTED]> wrote: Hi all, I am trying to run Solr on OSX, after a successful installation and tests on Linux, while trying to run with JDK 1.5.0, I am getting the following exception... HTTP ERROR: 500 Unable to compile class for JSP Generated servlet error: error: error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib; java.util.zip.ZipException: error in opening zip file Note: /tmp/Jetty__8983__solr_23999/org/apache/jsp/admin/ index_jsp.java uses unchecked or unsafe operations. I have checked /usr/local/lib and can see that 'libsvnjavahl-1.0.0.0.dylib' is in fact present there, I assume it is probably quite easy to fix this, or that plenty of people are running Solr on OSX, I would appreciate any advice on how to fix this up, thanks for your time, Ross McDonald
Re: Mac OSX - error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib
: The older version of Jetty that we are using requires the JDK version, : not the JRE version of 'java' so it can compile JSPs via javac. Maybe : that's be the problem? Try typing the full path to the java : executable to verify. Perhaps ... but this seems like an awfully strnage exception to get if the problem were that it can't find the compiler... : > error: error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib; : > java.util.zip.ZipException: error in opening zip file ...he said that /usr/local/lib/libsvnjavahl-1.0.0.0.dylib did in fact exist. (I would expect a class not found or an attempt at opening a file that doesn't exist in the other case) I don't really know much about Java on Macs, or what a "dylib" file is ... but the exception seems to indicate that it's expecting to find a Zip file (possible a jar?) Ross: does "unzip -l" or "jar tf" on /usr/local/lib/libsvnjavahl-1.0.0.0.dylib work for you? -Hoss
Re: Mac OSX - error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib
Thanks for the quick response guys, I am using jdk 1.5, and am ensuring use of this jdk by typing the full path. As regards doing an 'unzip -l' on the file it indeed generates an error.. /usr/local/lib rossputin$ unzip -l libsvnjavahl-1.0.0.0.dylib Archive: libsvnjavahl-1.0.0.0.dylib End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In the latter case the central directory and zipfile comment will be found on the last disk(s) of this archive. note: libsvnjavahl-1.0.0.0.dylib may be a plain executable, not an archive unzip: cannot find zipfile directory in one of libsvnjavahl-1.0.0.0.dylib or libsvnjavahl-1.0.0.0.dylib.zip, and cannot find libsvnjavahl-1.0.0.0.dylib.ZIP, period. oh dear.. maybe this is corrupt? A 'jar tvf' generates no output, once again indicating that the file is not a valid jar, regards, Ross. On 15 Aug 2006, at 00:09, Chris Hostetter wrote: : The older version of Jetty that we are using requires the JDK version, : not the JRE version of 'java' so it can compile JSPs via javac. Maybe : that's be the problem? Try typing the full path to the java : executable to verify. Perhaps ... but this seems like an awfully strnage exception to get if the problem were that it can't find the compiler... : > error: error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib; : > java.util.zip.ZipException: error in opening zip file ...he said that /usr/local/lib/libsvnjavahl-1.0.0.0.dylib did in fact exist. (I would expect a class not found or an attempt at opening a file that doesn't exist in the other case) I don't really know much about Java on Macs, or what a "dylib" file is ... but the exception seems to indicate that it's expecting to find a Zip file (possible a jar?) Ross: does "unzip -l" or "jar tf" on /usr/local/lib/libsvnjavahl-1.0.0.0.dylib work for you? -Hoss ___ Try the all-new Yahoo! Mail. "The New Version is radically easier to use" The Wall Street Journal http://uk.docs.yahoo.com/nowyoucan.html
Re: Mac OSX - error reading /usr/local/lib/libsvnjavahl-1.0.0.0.dylib
: oh dear.. maybe this is corrupt? : : A 'jar tvf' generates no output, once again indicating that the file : is not a valid jar, maybe ... i'm not convinced that file is suppose to be a zip/jar (i don't really get "dylib" files) ... just that java seems to think it should be. here's an interesting message from someone with a similar problem... https://mail.internet2.edu/wws/arc/shibboleth-dev/2005-08/msg00021.html ...according to this guy, that dylib is a JNI for subversion!? -Hoss
