Re: [Dspace-tech] Browse configuration
Greetings, Re: the post below from April: We would like to exlude one dc.subject qualifier (specifically, dc.subject.lcc) from the browse list, but include all the other dc.subject qualifiers. As far as I can tell, there's currently no way to do that. Has this been addressed, or will it be addressed in 1.5? Are other folks still interested in it? Thanks, Bill Anderson Digital Library Development Georgia Tech Library (My apologies to all if this shows up twice - I think I posted it before I was officially subscribed) > -original message- > From: *Richard Jones* <[EMAIL PROTECTED]> > Date: Apr 21, 2007 6:36 AM > > Hi Jeffrey, > > That particular configuration is wrong, I'm afraid. The browse > configuration is only designed to take a single metadata field to index > on (so using a comma delimited list of metadata fields will not work). > I have recently uploaded a new browse system which has greater > configuration options, although what you are trying to do here still > will not work. Is this something that other people wish to be able to > do, too? > > Cheers, > > Richard > > > -- > This email was composed using the Library Webmail client. > > The information transmitted is intended only for the person or entity > to which it is addressed and may contain confidential and/or > privileged material. Any review, retransmission, dissemination or > other use of, or taking of any action in reliance upon, this > information by persons or entities other than the intended recipient > is prohibited. > >Georgia Tech Library and Information Center > http://www.library.gatech.edu > -- > -- This email was composed using the Library Webmail client. The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. Georgia Tech Library and Information Center http://www.library.gatech.edu -- - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] Any way to reorder the lists of communities/collections?
In Dspace 1.5.2, anyway, the sql for listing communities is in the class org.dspace.content.Community; search for "ORDER BY". There are four pertinent sql statements, returning lists of all communities, top-level communities, sub-communities and collections within communities. There's a statement in org.dspace.content.Collection that returns a list of all collections. You should be able to do overlays of these classes that change the ordering; but I haven't tried it and don't know if there are any gotchas lurking in the wings. Bill Anderson Software Developer Digital Library Development Georgia Tech Library - "Andrew Marlow" wrote: | | On Fri, Jun 12, 2009 at 2:49 PM, gathub < thermalfluids...@gmail.com > wrote: | | Right now, all the communities and collections are listed alphabetically when | displayed. My managers are looking to give a specific order to the | collections; maybe ordering them by their ID number or time created. I have | not been able to find any way to modify the SQL statements, however. | | Does anyone know where I might be able to find the code containing the SQL | statements so I could make this change? Thanks | I don't know, but I would like to make a related comment. In another digital library system I am working on the ordering id comes across in the metadata. This is how we order the articles within an issue. So if you could add this to the metadata by extending your schema you might be able to do the sort yourself (I'm not sure how easy/difficult that would be to do). | -- | Regards, | | Andrew M. | http://www.andrewpetermarlow.co.uk | | | -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects | ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech -- Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] DSpace search weirdness
Correct me if I don't have this right: you had an existing instance of dspace, where search worked properly. You cloned the instance to new server, and after the transfer, media filter wasn't able to extract full text properly from PDFs with special characters in them. When you re-submit the PDFs to the new instance, media filter (and thus search) works as it should? It's possible the pdfs were damaged in the transfer. How did you transfer them? I assume you're not seeing any errors in the media filter output, right? Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library - "mikan.d.dspace listmail" wrote: | Hi Stuart, | As I mentioned in my earlier post, runnin filter-media with --force | (-f) switch didnt fix the problem. | | -Mika | | 2009/6/16 Stuart Lewis : | > Hi Mika, | > | > Since running filter-media on new items seems OK, have you tried | running: | > | > [dspace]/bin/filter-media -f | > | > -f forces all the bitstreams to be re-filtered. | > | > Thanks, | > | > | > Stuart Lewis | > Digital Services Programmer | > Te Tumu Herenga The University of Auckland Library | > Auckland Mail Centre, Private Bag 92019, Auckland 1142, New Zealand | > Ph: 64 9 373-7599 x81928 | > http://www.library.auckland.ac.nz/ | > | > | > | > -Original Message- | > From: mikan.d.dspace listmail [mailto:mikan.dsp...@gmail.com] | > Sent: Tuesday, 16 June 2009 1:05 a.m. | > To: Terrance Davis | > Cc: Dspace Tech | > Subject: Re: [Dspace-tech] DSpace search weirdness | > | > Nope. | > The server 1 has Debian 5 with Java version "1.6.0_12". and server | 2 | > has RHEL and Java version "1.5.0_18". Could this cause the | problem? | > | > Another strange thing I noticed, is that if I re-submit the entire | > item & file and then run filter-media, the text is extracted | > correctly?? So, to me it seems that the old data in the | transferred | > assetstore is handled incorrectly. Strange, eh? | > | > -Mika | > | > | > | > | > 2009/6/15 Terrance Davis : | >> Hi Mika, | >> | >> Are both systems using the same OS version and the same version of | Java? | >> | >> Best regards, | >> | >> Terrance | >> | >> -- | >> Web Applications Programmer | >> Institute for Clean and Secure Energy | >> University of Utah | >> http://www.ices.utah.edu | >> | >> | >> On Jun 15, 2009, at 2:01 AM, mikan.d.dspace listmail wrote: | >> | >>> Hi Terrance, | >>> | >>> I double-checked the indexes in configuration and they do match. | What | >>> I noticed though, is that the text extracted from pdf files | differ, | >>> which might be the cause of this problem. It seems that when | >>> filter-media extracts the text on the other server, it messes up | some | >>> special characters, thus making them unsearchable. What might be | >>> causing this? Both databases are set to UNICODE when created. Is | >>> there some other system setting that might be causing this? | >>> | >>> Example of extracted text is below: | >>> | >>> Server 1: (correct encoding) | >>> 3. PUNAISEN KIRJAN SISÄLTÖ | >>> Jaettiin punaisen kirjan sisällön päivitystä varten | vastuuhenkilöt | >>> seuraavaksi: | >>> 3.1 Yleisasu ja kirjan sisällön järjestys miettii ja tarkastelee | Tiina | >>> Sairanen | >>> | >>> Server 2: (Messed up characters) | >>> | >>> 3. PUNAISEN KIRJAN SIS?LT? | >>> Jaettiin punaisen kirjan sis?ll?n p?ivityst? varten | vastuuhenkil?t | >>> seuraavaksi: | >>> 3.1 Yleisasu ja kirjan sis?ll?n j?rjestys miettii ja tarkastelee | Tiina | >>> Sairanen | >>> | >>> | >>> Thanks for any help, | >>> Mika | >>> | >>> | >>> 2009/6/12 Terrance Davis : | >>>> | >>>> Hi Mika, | >>>> My first guess is that your config files don't match. You might | want to | >>>> check the server that is returning 40 results. If the configured | search | >>>> indexes have any white space (such as a tab) after the | properties, they | >>>> might not be matching up with the dublin core and not indexing | properly. | >>>> No trim() is happening on the configured search index properties | from the | >>>> 1.5.2 dspace.cfg, so they may look the same, but be thrown off by | extra | >>>> unwanted white space. | >>>> Best regards, | >>>>
Re: [Dspace-tech] Question about changing java code in DSpace 1.5.2
You may want to wait for a more authoritative answer on this, since deleting stuff is always troublesome -- but when this happened to us, we deleted the contents of the target directories (dspace/target/dspace-1.5.0-build.dir/ and dspace/modules/jspui/target/jspui-1.5.0) and ran mvn package again; the directories were rebuilt by maven. You could backup and try this; or you could wait for somebody on the actual dspace development team (I'm not) to scream "No! Don't do that!" Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library - "George Kozak" wrote: | Thanks, Bill: | | Yes, I have had problems with the jsps. My new classes did not end up | | in WEB-INF/classes nor did they end up in my dspace build. I didn't | see | any maven errors. So, I guess I will have to do some digging. | Thanks! | | bill.ander...@library.gatech.edu wrote: | > Hi, George. I assume you copied the entire package path as a | directory structure under java/org/dspace, and restarted Tomcat. Did | the new files compile correctly when you ran mvn package? If so, I | can think of three things that have happened to us in the past: | > | > 1) We've occassionally had to clean out the tomcat work directory to | get new code to run. The java classes aren't in there, of course; but | the cached jsps seem to get stuck sometimes, and continue to call the | code from the dspace libs. | > | > 2) Check to make sure your new classes are actually in the deployed | app (jspui/WEB-INF/classes/). If they aren't, then check to be sure | they're being copied to the target directory in your dspace build. | > | > 3) If you're running any of these classes from outside the jspui | (from the command line, for instance), then the updated class files | have to be copied to the appropriate jar in the dspace lib directory. | I assume you're not running the bitstream code from the command line, | but include this for completeness. | > | > Let me know if any of this helps. | > | > Cheers, | > | > Bill | > | > Bill Anderson | > Software Developer | > Digital Library Development | > Georgia Tech Library | > | > - "George Kozak" wrote: | > | > | Hi... | > | | > | I wanted to put in a "local" change to two java programs. This is | my | > | | > | first time with DSpace .1.5.2 (I have been working with DSpace | 1.4.2). | > | | > | These local mods were our modified version of Terry Owen's (U of | > | Maryland) Embargo code. | > | | > | I went to | > | | [dspace-1.5.2-src-release]/dspace/modules/jspui/src/main/java/org/dspace/ | > | | > | I put in my own versions of | app/webui/serlvet/BitstreamServlet.java | > | and content/Bitstream.java | > | | > | I ran "mvn package" and then "ant -Dconfig=[dspace | > | main]/config/dspace.cfg update" | > | and copied the new webapps over to Tomcat. | > | | > | However, when I execute my code, I do not seem to be getting my | unique | > | | > | versions of BitstreamServlet.java and Bitstream.java. It acts | like it | > | | > | would if it was using the vanilla versions of these modules. | > | | > | Did I do this wrong? Does the modified java code go elsewhere? | > | | > | -- | > | *** | > | George Kozak | > | Digital Library Specialist | > | Division of Library Information Technologies (DLIT), Digital | Media | > | Group | > | 501 Olin Library | > | Cornell University | > | 607-255-8924 | > | *** | > | g...@cornell.edu | > | | > | | > | | -- | > | Enter the BlackBerry Developer Challenge | > | This is your chance to win up to $100,000 in prizes! For a | limited | > | time, | > | vendors submitting new applications to BlackBerry App World(TM) | will | > | have | > | the opportunity to enter the BlackBerry Developer Challenge. See | full | > | prize | > | details at: http://p.sf.net/sfu/blackberry | > | ___ | > | DSpace-tech mailing list | > | DSpace-tech@lists.sourceforge.net | > | https://lists.sourceforge.net/lists/listinfo/dspace-tech | > | | -- | *** | George Kozak | Digital Library Specialist | Division of Library Information Technologies (DLIT), Digital Media | Group | 501 Olin Library | Cornell University | 607-255-8924 | *** | g...@cornell.edu -- Enter the BlackBerry Developer Challenge This is your chance to win up to $100,000 in prizes! For a limited time, vendors submitting new applications to BlackBerry App World(TM) will have the opportunity to enter the BlackBerry Developer Challenge. See full prize details at: http://p.sf.net/sfu/blackberry ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Item Mapping Problem
We're having a problem with item mapping in one of our collections. Clicking on the "Item Mapper" button results in an immediate system error. The log entry for the error (appended below) shows a null pointer exception, apparently at a point where the code is iterating through the items in the collection and getting their owning collections. I've check the database, and I don't have an item without an owning collection. I tried unmapping the last item mapped, just in case there was some problem with it, but that accomplished nothing. The collection in question contains 665 items, all mapped. I also tried submitting an item to the collection directly. This worked fine; it's only mapping that's broken. Item mapping works in all other collections. It has apparently been broken in this collection for several years, and across several upgrades, going back to before my tenure here. One of my colleagues remembers that it was broken earlier, when their were only a few items in the collection -- at that time, it was fixed by deleting the collection, recreating it, and re-mapping all the items. It worked for a time, and then broke again; nobody could figure out the problem, and there it say until our new archivist tried to use it last week. Has anybody else encountered this? Any suggestions? My apologies if this has been addressed here before; there seems to be a problem with the dspace-tech archives on sourceforge, and I wasn't able to search. Thanks, Bill Anderson Systems Analyst Georgia Tech Library 2009-10-26 14:23:54,369 WARN org.dspace.app.webui.servlet.InternalErrorServlet @ :session_id=FD1E6B248AD0538F340B539A9724394D:internal_error:-- URL Was: http://smartech.gatech.edu/tools/itemmap-- Method: GET -- Parameters were: java.lang.NullPointerException at org.dspace.app.webui.servlet.admin.ItemMapServlet.doDSPost(ItemMapServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:147) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.app.webui.filter.RegisteredOnlyFilter.doFilter(RegisteredOnlyFilter.java:98) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:767) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:697) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:619) -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] SWORD problem -- no mets manifest found
Hi, all I'm working on a SWORD implementation (DSpace 1.5.2), and I'm currently getting the following error: org.dspace.sword.DSpaceSWORDException: org.dspace.content.packager.PackageValidationException: No METS Manifest found (filename=mets.xml). Package is unacceptable. I have a valid METS xml file, called "mets.xml", in my zip package. This seems to be something that broke with 1.5.2; there was a post about it on dspace-devel during the test-a-thon, but as far as I could tell, no reply. Is anybody else having this problem? Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] 1.6 Memory problems
We upgraded to 1.6 yesterday. We tested for a couple of hours with no problem, and then I converted the statistics for solr, set off the statistics import script, and went home. When I got in this morning, our DSpace installation was crashing constantly due to memory errors, and the final output from the stat script looked like this: About to commit data to solr...Exception in thread "main" org.apache.solr.common.SolrException: Bad Gateway Bad Gateway request: http://smartech.gatech.edu/solr/statistics/update at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85) at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:74) at org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:387) at org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:493) We've restarted several times; but every time we do, solr begins madly throwing 403s (see below), and eventually java runs out of memory, and we crash. I've checked the lists and forums, but haven't found any reference to this problem -- has anyone else seen it? Alternatively, can anyone suggest a quick and painless way to shut off solr statistics until we track this down? Thanks, Bill 2010-04-07 10:20:38,009 ERROR org.dspace.statistics.SolrLogger @ Forbidden Forbidden request: http://smartech.gatech.edu/solr/statistics/update?wt=javabin&version=2.2 org.apache.solr.common.SolrException: Forbidden Forbidden request: http://smartech.gatech.edu/solr/statistics/update?wt=javabin&version=2.2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) at org.dspace.statistics.SolrLogger.post(SolrLogger.java:244) at org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:41) at org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:154) at org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:97) at org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:218) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:112) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:769) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:698) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:891) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:619) Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- Download Intel® Parallel Studio Eval Try the new software tools for you
Re: [Dspace-tech] 1.6 Memory problems
An update on this: we were able to circumvent the memory problem with a little Tomcat magic, so our DSpace instance is running. However, it's still throwing the "Forbidden" errors, and the solr statistics are still not working. I changed the usr for the solr server from {dspace.baseUrl}solr/statistics to http://127.0.0.1/solr/statistics, and instead of the 403 errors, I started getting "Connection Refused" (see below). Bill Anderson Software Developer Digital Library Development Georgia Tech Library 2010-04-07 12:58:09,210 ERROR org.dspace.statistics.SolrLogger @ java.net.ConnectException: Connection refused org.apache.solr.client.solrj.SolrServerException: java.net.ConnectException: Connection refused at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:391) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) at org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) at org.dspace.statistics.SolrLogger.post(SolrLogger.java:244) at org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:41) at org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:154) at org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:97) at org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:218) at org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) at org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:112) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190) at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291) at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:769) at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:698) at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:891) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690) at java.lang.Thread.run(Thread.java:619) Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:525) at java.net.Socket.connect(Socket.java:475) at java.net.Socket.(Socket.java:372) at java.net.Socket.(Socket.java:246) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpCl
Re: [Dspace-tech] 1.6 Memory problems
Looks like Keith nailed it; the "Disable Restriction Filter" param doesn't work (it looks like maybe it's supposed to be pasted into the server.xml?), but commenting out the entire filter in the solr webapp's web.xml fixes the problem. I assume leaving this commented out would be a security risk, so I'll talk to my admin about alternative solutions. Thanks, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library - "Keith R Gilbertson" wrote: | I think that networking/name service stuff on the host is configured | so that a call in Java to new | InetAddress.getLocalHost().getHostAddress() will return 127.0.0.1, | instead of the ethernet IP. Could this be conflicting with anything | in the LocalHostRestrictionFilter that ships with the DSpace solr | module? | | | - Original Message ----- | From: "Mark Diggory" | To: "bill anderson" | Cc: "dspace-tech" | Sent: Wednesday, April 7, 2010 1:21:19 PM GMT -05:00 US/Canada | Eastern | Subject: Re: [Dspace-tech] 1.6 Memory problems | | You can temporarily move the /dspace/solr/statistics/data directory | and restart solr, this should allow you to run without the imported | statistics. | | In 1.6.1 we should probably be catching this error and emailing the | administrator with it rather than letting it break the UI. | | Lets continue the thread to figure out why it is failing to load. | Maybe you can give me some details on the data directoy. | | Mark | | On Wed, Apr 7, 2010 at 7:26 AM, | wrote: | > We upgraded to 1.6 yesterday. We tested for a couple of hours with | no problem, and then I converted the statistics for solr, set off the | statistics import script, and went home. When I got in this morning, | our DSpace installation was crashing constantly due to memory errors, | and the final output from the stat script looked like this: | > | > About to commit data to solr...Exception in thread "main" | org.apache.solr.common.SolrException: Bad Gateway | > | > Bad Gateway | > | > request: http://smartech.gatech.edu/solr/statistics/update | > at | org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) | > at | org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) | > at | org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) | > at | org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85) | > at | org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:74) | > at | org.dspace.statistics.util.StatisticsImporter.load(StatisticsImporter.java:387) | > at | org.dspace.statistics.util.StatisticsImporter.main(StatisticsImporter.java:493) | > | > We've restarted several times; but every time we do, solr begins | madly throwing 403s (see below), and eventually java runs out of | memory, and we crash. I've checked the lists and forums, but haven't | found any reference to this problem -- has anyone else seen it? | > | > Alternatively, can anyone suggest a quick and painless way to shut | off solr statistics until we track this down? | > | > Thanks, | > | > Bill | > | > | > | > 2010-04-07 10:20:38,009 ERROR org.dspace.statistics.SolrLogger @ | Forbidden | > | > Forbidden | > | > request: | http://smartech.gatech.edu/solr/statistics/update?wt=javabin&version=2.2 | > org.apache.solr.common.SolrException: Forbidden | > | > Forbidden | > | > request: | http://smartech.gatech.edu/solr/statistics/update?wt=javabin&version=2.2 | > at | org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343) | > at | org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183) | > at | org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217) | > at | org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:63) | > at | org.dspace.statistics.SolrLogger.post(SolrLogger.java:244) | > at | org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:41) | > at | org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:154) | > at | org.dspace.services.events.SystemEventService.fireEvent(SystemEventService.java:97) | > at | org.dspace.app.webui.servlet.BitstreamServlet.doDSGet(BitstreamServlet.java:218) | > at | org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:151) | > at | org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:99) | > at | javax.servlet.http.HttpServlet.service(HttpServlet.java:617) | > at | ja
Re: [Dspace-tech] Improper Install?
Work directories should be created automatically by Tomcat when dspace jsps are compiled into servlets -- I don't think the dspace installation puts anything in your tomcat directories. Are you getting an error about this? Bill Anderson Software Developer Digital Library Development Georgia Tech Library - "bryce ray" wrote: | I'm having some difficulties with my installation of dspace. I've discovered that directories that should have been created were not. When are these directories created? and what might have caused them not to be created? | | Directories in: | /usr/share/tomcat6/work/Catalina | | When viewing this directory there are sub directories for other installations of dspace. However, there is no directory for my most recent install of dspace. | | Let me know if you need any more information, and thank you for helping me diagnose this problem. | | -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev | ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech-- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Trouble deleting items
Not sure how this one happened: after upgrading to dspace 1.6, we're having trouble deleting items from dspace. We get an error message explaining that 'update or delete on "item" violates foreign key constraint "$2" on "collection2item"'. Describing collection2item yields: Table "public.collection2item" Column | Type | Modifiers ---+-+--- id| integer | not null collection_id | integer | item_id | integer | Indexes: "collection2item_pkey" PRIMARY KEY, btree (id) "collection2item_collection_idx" btree (collection_id) "collection2item_item_id_idx" btree (item_id) Foreign-key constraints: "$1" FOREIGN KEY (collection_id) REFERENCES collection(collection_id) "$2" FOREIGN KEY (item_id) REFERENCES item(item_id) "coll2item_item_fk" FOREIGN KEY (item_id) REFERENCES item(item_id) DEFERRABLE I ran the database scheme update script, and it seems to have added the final, deferrable foreign key constraint; but I can't find any reference at all to the first two FKCs ($1 and $2). As far as I can tell, they aren't supposed to exist at all; I assume they're left over from some previous version of dspace, didn't get removed at some point in the past, and just never caused problems until now. Can anybody confirm that I can go ahead and drop these constraints (and similar constraints in Community2Collection? Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- Download Intel® Parallel Studio Eval Try the new software tools for yourself. Speed compiling, find bugs proactively, and fine-tune applications for parallel performance. See why Intel Parallel Studio got high marks during beta. http://p.sf.net/sfu/intel-sw-dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Tomcat log warnings
We recently upgraded to 1.6, encountered some problems, and beat a strategic retreat back to 1.5.2 while we worked to resolve them. After the rollback, we started getting intermittent crashes. The only log entries we've been able to associate with the crashes are these: WARNING: No MODS mapping for {various qualified dc metadata fields} Oddly enough, although these warnings seem to be thrown by DSpace (specifically, by the METSExport and MODSDisseminationCrosswalk classes), they're showing up in catalina.out rather than dspace.log, making it difficult to associate them with any specific DSpace activity. We're not even sure they have anything to do with the crashes, but they seem to show up in greater volume just before DSpace goes down. Has anybody else encountered this? Thanks, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Dspace 1.6.2 bin directory
We've just upgraded from 1.6.0 to 1.6.2, and found that many of the files in our bin directory no longer work. Upon investigation, a lot of former dsrun calls appear to have disappeared. For instance, index-init used to read like this: # Get the DSPACE/bin directory BINDIR=`dirname $0` echo "Creating browse index" $BINDIR/dsrun org.dspace.browse.IndexBrowse -f -r $BINDIR/dsrun org.dspace.browse.ItemCounter echo "Creating search index" $BINDIR/dsrun org.dspace.search.DSIndexer -b That's been replace by this: # Get the DSPACE/bin directory BINDIR=`dirname $0` echo "Creating browse and search indexes" $BINDIR/dspace index-init There is no binary or sub-directory called "dspace" in the bin directory -- although there is a file called "dspace.bat", which looks to be the batch file equivalent of dsrun. I'm assuming this is the result of a glitch in the release; is there any reason we shouldn't simply revert to the 1.6.0 binaries? Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- The Palm PDK Hot Apps Program offers developers who use the Plug-In Development Kit to bring their C/C++ apps to Palm for a share of $1 Million in cash or HP Products. Visit us here for more details: http://p.sf.net/sfu/dev2dev-palm ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] solr spiders question
Just a quick question for anybody who's using spider filtering in solr: If I want to add site-specific ips to the solr spider list, is there anything I need to do other than drop a text file in the config/spiders directory? Anything in the way of configuration? Thanks, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] An amusing aside, with implications for documentation
We've been having trouble with the new 'dspace' script launcher, and have so far stuck to using dsrun. Our problem was that none of the commands seemed to be recognized. Typing an incorrect command (or just ./dspace) yields a very nice set of usage notes: Usage: dspace [command-name] {parameters} - checker: Run the checksum checker - checker-emailer: Send emails related to the checksum checker - cleanup: Remove deleted bitstreams from the assetstore - community-filiator: Tool to manage community and sub-community relationships - create-administrator: Create a DSpace administrator account Etc., etc. Now, I don't know how anybody else's brain works; but when I see a dash in a help file, I automatically think of command line options. So, we've been trying to use the new script thus: ./dspace -import {etc} Silly, I guess -- but several of us read it that way, so I thought I'd post the tale here as a possible cautionary note for future documentation endeavors. Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- This SF.net email is sponsored by Make an app they can't live without Enter the BlackBerry Developer Challenge http://p.sf.net/sfu/RIM-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Geolite errors
We continue to get lots and lots of these in our Tomcat logs: Error seeking country while seeking 2189422231 ...accompanied by these in the dspace logs: ERROR org.dspace.statistics.SolrLogger @ Failed DNS Lookup for IP: We have a GeoLiteCity.dat in our config directory, and the SOLR stats are working. Is anybody else getting this? Cheers, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- This SF.net Dev2Dev email is sponsored by: Show off your parallel programming skills. Enter the Intel(R) Threading Challenge 2010. http://p.sf.net/sfu/intel-thread-sfd ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
Re: [Dspace-tech] tomcat reporting memory leak?
We've been experiencing problems similar to some reported on this thread since our upgrade to 1.6 several months ago. We're still using the jspui, and we've wondered (among other things) if some of these problems might be alleviated by a switch to the xmlui. Has anybody had any experience comparing the memory footprint and/or resource usage issues between the two interfaces? Thanks, Bill Bill Anderson Software Developer Digital Library Development Georgia Tech Library -- Start uncovering the many advantages of virtual appliances and start using them to simplify application deployment and accelerate your shift to cloud computing. http://p.sf.net/sfu/novell-sfdev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Citation export?
Is anybody working on giving dspace the ability to export citations? It's something our content folks have a lot of interest in, and I wouldn't mind working on it myself; but I don't want to duplicate effort. Bill Anderson Software Developer Georgia Tech Library -- Learn how Oracle Real Application Clusters (RAC) One Node allows customers to consolidate database storage, standardize their database environment, and, should the need arise, upgrade to a full multi-node Oracle RAC database without downtime or disruption http://p.sf.net/sfu/oracle-sfdevnl___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Postgres Driver problem?
We have a dark archive in a dspace instance, running DSpace 1.6.2 and Postgres 8.1.20. Our archivists mostly use the jspui, but occassionally switch over to do specific tasks. Yesterday, one of our archivists tried to load up the xmlui for the first time in about a month, and got an error message. Looking at the stacktrace (see below) it looks like the postgres driver is missing -- but it's not. It's in the lib/directory, right where it's supposed to be. Furthermore, the jspui is working fine. I thought this might be some sort of classpath issue, and I copied the driver jar into the xmlui's WEB_INF/classes directory; but no dice. Furthermore, as far as we can tell, nothing has changed in the app since the last time the xmlui was successfully loaded. Anybody seen this sort of behavior before? Cheers, Bill Java stacktrace java.sql.SQLException: java.lang.ClassNotFoundException: org.postgresql.Driver at org.dspace.storage.rdbms.DatabaseManager.initialize(DatabaseManager.java:1711) at org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:618) at org.dspace.core.Context.(Context.java:126) at org.dspace.app.xmlui.utils.ContextUtil.obtainContext(ContextUtil.java:99) at org.dspace.app.xmlui.utils.ContextUtil.obtainContext(ContextUtil.java:80) at org.dspace.app.xmlui.cocoon.AbstractDSpaceTransformer.setup(AbstractDSpaceTransformer.java:111) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71) at $Proxy23.setup(Unknown Source) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.setupPipeline(AbstractProcessingPipeline.java:356) at org.apache.cocoon.components.pipeline.impl.AbstractCachingProcessingPipeline.setupPipeline(AbstractCachingProcessingPipeline.java:710) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.preparePipeline(AbstractProcessingPipeline.java:466) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.prepareInternal(AbstractProcessingPipeline.java:480) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71) at $Proxy17.prepareInternal(Unknown Source) at org.apache.cocoon.components.source.impl.SitemapSource.init(SitemapSource.java:292) at org.apache.cocoon.components.source.impl.SitemapSource.(SitemapSource.java:148) at org.apache.cocoon.components.source.impl.SitemapSourceFactory.getSource(SitemapSourceFactory.java:62) at org.apache.cocoon.components.source.CocoonSourceResolver.resolveURI(CocoonSourceResolver.java:153) at org.apache.cocoon.components.source.CocoonSourceResolver.resolveURI(CocoonSourceResolver.java:183) at org.apache.cocoon.generation.FileGenerator.setup(FileGenerator.java:99) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71) at $Proxy18.setup(Unknown Source) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.setupPipeline(AbstractProcessingPipeline.java:343) at org.apache.cocoon.components.pipeline.impl.AbstractCachingProcessingPipeline.setupPipeline(AbstractCachingProcessingPipeline.java:710) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.preparePipeline(AbstractProcessingPipeline.java:466) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeline.process(AbstractProcessingPipeline.java:411) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:585) at org.apache.cocoon.core.container.spring.avalon.PoolableProxyHandler.invoke(PoolableProxyHandler.java:71)
[Dspace-tech] Overlay question re: POM files
Greetings, I'm working on a CAS authentication piece for our Dspace repository. I'm starting with the CAS plug-in patch from Paris-Dauphine University, extensively modified to suit our needs. I've got the code working on our test instance, but I'd like to move it all into the modules directory so as to be able to maintain it more easily. I've moved most of the source files into the xmlui module, and it works well -- but I'm not sure where to put the pom files: dspace-xmlui/dspace-xmlui-webapp/pom.xml dspace-api/pom.xml dspace-xmlui/dspace-xmlui-api/pom.xml Is it possible to maintain pom files as overlays? If so, does anybody have any advice on where to put these files? Or do I just have to keep track of them manually, as with the dspace.cfg file? Any advice appreciated. Thanks, Bill -- Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
[Dspace-tech] Handle collision during harvest
We're trying to havest the metadata from our IR, SMARTech (running DSpace 1.7.2) to a metadata-only repository running DSpace 1.8.2, using the OAI harvester. For the most part, it's going well -- but we have a lot of items in SMARTech mapped to more than one collection. When the harvester hits one of these mapped items, having already ingested its doppelganger, it throws an error: 2012-03-28 12:37:37,526 ERROR org.dspace.harvest.OAIHarvester @ Harvesting error occured while processing an OAI record: Handle collision: attempted to re-assign handle '1853/10302' to an incoming harvested item 'oai: smartech.gatech.edu:1853/10302' This makes sense, since the handle is indeed already in use -- but the harvester exits on the error, and nothing else in the collection is harvested. I'm assuming that anybody else who attempts to harvest metadata from SMARTech is getting the same behavior.Has anybody else run into this? Unless I'm missing something, it seems like this would make it impossible to do a full harvest on a site using mapped items. Thanks, Bill Anderson Digital Web Developer Georgia Tech Library -- This SF email is sponsosred by: Try Windows Azure free for 90 days Click Here http://p.sf.net/sfu/sfd2d-msazure___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech