Re: [Dspace-tech] DSpace 5.1 - oai 500
Hi Kostas, On 17/08/15 23:52, Konstantinos Koumoutsos wrote: [root@nemertes html]# /data/dspacenew/bin/dspace oai import -c [...] Caused by: com.ctc.wstx.exc.WstxIOException: Invalid white space character (0x17) in text to output I'd guess that this means one of your items has this character in its metadata. I'm not sure how you'd go about finding the culprit. Is there any more information in the DSpace log file? cheers, Andrea -- Dr Andrea Schweer IRR Technical Specialist, ITS Information Systems The University of Waikato, Hamilton, New Zealand -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] DSpace 5.1 - oai 500
Hello All. Any help on this? Thanks. Regards Kostas On Thu, Aug 6, 2015 at 10:48 AM, Konstantinos Koumoutsos koumout...@gmail.com wrote: Hello I am using dspace 5.1 and while requesting the oai page http://nemertes.lis.upatras.gr/oai/request/ i got 500 (logs attached). I tried the following with no luck. [root@nemertes html]# /data/dspacenew/bin/dspace oai clean-cache OAI 2.0 manager action started Purging cached OAI responses. [root@nemertes html]# /data/dspacenew/bin/dspace oai import -c OAI 2.0 manager action started Clearing index Index cleared Using full import. Full import 100 items imported so far... 200 items imported so far... 300 items imported so far... 400 items imported so far... 500 items imported so far... java.lang.IllegalStateException: Can't overwrite cause with java.io.IOException: Invalid white space character (0x17) in text to output at java.lang.Throwable.initCause(Throwable.java:456) at com.ctc.wstx.compat.Jdk14Impl.setInitCause(Jdk14Impl.java:70) at com.ctc.wstx.exc.WstxException.init(WstxException.java:46) at com.ctc.wstx.exc.WstxIOException.init(WstxIOException.java:16) at com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:505) at com.lyncode.xoai.dataprovider.xml.xoai.Element$Field.write(Element.java:204) at com.lyncode.xoai.util.XmlIOUtils.writeElement(XmlIOUtils.java:20) at com.lyncode.xoai.dataprovider.xml.xoai.Element.write(Element.java:220) at com.lyncode.xoai.util.XmlIOUtils.writeElement(XmlIOUtils.java:20) at com.lyncode.xoai.dataprovider.xml.xoai.Element.write(Element.java:223) at com.lyncode.xoai.util.XmlIOUtils.writeElement(XmlIOUtils.java:20) at com.lyncode.xoai.dataprovider.xml.xoai.Element.write(Element.java:223) at com.lyncode.xoai.util.XmlIOUtils.writeElement(XmlIOUtils.java:20) at com.lyncode.xoai.dataprovider.xml.xoai.Element.write(Element.java:223) at com.lyncode.xoai.util.XmlIOUtils.writeElement(XmlIOUtils.java:20) at com.lyncode.xoai.dataprovider.xml.xoai.Metadata.write(Metadata.java:95) at org.dspace.xoai.app.XOAI.index(XOAI.java:276) at org.dspace.xoai.app.XOAI.index(XOAI.java:211) at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:198) at org.dspace.xoai.app.XOAI.index(XOAI.java:131) at org.dspace.xoai.app.XOAI.main(XOAI.java:405) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77) Caused by: com.ctc.wstx.exc.WstxIOException: Invalid white space character (0x17) in text to output ... 23 more Caused by: java.io.IOException: Invalid white space character (0x17) in text to output at com.ctc.wstx.sw.XmlWriter.throwInvalidChar(XmlWriter.java:525) at com.ctc.wstx.sw.BufferingXmlWriter.writeCharacters(BufferingXmlWriter.java:501) at com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:503) ... 22 more [root@nemertes html]# Do you know what that error means? Many thanks. Kostas -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] CPU usage when idle
I should add that this was on DSpace 5 and that APR is not on by default (requires the libtcnative-1 package). On Mon, Aug 17, 2015 at 11:39 AM, helix84 heli...@centrum.sk wrote: Hi everyone, this is just a heads-up about a problem I solved with my repository. I was getting ~60% CPU usage on all CPUs in the DSpace VM all the time, even when DSpace was idle. This is on Debian Jessie with distro packages of tomcat8 and openjdk-7-jdk:amd64. The problem went away when I turned off APR in /etc/tomcat8/server.xml. I confirmed this solution independently on 2 different DSpace instances. !-- Listener className=org.apache.catalina.core.AprLifecycleListener SSLEngine=on / -- Be aware if you define your HTTPS connector in Tomcat, it's attribute syntax changes depending on whether you are using APR (OpenSSL) or not (JSSE). Unrelated to CPU usage, I was also getting occasional Too many open files message with APR despite trying to raise the respective ulimit. They haven't appeared yet with APR turned off. If you have similar experiences, please do share them with us. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] CPU usage when idle
Hi All, Added to: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Optimisations/Tomcat Cheers hg *Hilton Gibson* Ubuntu Linux Systems Administrator Stellenbosch University Library http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html On 17 August 2015 at 11:41, helix84 heli...@centrum.sk wrote: I should add that this was on DSpace 5 and that APR is not on by default (requires the libtcnative-1 package). On Mon, Aug 17, 2015 at 11:39 AM, helix84 heli...@centrum.sk wrote: Hi everyone, this is just a heads-up about a problem I solved with my repository. I was getting ~60% CPU usage on all CPUs in the DSpace VM all the time, even when DSpace was idle. This is on Debian Jessie with distro packages of tomcat8 and openjdk-7-jdk:amd64. The problem went away when I turned off APR in /etc/tomcat8/server.xml. I confirmed this solution independently on 2 different DSpace instances. !-- Listener className=org.apache.catalina.core.AprLifecycleListener SSLEngine=on / -- Be aware if you define your HTTPS connector in Tomcat, it's attribute syntax changes depending on whether you are using APR (OpenSSL) or not (JSSE). Unrelated to CPU usage, I was also getting occasional Too many open files message with APR despite trying to raise the respective ulimit. They haven't appeared yet with APR turned off. If you have similar experiences, please do share them with us. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Task Pool not visible to new administrator
Hi, This is as a follow up of my last post, A user was added as an administrator, but the task pool is not visible to him. We use the JSPUI version 3.1, your assistance will be greatly appreciated. Thanks The response i got dont seem to address the challenge i have. I will appreciate something more specific. Kind Regards Thanks Eric -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] CPU usage when idle
Hi everyone, this is just a heads-up about a problem I solved with my repository. I was getting ~60% CPU usage on all CPUs in the DSpace VM all the time, even when DSpace was idle. This is on Debian Jessie with distro packages of tomcat8 and openjdk-7-jdk:amd64. The problem went away when I turned off APR in /etc/tomcat8/server.xml. I confirmed this solution independently on 2 different DSpace instances. !-- Listener className=org.apache.catalina.core.AprLifecycleListener SSLEngine=on / -- Be aware if you define your HTTPS connector in Tomcat, it's attribute syntax changes depending on whether you are using APR (OpenSSL) or not (JSSE). Unrelated to CPU usage, I was also getting occasional Too many open files message with APR despite trying to raise the respective ulimit. They haven't appeared yet with APR turned off. If you have similar experiences, please do share them with us. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to update Discovery index for a specific handle?
Hi Alan, I think this should work: 1. changing the last_modified timestamp in the item tabel for the coresponding item 2. run [dspace]/bin/dspace index-discovery (this will update/clean the index) Regards Christian Am 17.08.2015 um 15:57 schrieb Alan Orth: Hi, When I edit items in the web user interface, either by batch CSV upload or one by one in Edit this Item, DSpace updates the Discovery indexes for the item(s) in question. Sometimes I have to make changes in SQL directly, like to delete empty metadatavalues, and as far as I know the only way to capture those changes in the Solr indexes is to perform an `index-discovery -b`, but that takes *hours* for our repository of 50,000 items (despite having an SSD and plenty of RAM on our Linode-powered VPS!). Is there a way to force the updating of a specific handle's Solr indexes? Thanks, Alan -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Christian Scheible Softwareentwickler / Abt. Content-basierte Dienste Kommunikations-, Informations- und Medienzentrum (KIM) Universität Konstanz 78457 Konstanz +49 (0)7531 / 88-2857 Raum B 703 -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] External Format Registry - Development plans?
Dear list, In the past there have been discussions to use PRONOM as an external format registry for DSpace, e.g. https://wiki.duraspace.org/display/DSPACE/BitstreamFormat+Conversion+Instructions The idea dates back to 2011 and was considered to be a feature with major priority back then (https://jira.duraspace.org/browse/DS-1096). It seems that the idea has not been realized. Are there plans to offer this feature in a future release? Likewise, if there are DSpace installations that use PRONOM as an external registry, we'd be interested to hear about them. Best, Franziska Ackermann Am 13.08.2015 um 08:30 schrieb Franziska Ackermann: Dear all, With the Bitstream Format Registry DSpace recognizes the mimetype of a bitstream, but doesn't specify the version of the file format. We are thinking about including the version information in the database. Has anyone done this yet? We'd be glad about tips. Best regards, Franziska Ackermann -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette:https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] Embargo process and future releases
At this time, it looks like the plugin-based embargo added in 1.6 might be removed and only the resoucepolicy-based 3.0 embargo kept. See https://jira.duraspace.org/browse/DS-2588 Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] How to update Discovery index for a specific handle?
Hi, When I edit items in the web user interface, either by batch CSV upload or one by one in Edit this Item, DSpace updates the Discovery indexes for the item(s) in question. Sometimes I have to make changes in SQL directly, like to delete empty metadatavalues, and as far as I know the only way to capture those changes in the Solr indexes is to perform an `index-discovery -b`, but that takes *hours* for our repository of 50,000 items (despite having an SSD and plenty of RAM on our Linode-powered VPS!). Is there a way to force the updating of a specific handle's Solr indexes? Thanks, Alan -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] Embargo process and future releases
I have not set embargos and am looking at doing so in the near future. I was going to start testing this, but with the discussion about sun setting one of the options I wanted to make sure I was using whichever option will be the most likely to move forward. Will we be keeping the Advanced or will there be a whole new setup created? https://wiki.duraspace.org/display/DSDOC5x/Embargo David Schuster Texas Woman's University Director of Library Information Technology Technical Support Phone: 940-898-3909 dschus...@twu.edumailto:dschus...@twu.edu [emailsignature][Alma_Certified_Admin_Logo] -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] External Format Registry - Development plans?
Hi Franziska, To answer the first part of your question, that ticket (DS-1096) is still looking for a volunteer or two to help us provide that integration with PRONOM. At this point in time, there's no timeline for when this work may happen, but it likely is still of interest. Similar to other open source platforms, DSpace itself is primarily developed and maintained by volunteers from throughout the world. So, if you or anyone else is interested in this work, please do let us know (add a comment to that ticket) and then feel free to provide a GitHub Pull Request per our code contributions guidelines: https://wiki.duraspace.org/display/DSPACE/Code+Contribution+Guidelines At this point, I'm unaware of anyone who has implemented this locally. But, I would also be interested to hear about any who have built in this feature already! - Tim -- Tim Donohue Technical Lead for DSpace DSpaceDirect DuraSpace.org | DSpace.org | DSpaceDirect.org On 8/17/2015 9:25 AM, Franziska Ackermann wrote: Dear list, In the past there have been discussions to use PRONOM as an external format registry for DSpace, e.g. https://wiki.duraspace.org/display/DSPACE/BitstreamFormat+Conversion+Instructions The idea dates back to 2011 and was considered to be a feature with major priority back then (https://jira.duraspace.org/browse/DS-1096). It seems that the idea has not been realized. Are there plans to offer this feature in a future release? Likewise, if there are DSpace installations that use PRONOM as an external registry, we'd be interested to hear about them. Best, Franziska Ackermann Am 13.08.2015 um 08:30 schrieb Franziska Ackermann: Dear all, With the Bitstream Format Registry DSpace recognizes the mimetype of a bitstream, but doesn't specify the version of the file format. We are thinking about including the version information in the database. Has anyone done this yet? We'd be glad about tips. Best regards, Franziska Ackermann -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette:https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] how to remove jspui in url to access jspui interface
Hi, We just implemented DSpace 5.2 and use jspui interface. In order to access the application, we use the url http://.tcnj.edu/jspui; (we have already changed the default port 8080 to 80). Is it possible to remove the jspui part? So that when people enter http://.tcnj.edu;, it will access the jspui application. Is this something called http redirect which can do the job? Thanks in advance for your help! (Our server is RH Linux 7.) Yongming - Yongming Wang Systems Librarian The College of New Jersey Library phone: 609-771-3337 email: wan...@tcnj.edu - -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] How to update Discovery index for a specific handle?
Alan, If your changes can be scoped to a specific community or collection, we have a process that will re-index a collection/community. We have present the user with a form that allows them to select either a community or a collection. We end up with 2 parameters - comm or coll - database id for the community or collection The following script deletes the discovery entries for that community or collection. It then runs index-discovery which rebuilds the missing entries. - https://github.com/Georgetown-University-Libraries/batch-tools/blob/master/bin-src/dspaceBatch.sh#L282-L291 Background thread: http://sourceforge.net/p/dspace/mailman/message/31838611/ Terry On Mon, Aug 17, 2015 at 6:57 AM, Alan Orth alan.o...@gmail.com wrote: Hi, When I edit items in the web user interface, either by batch CSV upload or one by one in Edit this Item, DSpace updates the Discovery indexes for the item(s) in question. Sometimes I have to make changes in SQL directly, like to delete empty metadatavalues, and as far as I know the only way to capture those changes in the Solr indexes is to perform an `index-discovery -b`, but that takes *hours* for our repository of 50,000 items (despite having an SSD and plenty of RAM on our Linode-powered VPS!). Is there a way to force the updating of a specific handle's Solr indexes? Thanks, Alan -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette -- Terry Brady Applications Programmer Analyst Georgetown University Library Information Technology https://www.library.georgetown.edu/lit/code 425-298-5498 (Seattle, WA) -- ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette