Re: [dspace-tech] Export an item without losing its statistics

[Stuart A. Yeates]

As far as I know, none of the export formats currently support statistics.

I have briefly thought about the possibility of putting counter
https://www.projectcounter.org/ stats in the METS, which seems doable,
but never got around to implementing it.

cheers
stuart


--
...let us be heard from red core to black sky
On Thu, 27 Sep 2018 at 14:35, Freddy Guerrero  wrote:
>
> Hello with everyone
>
> Please can you help me with this query: How do I export an item but without 
> losing its statistics? This is because it has many downloads and the author 
> requires us to keep the statistics.
>
> http://67.192.84.248:8080/handle/10469/8680/statistics
>
> Then I need to import it to my repository
>
> Fred
>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of 
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups 
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Server requests login often

[Stuart A. Yeates]

Have you checked that your dspace server knows what URL it's on?

If not, it can issue cookies for the wrong domain which get ignored, so
login doesn't work.

cheers
stuart

--
...let us be heard from red core to black sky

On 8 August 2018 at 09:52, Cameron, Jacob  wrote:

> Hi Everyone,
>
>
>
> Windows Server 2008 R2, Java 1.8.171, Tomcat 7.0.56, DSpace 6.  Our
> instance of DSpace randomly requests people login when going from screen to
> screen and no matter what I haven’t been able to figure out why.  There are
> 4GB memory assigned to DSpace/Tomcat, and the heap is nowhere near full.
> I’ve checked the logs but there’s nothing showing why it’s kicking people
> out.  The timeout is set for 15 minutes, but you can login, and click to go
> anywhere and it seems like you are logged out and have to log back in.
>
>
>
> If anyone has any suggestions, they would be appreciated.  I’m at my wits
> end.
>
>
>
> Jake
>
> --
>
> Jake Cameron, BCS(UNB)
>
> Systems Support Specialist III
>
> Information Systems and Technical Services University of Lethbridge Library
>
> Phone:(403)329-2756
>
> This e-mail, including any and all attachments, is only for the use of the
> intended recipient(s) and may contain information that is confidential or
> privileged. If you are not the intended recipient, you are advised that any
> dissemination, copying or other use of this e-mail is prohibited. Please
> notify the sender of the error in communication by return e-mail and
> destroy all copies of this e-mail. Thank you.
>
>
>
> --
> All messages to this mailing list should adhere to the DuraSpace Code of
> Conduct: https://duraspace.org/about/policies/code-of-conduct/
> ---
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
All messages to this mailing list should adhere to the DuraSpace Code of 
Conduct: https://duraspace.org/about/policies/code-of-conduct/
--- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] DSpace Upgrade and Platform Migration

[Stuart A. Yeates]

An alternative would be to migrate using METS-based SIPs, as per
https://wiki.duraspace.org/display/DSDOC18/AIP+Backup+and+Restore

This is a data-centric approach and some dspace-specific settings and
customisations may be lost.

cheers
stuart

--
...let us be heard from red core to black sky

On Fri, Jul 15, 2016 at 11:23 AM, Eric Schewe  wrote:

> We currently have DSpace 1.8.2 sitting on a CentOS 5 server.
>
>
>
> The application owner has requested an upgrade to the latest version. I
> see that DSpace 5.x has requirements that cannot be met by a CentOS 5
> server so my plan is to build a new CentOS 7 server and to migrate DSpace
> to it.
>
>
>
> Am I correct in assuming the best way for me to accomplish this would be:
>
>
>
> 1.   Build new CentOS 7 server
>
> 2.   Setup DSpace 1.8.2 on it
>
> 3.   Migrate existing installation from CentOS 5 to the new CentOS 7
> server
>
> 4.   Verify functionality and data integrity
>
> 5.   Upgrade DSpace 1.8.2 to 5.x on the CentOS 7 server
>
>
>
> Or is there a better way?
>
>
>
> Is there a documented or recommended process for migrating DSpace from one
> server to another?
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Re: DB Migration when adding new metadata field

[Stuart A. Yeates]

You can remove a metadata field from all items in the database using the
"CSV metadata export" method (delete the contents but not the heading of a
single column and reimport the csv).

cheers
stuart

--
...let us be heard from red core to black sky

On Tue, Jul 12, 2016 at 12:49 AM, Pantelis Karamolegkos <
pantelis...@gmail.com> wrote:

> If a previously added field needs to be removed, what is the recommended
> way to remove it from the database?
> (I assume either way it has to be removed from input-forms.xml)
>
> On Friday, July 8, 2016 at 5:07:17 PM UTC+3, Pantelis Karamolegkos wrote:
>
>> When adding a new metadata field through the respective admin form (in an
>> existing schema. e.g. dc), do we also have to manually add the respective
>> flyway migration script under org.dspace.storage.sqlmigration. ?
>> Otherwise how will the new field be added to the database of someone who
>> checks out our code from the branch we are working on?
>>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

[dspace-tech] Re: Migrating to Rosetta / exporting items

[Stuart A. Yeates]

Rosetta does OAI-PMH, but there are a lot of things DSpace doesn't include
in the OAI-PMH feed.

Cheers
Stuart

On Friday, 24 June 2016, Luiz dos Santos  wrote:

> Hi Stuart,
>
> When I was in  ExLibris, they had Digitool, and Digitool had OAI-MPH
> interface, did you check it Rosetta have it as well?
>
> Best
> Luiz
>
> On Thu, Jun 23, 2016 at 5:22 PM, Stuart A. Yeates  > wrote:
>
>> We are moving our collections from DSpace to Rosetta (from ExLibris now
>> Proquest) and I was wondering whether anyone had any experiences or
>> suggestions to share about such migrations.
>>
>> As far as I can tell, what I really need is something like the
>> development of the code at
>> https://wiki.duraspace.org/display/DSPACE/DSpace+SIP+Toolkit which would
>> let me export items in the repositories as SIPs.
>>
>> The vanilla DSpace export is lacking in significant ways, particularly
>> relating to locked files, permissions, statistics, etc.
>>
>> We're running 5 instances of a branded but largely uncustomised DSpace
>> 1.8.2.
>>
>> cheers
>> stuart
>> --
>> ...let us be heard from red core to black sky
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "DSpace Technical Support" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to dspace-tech+unsubscr...@googlegroups.com
>> 
>> .
>> To post to this group, send email to dspace-tech@googlegroups.com
>> .
>> Visit this group at https://groups.google.com/group/dspace-tech.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
--
...let us be heard from red core to black sky

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

[dspace-tech] Migrating to Rosetta / exporting items

[Stuart A. Yeates]

We are moving our collections from DSpace to Rosetta (from ExLibris now
Proquest) and I was wondering whether anyone had any experiences or
suggestions to share about such migrations.

As far as I can tell, what I really need is something like the development
of the code at https://wiki.duraspace.org/display/DSPACE/DSpace+SIP+Toolkit
which would let me export items in the repositories as SIPs.

The vanilla DSpace export is lacking in significant ways, particularly
relating to locked files, permissions, statistics, etc.

We're running 5 instances of a branded but largely uncustomised DSpace
1.8.2.

cheers
stuart
--
...let us be heard from red core to black sky

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] How to prevent Google Search Appliance from over-generating?

[Stuart A. Yeates]

We solved a related problem with:

http://researcharchive.vuw.ac.nz/robots.txt

cheers
stuart

--
...let us be heard from red core to black sky

On Wed, Jun 15, 2016 at 7:55 AM, Louise Gruenberg 
wrote:

> The American Library Association has an archive ( https://alair.ala.org/)
> powered by DSpace Direct. We are attempting to implement federated search
> across about 100 web properties that shouldn't have so much content that
> they exceed our license limit. The ALAIR has about 5,000 digital records
> but the search appliance crawls about a quarter of a million on the site.
> The /handler director is responsible for 183,000+. Does anyone know what we
> would need to restrict to knock the crawl back to a reasonable level?
>
> If you could also respond to lgruenb...@ala.org (my work email), that
> would be great.
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Bad Characters making OAI returning mal formed XML

[Stuart A. Yeates]

The issue may be that the code blocks in question are not supported by the
version of java in use. Different versions of java support different
versions of unicode which include different sets of code blocks. Please
include the exact version of java and the code point / code block in any
bug reports.

For example, for a long time 'Linear B' was a problem for us, but now it's
not.

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Jun 9, 2016 at 11:09 PM, Tiago Guimarães <
tiagommguimarae...@gmail.com> wrote:

> DB is in UTF.
> Note that there is no error while using the JSPUI, only when trying to
> harvest the OAI, does that error appear.
>
> The log has that line that i posted:
> com.ctc.wstx.exc.WstxParsingException: Illegal character entity:
> expansion character (code 0xdbc0) not a valid XML character
>
> The really weird thing is that char code is not on the interval for
> invalid xml chars in the w3c documentation.
>
> From my understanding, this errors appear when somebody copy and pastes
> the the abstract from some pdf and carry over some weird chars.
>
>
> Em quinta-feira, 9 de junho de 2016 12:02:17 UTC+1, Luiz dos Santos
> escreveu:
>>
>> Hi,
>>
>>To me it seems a charset problem, are you sure that the database is
>> UTF-8? Do you see any error in the log?
>>
>> Best
>> Luiz
>>
>> On Thursday, June 9, 2016, Tiago Guimarães 
>> wrote:
>>
>>> Hi all,
>>>
>>>
>>> I'm having problems with bad characters in OAI.
>>>
>>>
>>> It's the same as this JIRA ticket:
>>> https://jira.duraspace.org/projects/DS/issues/DS-2806
>>>
>>>
>>> this is a problem that is appearing here, basicaly, OAI returns
>>> mal-formed XML because of weird chars
>>>
>>> Example:  https://i.gyazo.com/22b7f355b0e71b830ec08378a9076c34.png
>>>
>>> Shouldn't dspace take care of that? At least warn the User when he
>>> pastes invalid chars when deposit an item.
>>>
>>>
>>> DSpace should probably have a feature that detects characters that break
>>> the OAI XML. I'm up to creating a PR that does that, but i need guidance.
>>>
>>>
>>>
>>> Also, according to this https://www.w3.org/TR/REC-xml/#NT-Char the char
>>> 0xdbc0 should be valid to XML, but OAI is giving me this:
>>> com.ctc.wstx.exc.WstxParsingException: Illegal character entity: expansion
>>> character (code 0xdbc0) not a valid XML character
>>>
>>> --
>>> You received this message because you are subscribed to the Google
>>> Groups "DSpace Technical Support" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to dspace-tech+unsubscr...@googlegroups.com.
>>> To post to this group, send email to dspace-tech@googlegroups.com.
>>> Visit this group at https://groups.google.com/group/dspace-tech.
>>> For more options, visit https://groups.google.com/d/optout.
>>>
>> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Sword v2 collection configuration

[Stuart A. Yeates]

Well org.apache.abdera is the Atom XML parser, and it's an '
ArrayIndexOutOfBoundsException'

I'm guessing that you need to check the exact formatting of the SWORD
content you're trying to feed into DSpace.

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Jun 9, 2016 at 2:49 AM, Alex Fletcher 
wrote:

> I've been working with someone at another company to get a Swordv2
> connection going between their client and our 5.5 DSpace server.
>
> When they connect and try to upload something to a particular collection,
> the server throws the following error:
>
> May 27, 2016 12:29:08 PM org.apache.catalina.core.StandardWrapperValve
> invoke
> SEVERE: Servlet.service() for servlet [collection] in context with path
> [/swordv2] threw exception
> org.apache.abdera.parser.ParseException:
> java.lang.ArrayIndexOutOfBoundsException
> at
> org.apache.abdera.parser.stax.FOMParser.parse(FOMParser.java:128)
> at
> org.apache.abdera.util.AbstractParser.parse(AbstractParser.java:65)
> at
> org.swordapp.server.SwordAPIEndpoint.addDepositPropertiesFromEntry(SwordAPIEndpoint.java:355)
> at org.swordapp.server.CollectionAPI.post(CollectionAPI.java:156)
> at
> org.swordapp.server.servlets.CollectionServletDefault.doPost(CollectionServletDefault.java:48)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
> at
> org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:193)
> at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)
> at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ArrayIndexOutOfBoundsException
> at java.lang.System.arraycopy(Native Method)
> at java.io.PushbackInputStream.unread(PushbackInputStream.java:235)
> at
> org.apache.abdera.i18n.text.io.DynamicPushbackInputStream.unread(DynamicPushbackInputStream.java:91)
> at
> org.apache.abdera.i18n.text.io.PeekAheadInputStream.peek(PeekAheadInputStream.java:61)
> at
> org.apache.abdera.i18n.text.io.PeekAheadInputStream.peek(PeekAheadInputStream.java:52)
> at
> org.apache.abdera.i18n.text.io.CharsetSniffingInputStream.detectEncoding(CharsetSniffingInputStream.java:110)
> at
> org.apache.abdera.parser.stax.util.FOMSniffingInputStream.detectEncoding(FOMSniffingInputStream.java:39)
> at
> org.apache.abdera.i18n.text.io.CharsetSniffingInputStream.(CharsetSniffingInputStream.java:81)
> at
> org.apache.abdera.i18n.text.io.CharsetSniffingInputStream.(CharsetSniffingInputStream.java:74)
> at
> org.apache.abdera.parser.stax.util.FOMSniffingInputStream.(FOMSniffingInputStream.java:35)
> at
> org.apache.abdera.parser.stax.FOMParser.parse(FOMParser.java:107)
> ... 26 more
>
> The configuration file (swordv2-server.cfg) has the following variables
> set:
>
> url = {dspace.url}/swordv2
> #
> servicedocument.url =
> https://qspace-prod.library.queensu.ca/swordv2/servicedocument
> #
> accept-packaging.collection.METSDSpaceSIP =
> http://purl.org/net/sword/package/METSDSpaceSIP
> accept-packaging.collection.SimpleZip =
> http://purl.org/net/sword/package/SimpleZip
> accept-packaging.collection.Binary =
> http://

Re: [dspace-tech] Batch loading unicode metdata data

[Stuart A. Yeates]

The documented batch uploading method works with unicode for us. Is Nepali
a relatively recent addition to the Unicode standard? Unicode support is
provided by the underlying java implementation and some of the more
recently added scripts aren't supported. We've have issues with Linear B,
for example.

We validate files before uploading with  'xmllint'.  A commandline such as

xmllint --noout dublin_core.xml

will complete silently if dublin_core.xml is good XML and proper encoding,
or complain if problems are seen.

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Jun 9, 2016 at 7:52 AM, George Kozak  wrote:

> Hi...
> I am using DSpace 5.5 (XMLUI - modified Mirage 2).  One of our Sys Admins
> was given a bunch of files to upload using the batch loader (dspace
> import).  The metadata is UNICODE formatted Nepali, and the batch loader
> errors out processing the dublin_core.xml file with the UNICODE.  Is there
> a way to upload UNICODE using the batch loader?
>
> --
> ***
> George Kozak
> Digital Library Specialist
> Cornell University Library - IT
> 218 Olin Library
> Cornell University
> Ithaca, NY 14853
> 607-255-8924
> g...@cornell.edu
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Does Cocoon slow down DSpace?

[Stuart A. Yeates]

A step-change in performance to ~30 seconds makes me think of a network
timeout.  This could easily be caused by an attempt to download an xsd to
validate a file if the machine doesn't have access to the internet.

Be aware that when searching for bots that some of them come from a subnet,
so ask "which subnets are sending many requests?" rather than "which IP
addresses are sending many requests?"

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Jun 9, 2016 at 7:48 AM, Hui Zhang  wrote:

> Hi, Luiz:
>
> Yes, I agree with the bot issue and we blocked a few rogue ones (as much
> as we can identify them). But the problem is different this time: discovery
> is as fast or even faster because we re-build the Solr index; however,
> loading a handle has to wait 30 or more secs (no kidding, I see it myself
> and is true), then loading the pdf and view full metadata record will take
> 10-20secs each. I think it is related with DB (postgres) because discovery
> is no problem, so we change the config with maxconnections sets to 95 and
> maxidle to -1, but it does not help neither. So, my question is, does the
> problems described above as likely a DSpace (JVM and etc) issue or
> DB-related (could still related to DSpace code of handling connection pool)?
>
> Thanks
> --
> Hui
>
> On Wednesday, June 8, 2016 at 10:01:34 AM UTC-7, Luiz dos Santos wrote:
>>
>> Hi Hui,
>>
>> I have two comments:
>>
>> Were you able to see in the new relic report if there is anything
>> that the coocon class is wait for such as database or anything else?
>>Did you already check how many requisition are coming your
>> repository? We got something like that last year and our problem was that
>> we were getting too many robots query, it was solved with a filter.
>>
>> Best
>> Luiz
>>
>>
>> On Wednesday, June 8, 2016, Hui Zhang  wrote:
>>
>>> Thanks Tim. Yeah, I think the next step is to run some tests to find out
>>> what problem cause the delay beyond Coccon forward. We re-build the
>>> discovery index and restart the whole server (not just the tomcat), I will
>>> say it is getting better regarding to speed. We faced similar speed issue
>>> last year at the same peak weeks, but it gets worse this year and the
>>> 'root' cause is not clear to us. We probably will run some tests in the
>>> summer to see whether we can figure it out.
>>>
>>> Best,
>>> --
>>> Hui
>>>
>>>
>>>
>>>
>>> On Wednesday, June 8, 2016 at 8:11:24 AM UTC-7, Tim Donohue wrote:
>>>>
>>>> Hi Hui,
>>>>
>>>> This is a new one for me as well. Though, I hope others will speak up
>>>> if they've seen something similar, as maybe it'd provide us more info
>>>> around the root cause.
>>>>
>>>> As Stuart notes, I'm not sure the CocoonForwardController really is to
>>>> blame (as it is a simple wrapper), so it might be a matter of digging a bit
>>>> deeper to see if there are any other clues in your NewRelic monitor.
>>>>
>>>> A bottleneck of 33 seconds is a *massive* bottleneck though.  Can you
>>>> "visibly"reproduce the bottleneck in your browser (e.g. does it happen
>>>> right when you start a new deposit? Is it on a specific step during the
>>>> deposit process? Is it during the final save/submit?)? Is there any chance
>>>> you've heavily customized this area of the deposit process (if so, it also
>>>> may be worth reviewing any custom code you've added to ensure it isn't a
>>>> possible cause)?
>>>>
>>>> As for whether to blame Cocoon, it's really hard to say without more
>>>> info.  Cocoon is a rather outdated platform (which is why we are moving
>>>> toward a new UI in the near future [1]), and I know others have
>>>> seen/reported minor "sluggishness" in the past at times. But, nothing to
>>>> this extent, which makes me wonder if there could be something else going
>>>> on.
>>>>
>>>> If you have a test/development server, it also might be interesting to
>>>> see if you could reproduce this issue using a tool like JMeter (
>>>> http://jmeter.apache.org/).  If it's simply grinding to a halt when a
>>>> large number of users access to the site, you should be able to reproduce
>>>> that using JMeter (or similar) and then potentially work to narrow down
>>>> possible causes. F

Re: [dspace-tech] Does Cocoon slow down DSpace?

[Stuart A. Yeates]

I believe that you will find that blaming this java class is a measurement
artifact.  If you look at the code, it's a one-line wrapper around other
things:
https://github.com/DSpace/DSpace/blob/master/dspace-xmlui/src/main/java/org/dspace/springmvc/CocoonForwardController.java

As to whether Cocoon is a bottle-neck, that's a deeper question involving
how else you'd get certain things done.

If I were seeing things grind to a halt while students were submitting
their work, I'd look at decoupling the deposit from the rest of repository
using the standard SWORD interface.

cheers
stuart

--
...let us be heard from red core to black sky

On Wed, Jun 8, 2016 at 6:45 AM, Hui Zhang  wrote:

> Hello,
>
> We have an fairly large these and dissertation IR running on DSpace 3.0
> XMLUI, which faced the problem of sluggish speed recently as students start
> to deposit their works for graduation. Although the usage level is more
> than normal, but we still feel it is odd because of the resources committed
> to it (heap memory: 10GB, max allowed DB connections: 80). Our NewRelic
> monitor identifies '/CocoonForwardController/forwardRequest'
> (org.apache.cocoon.sitemap.SitemapServlet.service()) as the bottleneck that
> takes average 33 sec while others take ms. As Cocoon forwardrequest is
> about 98% of the requests, the IR becomes too slow for users. I am
> wondering whether other institutes have similar performance issues and
> whether Cocoon, or how it is implemented in DSpace, has been discussed with
> speed related issues? We appreciate suggestions and are willing to
> collaborate on some solutions as well.
>
> Best,
> --
> Hui Zhang
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Controlled Vocabularies shipped

[Stuart A. Yeates]

ANZRSC's look like they're under a CC license:

http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/1297.02008?OpenDocument

This is widely used in Australia and New Zealand.

cheers
stuart

--
...let us be heard from red core to black sky

On Tue, May 31, 2016 at 6:25 AM, Samuel Henrique 
wrote:

> Hi Tim,
>
> I'm sorry for taking so long to answer, but i didn't see the reply.
>
> I just made a PR with the cnpq's xml.
>
> https://github.com/DSpace/DSpace/pull/1423
>
> You can discuss the licensing problem (if there's still any) there and i
> can directly contact other people if needed.
>
> Thanks!
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Search with a "?"

[Stuart A. Yeates]

'?' is a special character in URLs and the web generally.

The behavior you describe doesn't surprise me in the least.

Searches involving the question mark could probably be made to work, but
unless it's deeply important to you in an on-going sense, it's unlikely to
be worth the effort.

cheers
stuart

--
...let us be heard from red core to black sky

On Fri, May 13, 2016 at 7:11 AM, George Kozak  wrote:

> Hello:
>
> We are running DSpace 5.5, XMLUI with modified Mirage 2 theme.
> A user complained to me that an item couldn't be found if one did a search
> with a question mark ("?").
> For instance, in our repository (https://ecommons.cornell.edu), we have
> an item entitled:
> "*What’s all the buzz about mosquitoes?"*
> If a person searches for "*What’s all the buzz about mosquitoes",* the
> item is found.
> If a person searches for "*What’s all the buzz about mosquitoes?", *the
> item is not found.
>
> Is this the way search should work or is this a bug of some kind?
>
> --
> ***
> George Kozak
> Digital Library Specialist
> Cornell University Library - IT
> 218 Olin Library
> Cornell University
> Ithaca, NY 14853
> 607-255-8924
> g...@cornell.edu
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Batch import fails

[Stuart A. Yeates]

Check that your schema includes this exact spelling.

Cheers
Stuart

On Sunday, 8 May 2016, Jeffrey A Trimble  wrote:

> I’ve got a unique issue I’ve never seen before.  I’m updating a set of
> records with the batch import feature.  When it runs, it looks like it’s
> going to be fine, but then when you agree to make the changes, you get the
> following error:
>
> ---
> Changes for item: 11784 (1989/11776)
>  + Add(dc.relation.ispartofseries [en_US]): Master's Theses no. 1481
>  + Add(dc.identifier.oclc [en_US]): 906935863
>  + Add(dc.identifier.other [en_US]): b21525183
>
> 385 item(s) will be changed
>
> Do you want to make these changes? [y/n] y
> java.sql.SQLException: bad_dublin_core schema=dc, relation ispartofseries
>
> Now, this is a default field in the DCmetadata, so I don’t understand why
> I’m getting this.
>
> Any one have some clues?
>
> Thanks in advance,
>
> Jeffrey Trimble, MLS
> William F. Maag Library
> Youngstown State University
> 330.941.2483 (Office)
> jatrim...@ysu.edu 
> http://www.maag.ysu.edu
> http://digital.maag.ysu.edu
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com
> 
> .
> To post to this group, send email to dspace-tech@googlegroups.com
> .
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>


-- 
--
...let us be heard from red core to black sky

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

[dspace-tech] export including locked files

[Stuart A. Yeates]

I'm following the standard instructions for importing and exporting items
from DSpace are at
https://wiki.duraspace.org/display/DSDOC18/Importing+and+Exporting+Items+via+Simple+Archive+Format
but seem to be unable to get DSPACE to export locked files attached to
items.

Is there a way to force all files to be exported?

An exemplar item is http://researcharchive.vuw.ac.nz/handle/10063/5068
where the second PDF the form is locked to admin-only.

cheers
stuart


--
...let us be heard from red core to black sky

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] How to import from internal academic system

[Stuart A. Yeates]

You should seriously consider asking the developers to implement an OAI
interface https://www.openarchives.org/OAI/openarchivesprotocol.html

There are a number of toolkits with various functionality and technical
platforms at https://www.openarchives.org/pmh/tools/tools.php which means
the developers may not have to do all the work from scratch.

There are also some convenient validators.

cheers
stuart

--
...let us be heard from red core to black sky

On Tue, May 3, 2016 at 5:28 AM, SamuelOPH  wrote:

> Hi, I'm writing this email to get help on about which approach should i
> use in order to import data from an internal academic system.
>
> First, let me introduce the situation;
> I'm an intern at my university and i work mainly with our OJS and VuFind
> systems, i recently started messing around with DSpace because my boss
> asked me to give it a look as we're constantly adapting the systems to fit
> our use [like migrating things from/to ojs, theme'ing vufind...] and we
> need some changes in our dspace inplementation.
> I study computer engineering so i have a nice background in the area in
> general, i'm saying this because i know there are a lot of people who
> manages dspace which are more from an editorial area.
>
> The internal academic system:
> We use here a *locally* developed academic system, which is *closed
> source* AFAIK (i don't mean to talk about this, but yeah i know ¬¬), it
> manages various things from the university and its campus, like grades and
> etc.
>
> This system is also used to register some academic documents like
> masterthesis and doctoratethesis, so is pretty much the fields that DSpace
> indexes, like authors, date, type...
> PS.: The motivation to do this import is to reutilize this fields, not
> having to enter the thesis metadata again, we just import it from the
> academic system.
>
> The Problem:
> I was told that we have now an oportunity to ask for the developers to
> implement something which we may use to harvest this data from our academic
> system, but i don't have enough experience with dspace to be certain that
> i'm choosing the best aproach and i think i will have to give them a pretty
> precise TODO list.
>
> What do I need:
> I need to be able to harvest SOME of this academic stuff periodicaly,
> there are some types of material that we want to index in Dspace and others
> not.
> I believe this separation could be made by either the harvester side
> (choosing some sorte of tags to import) or by the harvested side (only
> exposing what's chosen).
>
> My boss told me that a solution like making the academic system export
> some sort of xml file and importing it on DSpace would be fine, and we can
> chose what to export on the "harvested' side [that is, the academic system].
> I understand that this approach requires that i chose some export format
> accepted by dspace that better fills my needs, something like using QDC.
>
> I also thought of something like exposing an OAI-PMH interface from the
> academic system and making DSpace harvest only what i need (again, by
> filtering by some tag), and having the possibility of automating the
> proccess.
>
> Can anybody give me some ideias, use case, or anything that i might read
> to project this import/export dynamic?
>
>
> Samuel Henrique O. P. [samueloph]
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Edited input form - new metadata not showing up in full item record?

[Stuart A. Yeates]

Are the metadata fields you're adding in the metadata registry (edit via
the web)? Are they absent form the list of fields to suppress (search for
provenance, which is the one suppressed by default)?

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Apr 21, 2016 at 2:42 PM, Kristy Hoffman  wrote:

> I have updated my input-forms.xml file to include the fields I would like
> to include, and in the order I would like them to be. This seems to work as
> I can step through the submission process with no problem. However, the
> metadata I added is not showing up in the full record. For example, I added
> dc.rights but this information does not show up in the record.
>
> I experienced a similar problem when updating my metadata via a CSV file.
> I receive a message saying everything is okay, the file uploaded fine and
> is pending, but the data, if it's saved somewhere at all, never shows up in
> the full record.
>
> I thought my next step for DSpace v1.7 would be to rebuild via the mvn
> package command as stated on duraspace. However, I receive this build
> error:  Cannot execute mojo: resources. It requires a project with an
> existing pom.xml, but the build is not using one.
>
> I've looked through dspace.cfg, all through my config folder, etc. but
> cannot figure out how to make this information save and display when
> viewing the full record. I can't even use it to search so it seems like it
> isn't being saved all?
>
> Could anyone provide any insight please? Thanks!
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] metadata export doubles columns

[Stuart A. Yeates]

There is a bug where dspace sees significance in white space in language
fields.

The trick is to find the white space and remove it.

Cheers
Stuart

On Saturday, 16 April 2016, Chris Gray  wrote:

> When exporting metadata for items I get duplication of columns.  For
> instance, the CSV will have a column for dc.identifier.uri and a column for
> dc.identifier.uri[].  This happens with other columns too.
>
> I know you get this when you have different languages associated with
> values in the same field, but in this case there is no language associated
> with the fields.  They look identical in the UI, but get separated into two
> columns in the metadata output.
>
> Does anyone know what would do this?  I assume we've misconfigured
> something.  Is it bad not to associate any language with some fields?
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com
> 
> .
> To post to this group, send email to dspace-tech@googlegroups.com
> .
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>


-- 
--
...let us be heard from red core to black sky

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Event trigger

[Stuart A. Yeates]

I would look to doing this via a standard API. There are several flavours
of RSS as well as OAI-PMH which let you do things like this.

RSS + IFTTT is where i'd start

cheers
stuart

--
...let us be heard from red core to black sky

On Fri, Apr 8, 2016 at 11:19 AM, Peter Javorka  wrote:

> Hello,
>
> I'm trying to create trigger after an Item is created or updated. I want
> to create export of the Item and run a custom shell script, when the export
> is done.
> I found command line tool for creating exports, but i have problem with
> that trigger.
>
> Thanks
> Peter
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] SearchServiceException error prevents browsing for non-administrator group members

[Stuart A. Yeates]

The underlying exception appears to be a 'org.apache.http.ParseException'
and things and can cause parse exceptions (rather than unexpected query
results) in solr are largely limited to punctuation (:;-., etc). I would
start by double checking that none of your group names have punctuation in
them.

cheers
stuart

--
...let us be heard from red core to black sky

On Fri, Apr 8, 2016 at 6:30 AM, Webb, Nicholas 
wrote:

> I'm encountering an instance of what seems to be the same bug discussed
> here: https://groups.google.com/forum/#!topic/dspace-tech/GsS3z6DZph0
>
> We're running Mirage 2 (cosmetic changes but otherwise unmodified) on
> DSpace 5.3 on top of Windows Server 2012. Recently, certain users lost the
> ability to view, search or browse Items. They can explore the
> Community/Collections hierarchy, but (in most cases -- see below) Items do
> not appear in the Recently Added list, and trying to browse via the sidebar
> fails with an HTTP ParseException error in the stack trace.
>
> The error is dependent on group membership. In our instance, we have two
> primary Groups, "Archives Staff -- All" and "Archives Staff -- Responsible
> for Regular Uploads." (I'll call them "All" and "Uploaders" for
> convenience.)
>
> When we create a new Collection, the All group is added as the sole member
> of the collection's ADMIN and SUBMIT groups, and the Uploaders group is
> added as the sole member of the three WORKFLOW_STEP groups.  (This is so
> that staff members not involved with the ingest workflow don't get
> bombarded with email notifications.) If the collection is restricted to
> logged-in staff, we add All as the sole member of DEFAULT_READ, otherwise
> the sole member of DEFAULT_READ is Anonymous. We have several hundred
> collections and don't need to get granular with individual permissions (all
> staff members can view all restricted collections), so this scheme works
> for us as it lets us add and remove individual E-People from the All and
> Uploaders groups as needed.
>
> Recently, a staff member who's part of All but not Uploaders encountered
> the error for the first time, while my account still worked fine. I'm the
> repository administrator and primary user, so I'm a member of the All and
> Uploaders groups as well as the Administrators group. I tried adding her as
> an Administrator, and this fixed the problem for her account.
>
> Setting up a dummy account and running through all the possible
> permutations of account membership, I find the following:
>
> - fully anonymous (not logged in) user -- works
> - logged in, but not a member of any groups -- works
> - member of Uploaders only -- Recently Added display works;
> SidebarFacetsTransformer fails; attempting to browse fails
> - member of All only -- Recently Added display fails with
> SearchServiceException; SidebarFacetsTransformer fails; attempting to
> browse fails
> - member of All and Uploaders -- Recently Added display fails with
> SearchServiceException; SidebarFacetsTransformer fails; attempting to
> browse fails
> - member of All and Administrators -- works
> - member of Uploaders and Administrators -- works
> - member of Uploaders, All and Administrators -- works
>
> As far as I can tell, these errors will be the case for all users with the
> relevant group combination. I also tried creating a new, otherwise empty
> Test group. The errors don't show up for users who are members of Test
> alone, but if they're added to Uploaders and/or to All in addition to Test,
> they encounter errors associated with those groups.
>
> I've attached two error stacks: the Java stack trace displayed in the
> browser after an unsuccessful attempt by a member of the All group to
> browse by author, and the errors in dspace.log produced by the initial
> login of a member of the All group.
>
> As far as I know, there have been no obvious changes that might have
> provoked this. We recently moved the server within our local network
> (admins added some Windows services and changed the IP address), but
> nothing in the DSpace application itself has been modified.
>
> Any idea what's going on here? Seems to be a problem with Solr, but I
> can't figure out what.
>
> Nicholas Webb
> Digital Archivist
>
> Icahn School of Medicine at Mount Sinai
> Box 1102 - One Gustave L. Levy Place
> New York, NY 10029-6574
>
> (o) 212-241-7239
> (f) 212-241-7864
> (e) nicholas.w...@mssm.edu
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this gr

Re: [dspace-tech] Sword v2 problems with tomcat 7/8 Dspace 5.2

[Stuart A. Yeates]

If it's intermittent, i'd check to see whether it was java running out of
memory or temporary disk that's the problem.

Check for out of memory errors and/or high disk usage percentages.

cheers
stuart

--
...let us be heard from red core to black sky

On Sat, Apr 2, 2016 at 5:14 PM, Robin Harper 
wrote:

> Hi,
>
> I am having trouble  depositing larger files (> about 128k) using the java
> Swordv2 Client into dspace - if I am using tomcat 7 or 8 (works fine in
> tomcat 6)
>
> I have tried setting the following in the connector (server.xml)
> maxSwallowSize="-1"  maxPostSize="-1" but the size of the files causing
> errors are wrong in any event (it should default to 2MB)
>
> There are no error messages in the tomcat files (even with fine), no
> reported problems other than
>
> INFO [main] (HttpMethodDirector.java:439) - I/O exception
> (java.net.ConnectException) caught when processing request: Connection
> refused
>
>  INFO [main] (HttpMethodDirector.java:445) - Retrying request
>
>  x 3
>
>
>  from the sword client. I am running out of ideas. I am communicating
> directly with tomcat on port 8080.
>
>
> I can always shift back to tomcat 6 when I need to use sword (its
> intermittent) but that is a pain.
>
>
> I was wondering if anyone had seen this problem - or had any thoughts as
> to where I should look?
>
>
> Thanks
>
>
> Robin
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] OAI

[Stuart A. Yeates]

The most obvious thing to check is whether pages are actually being served
differently, or whether the difference is in the character set presentation
by the browser. To determine this, either manually override the character
set in the browser to ensure they're identical, or download both using a
tool such as wget / curl and compare them using 'less'

cheers
stuart

--
...let us be heard from red core to black sky

On Fri, Apr 1, 2016 at 6:27 AM, Gabriel Gervasio  wrote:

> Hello, we have several records loaded in DSpace 5.2, which are displayed
> correctly in the presentation and query interface. But from the OAI-PMH
> interface are displayed question marks instead of accents or special
> characters. The database is UTF-8 encoding, as well as Tomcat
> configurations/postgresql database is in UTF-8. Thanks in advance.
>
> http://dspace.plusites.net:8080 (ok)
> http://dspace.plusites.net:8080/oai (error with special characters)
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] DC to MARC

[Stuart A. Yeates]

MARC is significantly more expressive than either Simplified or Qualified
Dublin Core. A straight conversion is unlikely to get you the kind of
results you're hoping for.

cheers
stuart

--
...let us be heard from red core to black sky

On Tue, Mar 22, 2016 at 10:33 PM, DSpacer  wrote:

> *Hi all,*
>
> Recently, we were trying to convert Dublin Core to MARC 21 but in vain.
> Just found a bit interesting scripts for doing this on the following link:
>
> https://wiki.duraspace.org/display/DSPACE/Dc2MARC
>
> which reads as follows:
>
> "*Scripts for converting DublinCore to MARC*
>
> Export the items you want to convert the metadata for, using the DSpace
> export tool.
> Download and unpack the dc2marc.tar\
> 
>  .
>
> The files in this package are as follows:
> clean_linefeeds.pl - formats the dublin_core.xml files in a new files
> named dublin_core
> parse_indicators.pl - converts DCq to MARC - the result is a dspace.mrc
> file, containing all records
>
> Both Perl programs are run using the m_marc.sh.script
> USAGE: m_marc.sh (DIRECTORY where the dspace items were exported)
>
> clean-before-rerun.sh - removes dublin_core files created by
> clean_linefeeds.pl, if for whatever reason you want to rerun the scripts.
> USAGE: clean-before-rerun.sh (DIRECTORY where the dspace items were
> exported)
>
> The scripts may require the installation of some Perl modules.
>
> Developed at the University of Toronto. Licensed under Creative Commons
> Attribution 2.5 Canada License."
>
>
> Can you guys simplify it & order the steps? I've got confused a lot with
> it.
>
> Your help would mean a lot for us!
>
> Thanking you,
>
> *Regards,*
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] bitstreams with special chars not downloading

[Stuart A. Yeates]

There are some UTF-8 settings in the tomcat config. You probably need to
turn them on systematically. You may also want to specify unicode on the
commandline when starting tomcat (although that's usually a file content
encoding issue rather than a filename encoding issue).

cheers
stuart

--
...let us be heard from red core to black sky

On Tue, Mar 15, 2016 at 11:53 AM, Monika Mevenkamp 
wrote:

> The bitstream shown at
> http://dataspace.princeton.edu/jspui/handle/88435/dsp01xp68kj53b does not
> download correctly. This is JSPUI
>
> The bitstream has lots of UTF8 chars: Панкратова_М_Н_2007.pdf
> It links to
>
> http://dataspace.princeton.edu/jspui/bitstream/88435/dsp01xp68kj53b/1/%d0%9f%d0%b0%d0%bd%d0%ba%d1%80%d0%b0%d1%82%d0%be%d0%b2%d0%b0_%d0%9c_%d0%9d_2007.pdf
> which correctly  decides to
>
> http://dataspace.princeton.edu/jspui/bitstream/88435/dsp01xp68kj53b/1/Панкратова_М_Н_2007.pdf
>
>
> I set myself up to debug the issue on my laptop where I deal with
>
>
> http://localhost:8080/jspui/bitstream/88435/dsp01xp68kj53b/1/%D0%9F%D0%B0%D0%BD%D0%BA%D1%80
> %D0%B0%D1%82%D0%BE%D0%B2%D0%B0_%D0%9C_%D0%9D_2007.pdf
>
> http://localhost:8080/jspui/bitstream/88435/dsp01xp68kj53b/1/Панкратова_М_Н_2007.pdf
>
> I noticed that the HttpServletRequest request, that is passed to the
> ReferredObjects  constructor, contains the correct path in the
> coyoteRequest and in attributes[‘dspace.original.url’] along with a funny
> looking requestDispatchPath value. The code uses the value from
> the requestDispatchPath with the consequence that the comparison with the
> bitstream’s filename fails and the servlet refuses to return the bitstream;
> here the specifics:
>
>  attributes   "dspace.original.url" ->  "
> http://localhost:8080/jspui/bitstream/88435/dsp01xp68kj53b/1/%D0%9F%D0%B0%D0%BD%D0%BA%D1%80%D0%B0%D1%82%D0%BE%D0%B2%D0%B0_%D0%9C_%D0%9D_2007.pdf”
>
>
>  requestDispatchPath
> = /bitstream/88435/dsp01xp68kj53b/1/Панкратова_М_Р_2007.pdf
>  coyoteRequest = R(
> /jspui/bitstream/88435/dsp01xp68kj53b/1/%D0%9F%D0%B0%D0%BD%D0%BA%D1%80%D0%B0%D1%82%D0%BE%D0%B2%D0%B0_%D0%9C_%D0%9D_2007.pdf)
>
> Can anybody explain this behavior ?
>
> Monika
>
>
>
>
>
> 
> Monika Mevenkamp
>
> mo.me...@gmail.com
>
> http://mo-meven.tumblr.com/
> http://mcmprogramming.com/mo.meven/
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] adding additional fields to OAI?

[Stuart A. Yeates]

There are two options here.

Make a new metadata profile (gives huge flexibility, but will be ignored by
99% of harvesters) or change an existing one (limited flexibility, may be
misinterpreted, seen by most / all harvesters).

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Mar 10, 2016 at 8:05 AM, Borda, Susan 
wrote:

> Hi-
> Has anyone added additional fields to OAI? For example we have a pile of
> ETDs that have been OCR’d and are considering making the full text
> available and I’m wondering if this can be accomplished via OAI.
>
> Thanks,
> susan
> —
> Susan Borda
> Digital Technologies Development Librarian
> Montana State University Library
> 406-994-1873
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] Solr vs Google Analytics

[Stuart A. Yeates]

For sound business reasons, google analytics invests heavily in a rigorous
separation of human from computer accesses. Google analytics is always
likely to have lower numbers than other methods of counting.

cheers
stuart

--
...let us be heard from red core to black sky

On Wed, Feb 3, 2016 at 9:41 AM, Borda, Susan 
wrote:

> Hi-
> I’m finally getting a handle on this whole Solr business. Why would Solr
> have very different numbers than Google Analytics? For example:
>
> For handle # 1/2237 within March 2015 – Dec 2015:
>
> Within Dspace UI:
> Totals Visits (Views): 172
> File Visits (Views): 18436 – from Solr extracted data I’m getting more
> like 16,966
>
> From Google Analytics:
> All Traffic (Sessions): 95
> File Downloads: 6
>
> Is our instance of Google Analytics configured really incorrectly or what?
>
> Thanks,
> susan
> —
> Susan Borda
> Digital Technologies Development Librarian
> Montana State University Library
> 406-994-1873
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] REPOST: Discrepancy of figures displayed in the community-list from browse by list

[Stuart A. Yeates]

(a) try rebuilding the solr indexes to ensure they're up-to-date

(b) does every item have one and exactly one title?

cheers
stuart

--
...let us be heard from red core to black sky

On Thu, Nov 12, 2015 at 2:46 PM, euler  wrote:

> Dear All,
>
> I am reposting my query from October since I did not received any response
> from the list. Hope someone can help me to figure out how to reconcile the
> figures in the browse by titles and in the strengths displayed.
>
> Thanks in advance and best regards,
> euler
>
> On Thursday, October 8, 2015 at 8:58:13 PM UTC+8, euler wrote:
>>
>> Dear All,
>>
>> This is somewhat related to George's post: Question about Totals of Items
>> 
>>  from
>> a few days ago. I am wondering why the figures being displayed in the
>> community-list is not the same from the number of items in the browse by
>> titles? I suppose the figures from the community-list comes from querying
>> SOLR? The repository manager told me that in this repository, there were no
>> restricted items (so restricted items are out of the question). I tried
>> querying SOLR based from this page:
>> https://wiki.duraspace.org/display/DSPACE/Solr#Solr-Numberofitemsinaspecificcommunity
>>  and
>> the results are equal to the figures in the browse by titles.
>>
>> Here's the community-list link of the repository:
>> http://iris.wpro.who.int/community-list and here's the link of the
>> browse by title:
>> http://iris.wpro.who.int/handle/10665.1/9971/browse?type=title
>>
>> As I write this, there are 6,231 titles in the browse by titles but there
>> are 6,316 items being displayed in the community-list.
>>
>> Please help where should I look and how to fix the discrepancy in the
>> figures.
>>
>> Thanks in advance,
>> euler
>>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at http://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at http://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] OAI problem: "Can't overwrite cause"

[Stuart A. Yeates]

If I understand correctly that message means that an error was thrown but
the exact nature of the error has been obscured by non-printable unicode
characters in the original error message.

I'm going to take a punt and suggest that some metadata in your repository
contains unprintable unicode characters.

cheers
stuart
--
...let us be heard from red core to black sky

On Fri, Oct 2, 2015 at 9:45 AM, George Kozak  wrote:

>
> I have been getting a lot of complains that people cannot get full List of
> records from my DSpace repository (https://ecommons.cornell.edu) using
> OAI.
> I am running DSpace 5.2 XMLUI (Mirage2).
> I decided to do a clean index and ran:
> /bin/dspace oai -c
> It ran for 9400 items and then I got the following error:
> java.lang.IllegalStateException: Can't overwrite cause with
> java.io.IOException: Invalid white space character (0x19) in text to output
> at java.lang.Throwable.initCause(Throwable.java:456)
>
> Does anyone have any ideas on how I can proceed.  Around 9,000 items is
> all that anyone can get from my repository, so I am assuming that import
> failure is what is causing my problem.
> Any help will be appreciated.
>
> --
> ***
> George Kozak
> Digital Library Specialist
> Cornell University Library - IT
> 218 Olin Library
> Cornell University
> Ithaca, NY 14853
> 607-255-8924
> g...@cornell.edu
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at http://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at http://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Re: [dspace-tech] DSpace 5.3 Creative Commons connection timed out

[Stuart A. Yeates]

Given that this is very likely to occur in testing, could the error
handling give a more useful hint?

cheers
stuart

--
...let us be heard from red core to black sky

On Wed, Sep 16, 2015 at 9:25 AM, Andrea Schweer 
wrote:

> On 16/09/15 09:21, Andrea Schweer wrote:
>
>> Please note that if your test server is also behind a proxy, you may need
>> to make additional settings as mentioned in this comment here:
>> https://jira.duraspace.org/browse/DS-2151?focusedCommentId=42205&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-42205
>> There are proxy settings in build.properties / dspace.cfg (
>> https://github.com/DSpace/DSpace/blob/dspace-5.3/dspace/config/dspace.cfg#L429)
>> but according to the Jira comment it may be that those aren't used by the
>> Creative Commons code.
>>
>
> Just to add that I had a quick look at the code that talks to the Creative
> Commons API and it looks like it does use the proxy settings from
> dspace.cfg, at least in DSpace 5.3:
> https://github.com/DSpace/DSpace/blob/dspace-5.3/dspace-api/src/main/java/org/dspace/license/CreativeCommons.java#L62
> -- so the tomcat settings may not be required after all.
>
>
> cheers,
> Andrea
>
> --
> Dr Andrea Schweer
> IRR Technical Specialist, ITS Information Systems
> The University of Waikato, Hamilton, New Zealand
> +64-7-837 9120
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to dspace-tech+unsubscr...@googlegroups.com.
> To post to this group, send email to dspace-tech@googlegroups.com.
> Visit this group at http://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to dspace-tech+unsubscr...@googlegroups.com.
To post to this group, send email to dspace-tech@googlegroups.com.
Visit this group at http://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.