[Dspace-tech] metadata extract for withdrawn items

[Kirti Bodhmage]

Hi

We got nearly 700 items in withdrawn state.
Is there any easy way to export metadata for these 700 records.

I found few sql queries in dspace.log after enabling debug but finding it 
difficult to co-relate them.

Thanks
Kirti
--
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Batch import in DSpace 1.7

[Kirti Bodhmage]

Hi,

We have couple of  papers which needs to be imported in our Dspace repository.
The batch import tool  is suitable to import these papers  but it needs 
metadata in DSpace format.
Is there any way of creating DSpace Dublin-core format if we have some basic 
information about title, author, report number?

Regards
Kirti

--
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Internal Server Error due to Browse index erros

[Kirti Bodhmage]

Hi,



All of a sudden we started to get loads of  errors related to browse indexes.

It looks like some robot is using http://qmro.qmul.ac.uk/jspui/browse  url 
while it should be using this url with some parameter.





An internal server error occurred on http://qmro.qmul.ac.uk/jspui:

Date:   4/24/13 2:38 PM

Session ID: 76F88FEE407DA917F0BAAE58640E8063

User:   Anonymous

IP address: 138.37.31.252

-- URL Was: http://qmro.qmul.ac.uk/jspui/browse

-- Method: GET

-- Parameters were:

Exception:

javax.servlet.ServletException: There is no browse index for the request
*

Is there any way to stop robot to browse the website?


We got 2 robots.txt
One is under /tomcat/webapps/jspui  and has following content:

User-agent: *
# Uncomment the following line ONLY if sitemaps.org or HTML sitemaps are used
# and you have verified that your site is being indexed correctly.
# Disallow: /browse

Another robot.txt is at the root of apache /var/www/html and has following 
content:

User-agent: *
Disallow: /community-list
Disallow: /simple-search
Disallow: /advanced-search
Disallow: /displaystats
Disallow: /subscribe
Disallow: /register
Disallow: /password-login
Sitemap: https://qmro.qmul.ac.uk/jspui/sitemap?map=0

Does adding  ‘Disallow: /browse to’ any of these files will stop robot to 
browse our repository?

Regards
Kirti

--
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace sending too many alert emails

[Kirti Bodhmage]

HI,

The database is on a flaky hardware. We had few incidences of Dspace database 
going down over the  weekend and then DSpace sending loads of alert messages.

Here is the email generated:

*

An internal server error occurred on http://qmro.qmul.ac.uk/jspui:

Date:   4/23/13 2:07 AM

Session ID: C9917768F7057707AEA026A3DF7BFDF2

User:   Anonymous

IP address: 138.37.31.252

-- URL Was: 
http://qmro.qmul.ac.uk/jspui/bitstream/123456789/1674/1/SODIPOPiracyAnd1995.pdf

-- Method: GET

-- Parameters were:

Exception:

java.sql.SQLRecoverableException: IO Error: The Network Adapter could not 
establish the connection

at 
oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:478)

at 
oracle.jdbc.driver.PhysicalConnection.(PhysicalConnection.java:547)

at 
oracle.jdbc.driver.T4CConnection.(T4CConnection.java:225)

at 
oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:29)

at 
oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:556)

at java.sql.DriverManager.getConnection(DriverManager.java:582)

at java.sql.DriverManager.getConnection(DriverManager.java:185)

at 
org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:75)

at 
org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)

at 
org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:974)

at 
org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:106)

at 
org.dspace.storage.rdbms.DatabaseManager.getConnection(DatabaseManager.java:588)

at org.dspace.core.Context.(Context.java:95)

at 
org.dspace.app.webui.util.UIUtil.obtainContext(UIUtil.java:98)

at 
org.dspace.app.webui.servlet.DSpaceServlet.processRequest(DSpaceServlet.java:100)

at 
org.dspace.app.webui.servlet.DSpaceServlet.doGet(DSpaceServlet.java:67)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)

at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)

at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at 
org.dspace.utils.servlet.DSpaceWebappServletFilter.doFilter(DSpaceWebappServletFilter.java:78)

at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)

at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)

at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)

at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)

at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)

at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)

at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)

at 
org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:190)

at 
org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:291)

at 
org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:774)

at 
org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:703)

at 
org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:896)

at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690)

at java.lang.Thread.run(Thread.java:619)

Caused by: oracle.net.ns.NetException: The Network Adapter could not establish 
the connection


**

From: bluy...@gmail.com [mailto:bluy...@gmail.com] On Behalf Of Bram Luyten
Sent: 23 April 2013 11:40
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace sending too many alert emails

Hi Kirti,

can you copy a typical log entry for such a database error?

best regards,

Bram


--
[logo]

Bram Luyten @mire
2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010
Esperantolaan 4, Heverlee 3001, Belgium
www.atmire.com<http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=braml>


On Tue, Apr 23, 2013 at 10:36 AM, Kirti Bodhmage 
mailto:k.bodhm...@qmul.ac.uk>> wrote:
Hi,

We had couple of occasions when our dspace databas

[Dspace-tech] Dspace sending too many alert emails

[Kirti Bodhmage]

Hi,

We had couple of occasions when our dspace database went down and that has 
triggered DSpace sending alert messages to the mailing list with
subject line 'DSpace: Internal Server Error'.

The frequency of these messages are 2 or 3 messages per minute, within few 
hours we usually get hundreds of alert emails.

We do not want Dspace to send loads of alert messages when something goes wrong.
Is there any way to reduce the frequency of these emails ?

Regards
Kirti Bodhmage

--
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service 
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] solr not showing statistics after the upgrade

[Kirti Bodhmage]

Hi,

 

I have upgraded Dspace from 1.6.2 to 1.7.2  and I  couldn't see my SOLR
statistics.

Here is an error while running stats-util -o  job.

 

[appsrv@coot bin]$ ./dspace stats-util -o

SOLR Optimize -- Process Started:1361970127186

Exception: Not Found

 

Not Found

 

request: http://127.0.0.1:8080/solr/statistic/update

org.apache.solr.common.SolrException: Not Found

 

 

The dspace.log are filled with error.

 

Not Found

request: http://127.0.0.1:8080/solr/statistic/update?wt=javabin&version=1

2013-02-27 13:06:29,689 INFO
org.dspace.app.webui.servlet.AbstractBrowserServlet @
anonymous:session_id=447AD0281216E8B18B079231684D98AF:ip_addr=138.37.31.252:
browse:type=author,order=ASC,value=null,month=null,year=null,starts_with=nul
l,vfocus=null,focus=-1,rpp=20,sort_by=0,community=123456789/1,collection=n/a
,level=0,etal=-1

2013-02-27 13:06:29,689 INFO  org.dspace.browse.BrowseEngine @
anonymous:session_id=447AD0281216E8B18B079231684D98AF:ip_addr=138.37.31.252:
browse_by_value:focus=null

2013-02-27 13:06:30,646 INFO
org.dspace.app.webui.servlet.AbstractBrowserServlet @
anonymous:session_id=073659E678C455FFF47560596A4F4DF5:ip_addr=138.37.31.252:
browse:type=author,order=ASC,value=Schneider,
RA,month=null,year=null,starts_with=L,vfocus=null,focus=-1,rpp=20,sort_by=1,
community=n/a,collection=n/a,level=1,etal=-1

2013-02-27 13:06:30,646 INFO  org.dspace.browse.BrowseEngine @
anonymous:session_id=073659E678C455FFF47560596A4F4DF5:ip_addr=138.37.31.252:
browse_by_item:

2013-02-27 13:06:33,451 INFO  org.dspace.usage.LoggerUsageEventListener @
anonymous:session_id=3D5EB2250BB3A76426EF6A4701BAFDFC:ip_addr=138.37.31.252:
view_collection:collection_id=146

2013-02-27 13:06:33,460 ERROR
org.dspace.statistics.SolrLoggerUsageEventListener @ Not Found

 

Do you think my GeoLiteCity.dat file is corrupted ?
 
 

Regards

Kirti

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Removing duplicates in metadata fields

[Kirti Bodhmage]

Hi,

 

For some reason we got duplicates of dc.relation.ispartof  metadata field in
many of the records in repository.

 

Is there any sql to remove these duplicates ?

 

Thanks

Kirti Bodhmage

 

--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnnow-d2d___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] SOLR Exception in 1.6.2 : Service Unavailable

[Kirti Bodhmage]

Hi Again,


I saw following error in catalina.err related to SOLR.
I  do not know solr technology  but do I need to increase maxWarmingSearchers 
value?



Jan 11, 2013 1:42:18 PM org.apache.solr.common.SolrException log
SEVERE: org.apache.solr.common.SolrException: Error opening new searcher. 
exceeded limit of maxWarmingSearchers=2, try again later.

at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:941)
at 
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:368)
at 
org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:77)
at 
org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:104)
---

Ta
Kirti

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 11 January 2013 13:30
To: Kirti Bodhmage
Cc: dspace-tech
Subject: Re: [Dspace-tech] SOLR Exception in 1.6.2 : Service Unavailable

On Fri, Jan 11, 2013 at 2:22 PM, Kirti Bodhmage  wrote:
> Do we need to enable autocommit  to resolve this error?

According to @mire's page yes, but also note that you need to change 
SolrLogger.java.

> Another interesting thing to notice is that  wget on solr url shows an 
> error.

That is normal. By default, Solr is accessible only from the machine DSpace 
runs on [1]. No need to change anything here. For testing purposes, you acn 
call wget from the dspace machine.

https://wiki.duraspace.org/display/DSPACE/Solr#Solr-ConnectingtoSolr


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] SOLR Exception in 1.6.2 : Service Unavailable

[Kirti Bodhmage]

Hi,

 

All of a sudden we started to get following exception about SOLR on our live 
server. 

This is causing a very high CPU usage on the server,  displaying server busy 
error to users.

 

--

2013-01-11 13:04:06,715 ERROR org.dspace.statistics.SolrLogger @ Service 
Unavailable

Service Unavailable

request: http://127.0.0.1:8080/solr/statistics/update

org.apache.solr.common.SolrException: Service Unavailable

Service Unavailable

request: http://127.0.0.1:8080/solr/statistics/update

at 
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:343)

at 
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:183)

at 
org.apache.solr.client.solrj.request.UpdateRequest.process(UpdateRequest.java:217)

at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:85)

at org.dspace.statistics.SolrLogger.post(SolrLogger.java:247)

at 
org.dspace.statistics.SolrLoggerUsageEventListener.receiveEvent(SolrLoggerUsageEventListener.java:41)

at 
org.dspace.services.events.SystemEventService.fireLocalEvent(SystemEventService.java:154)

 



 

I goggled on this error and found a page from AtMire   
 
http://atmire.com/statistics_performance.php,.

 

It talks about enabling autocommit.

 

The settings for autocommit in our solrconfig.xml are commented.

 



 

Do we need to enable autocommit  to resolve this error?

 

Another interesting thing to notice is that  wget on solr url shows an error.

 

wget  http://127.0.0.1:8080/solr/statistics/

--2013-01-11 13:18:47--  http://127.0.0.1:8080/solr/statistics/

Connecting to 127.0.0.1:8080... connected.

HTTP request sent, awaiting response... 404 Not Found

2013-01-11 13:18:47 ERROR 404: Not Found.

 

Is there anything missing here?

 

Thanks

Kirti

--
Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
much more. Get web development skills now with LearnDevNow -
350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122812___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Exporting collection fails for large collection in Dspace 1.7.2

[Kirti Bodhmage]

Yes. The error was
"The overall size of this export is too large.  Please contact your 
administrator for more information."

I could get rid of this error by setting 

org.dspace.app.itemexport.max.size = 1024.


Thanks
kirti

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 09 January 2013 15:05
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Exporting collection fails for large collection in 
Dspace 1.7.2

Hi kriti,

was this the exact error?

"The overall size of this export is too large.  Please contact your 
administrator for more information."

Try changing the following configuration option:

# The maximum size in Megabytes the export should be.  This is enforced before 
the # compression.  Each bitstream's size in each item being exported is added 
up, if their # cummulative sizes are more than this entry the export is not 
kicked off org.dspace.app.itemexport.max.size = 200


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
Master Java SE, Java EE, Eclipse, Spring, Hibernate, JavaScript, jQuery
and much more. Keep your Java skills current with LearnJavaNow -
200+ hours of step-by-step video tutorials by Java experts.
SALE $49.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122612 
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

[Kirti Bodhmage]

Hi,

This has been fixed now. 
Posting the solution , someone may find it useful.

I have to import Repository Tools jar in maven repository
(dspace-symplectic-api  dspace-symplectic-webapp  elements-api)  and change
few pom.xml s in dspace source directory
And buidt the dspace.

This has added Repository Tools classes in Dspace code.

Regards
Kirti 

-Original Message-
From: Kirti Bodhmage [mailto:k.bodhm...@qmul.ac.uk] 
Sent: 08 January 2013 11:05
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

No. I haven't compiled Dspace with these libraries.

I will raise a support call with Symplectic.

Thanks
Kirti


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of
helix84
Sent: 08 January 2013 10:39
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

Hi Kirti,

first of all, I know almost nothing about Repository Tools / Symplectic
Elements, so it might be best to ask them directly.

But the following is quite a common Java error, meaning that the requested
class cannot be fount in classpath for some reason.

On Tue, Jan 8, 2013 at 11:28 AM, Kirti Bodhmage 
wrote:
> Caused by: java.lang.ClassNotFoundException: 
> uk.co.symplectic.repository.dspace.ElementsConsumer

I would first verify that the repository tools' jar is located in both
[dspace]/lib and in [dspace]/webapps/xmlui/WEB-INF/lib/. Judging from the
names of the directories you mentioned, it was probably supposed to be
compiled along with the new DSpace version you deployed. Did you do that?


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette



--
Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS and
more. Get SQL Server skills now (including 2012) with LearnDevNow -
200+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only - learn more at:
http://p.sf.net/sfu/learnmore_122512
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette:
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
Master Java SE, Java EE, Eclipse, Spring, Hibernate, JavaScript, jQuery
and much more. Keep your Java skills current with LearnJavaNow -
200+ hours of step-by-step video tutorials by Java experts.
SALE $49.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122612 
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Exporting collection fails for large collection in Dspace 1.7.2

[Kirti Bodhmage]

Hi,

I tried to export collections in Dspace via GUI and from command line interface.

Exporting collection via GUI works for smaller collection ( e.g. collection 
with 15 Items in it)
But it fails for collection having 300 items in it. The error on the webpage is 
'Export is too large'.

I tried the same export via command line and both exports work fine.
It took around 15 to 20 mins for collection with 300 items to create a zip file.

As exporting the large collection is successful via command line but fails via 
GUI, I wonder if GUI interface is timing out before server finishes the process.
I haven't seen any timeout error in the logs though.

Does anybody have similar problem?

Regards
Kirti Bodhmage


--
Master Java SE, Java EE, Eclipse, Spring, Hibernate, JavaScript, jQuery
and much more. Keep your Java skills current with LearnJavaNow -
200+ hours of step-by-step video tutorials by Java experts.
SALE $49.99 this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122612 
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

[Kirti Bodhmage]

No. I haven't compiled Dspace with these libraries.

I will raise a support call with Symplectic.

Thanks
Kirti


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 08 January 2013 10:39
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

Hi Kirti,

first of all, I know almost nothing about Repository Tools / Symplectic 
Elements, so it might be best to ask them directly.

But the following is quite a common Java error, meaning that the requested 
class cannot be fount in classpath for some reason.

On Tue, Jan 8, 2013 at 11:28 AM, Kirti Bodhmage  wrote:
> Caused by: java.lang.ClassNotFoundException: 
> uk.co.symplectic.repository.dspace.ElementsConsumer

I would first verify that the repository tools' jar is located in both 
[dspace]/lib and in [dspace]/webapps/xmlui/WEB-INF/lib/. Judging from the names 
of the directories you mentioned, it was probably supposed to be compiled along 
with the new DSpace version you deployed. Did you do that?


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette 
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS
and more. Get SQL Server skills now (including 2012) with LearnDevNow -
200+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only - learn more at:
http://p.sf.net/sfu/learnmore_122512
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Dspace upgrade and Repository tools(Symplectic)

[Kirti Bodhmage]

Hi,

 

This is question for Repository Tools for Dspace.

I wonder if anybody has faced this problem with Dspace upgrade.

 

We got Repository Tools for Dspace to talk to Symplectic Elements
(Publication website).

 

We have upgraded our Dspace instance from 1.6.2 to 1.7.2 but the upgrade has
broken the Repository Tools. 

 

What is the best way of fixing the Repository Tools?

 

Do we need to install Repository Tools again after the upgrade?

 

Or 

 

Do we just need to compile Dspace with following jars?

dspace-symplectic-api 

dspace-symplectic-webapp

elements-api

 

I have copied our old crosswalk and the publication settings in dspace.cfg
in new installation directory.

 

The exception in the dspace.log is:

 

Caused by: java.lang.ClassNotFoundException:
uk.co.symplectic.repository.dspace.ElementsConsumer

at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.jav
a:1645)

at
org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.jav
a:1491)

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:169)

at
org.dspace.event.ConsumerProfile.readConfiguration(ConsumerProfile.java:87)

at
org.dspace.event.ConsumerProfile.makeConsumerProfile(ConsumerProfile.java:62
)

at
org.dspace.event.EventManager$DispatcherPoolFactory.makeObject(EventManager.
java:227)

 

 

Regards

Kirti Bodhmage

Application Analyst

 

--
Master SQL Server Development, Administration, T-SQL, SSAS, SSIS, SSRS
and more. Get SQL Server skills now (including 2012) with LearnDevNow -
200+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
SALE $99.99 this month only - learn more at:
http://p.sf.net/sfu/learnmore_122512___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] old solr statistics missing after upgrade from 1.6.2 to 1.7.2

[Kirti Bodhmage]

Hi,

 

We have recently upgraded our test instance from Dspace 1.6.2 to 1.7.2.

After the upgrade we found that old statistics are missing.

 

The statistics page shows the statistics from the date of upgrade.

 

Do we need to copy  files from backup   /dspace1.6.2 /solr/statistics/data
to  dspace.1.7.2/solr/statistics/data  ?

 

 

 

Regards

Kirti Bodhmage

 

 

--
Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS,
MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current
with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft
MVPs and experts. ON SALE this month only -- learn more at:
http://p.sf.net/sfu/learnmore_122712___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Dspace 1.6.2 --connectivity with 11g

[Kirti Bodhmage]

Hi,

Can anybody confirm that Dspace 1.6.2 is compatible with Oracle 11g?
Dspace 1.6.2 needs 9i.


We are in process of migrating from 1.6.2 to 1.7.2  and 1.7.2 needs  Oracle
11g database.

The first step for us is to migrate our 9i database to 11g database. And
then do Dspace upgrade.

Will current Dspace 1.6.2 will work with 11g?

Thanks
Kirti

-Original Message-
From: Lighton Phiri [mailto:lighton.ph...@gmail.com] 
Sent: 13 December 2012 19:46
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] dspace upgrade to 1.7.2-- oracle database version

You could use 10g if you wanted; the documentation [1] says 1.7.2 supports
Oracle database 10g or greater.

[1]
https://wiki.duraspace.org/display/DSDOC17/Installation#Installation-Relatio
nalDatabase:(PostgreSQLorOracle).
Lighton Phiri
http://lightonphiri.org


On 13 December 2012 19:42, Kirti Bodhmage  wrote:
> Hi,
>
>
>
> We are in process to upgrade from 1.6.2 to 1.7.2.
>
> Our  database is Oracle 9i.
>
>
>
> Does version 1.7.2 needs 11g as database ?
>
>
>
> Thanks
>
> Kirti
>
>
> --
>  LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free 
> Trial Remotely access PCs and mobile devices and provide instant 
> support Improve your efficiency, and focus on delivering more 
> value-add services Discover what IT Professionals Know. Rescue 
> delivers http://p.sf.net/sfu/logmein_12329d2d
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] dspace upgrade to 1.7.2-- oracle database version

[Kirti Bodhmage]

Hi,

 

We are in process to upgrade from 1.6.2 to 1.7.2.

Our  database is Oracle 9i.

 

Does version 1.7.2 needs 11g as database ?

 

Thanks

Kirti

--
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace statistics--where is download information

[Kirti Bodhmage]

Hi,

I am still struggling to extract download information from the SOLR as well as 
database.

Attaching database schema.
Any idea which table has file download information ?

>From SOLR documentation

Following url displays: Top downloaded items by a specific user

http://localhost:8080/solr/statistics/select?indent=on&version=2.2&start=0&rows=100&fl=*%2Cscore&qt=standard&wt=standard&explainOther=&hl.fl=&facet=true&facet.field=epersonid&q=type:0


I am interested to find out following things:

Top 10 downloaded  items in each collection

Lifetime of the repository (up to today) -
A download metric for every object in collection

Thanks
Kirti



-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 24 October 2012 15:05
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace statistics--where is download information

On Wed, Oct 24, 2012 at 3:51 PM, Kirti Bodhmage  wrote:
> The error I got is, unknown type search.resourcetype
> --
> HTTP Status 400 - undefined field search.resourcetype type Status 
> report message undefined field search.resourcetype description The 
> request sent by the client was syntactically incorrect (undefined field 
> search.resourcetype).
> ---

Well, the message seems to come from Solr alright, although I wasn't able to 
reproduce it.


> Is the documentation in https://wiki.duraspace.org/display/DSPACE/Solr  is 
> for Dspace 1.7 onwards ?

Yes, Discovery is officially in DSpace since 1.7, before that it has been 
available as an addon.
So I didn't consider any previous version, but the basics must be similiar. The 
schema might have changed, though. So like I said, just go to the admin 
interface. You'll see a list of admin interfaces for each of the cores if you 
go to:

http://localhost:8080/solr/

Which cores can you see there?

When you open the admin interface, go to "schema browser".


> Is there any way to query SOLR in 1.6.2 ?

Ah, you didn't say you had 1.6.2. There have surely been many changes between 
1.6, 1.7 and 1.8, so anything's possible. I actually wasn't sure if there was a 
"search" core before 1.7. I know there was "statistics". If there really wasn't 
"search", you'll have to get that data using SQL.

Regards,
~~helix84


Dspace-db-schema.pdf
Description: Adobe PDF document
--
The Windows 8 Center - In partnership with Sourceforge
Your idea - your app - 30 days.
Get started!
http://windows8center.sourceforge.net/
what-html-developers-need-to-know-about-coding-windows-8-metro-style-apps/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace statistics--where is download information

[Kirti Bodhmage]

Hi,

I was able to connect to SOLR using ssh forwarding from putty.

I tried to query SOLR using following url

http://localhost:8080/solr/search/select?q=search.resourcetype:2&sort=dc.date.accessioned_dt%20desc

The error I got is, unknown type search.resourcetype
--
HTTP Status 400 - undefined field search.resourcetype
type Status report
message undefined field search.resourcetype
description The request sent by the client was syntactically incorrect 
(undefined field search.resourcetype).
---

Is the documentation in https://wiki.duraspace.org/display/DSPACE/Solr  is for 
Dspace 1.7 onwards ?

Is there any way to query SOLR in 1.6.2 ?

Thanks
Kirti

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 24 October 2012 13:12
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace statistics--where is download information

Hi Kirti,

you're right, the download count is only in the Solr index ("statistics" core), 
not in DB. Additionally, the data about items (file name, collection name, 
author) is also in Solr, albeit in a different core ("search"). Therefore I 
recommend you to combine these two sources to get the results you need. It may 
sound intimidating at first, but querying Solr is really easy once you grasp 
the basics. The sole purpose of Solr is to be queried easily! I've written up 
some basic information on Solr in DSpace here:


https://wiki.duraspace.org/display/DSPACE/Solr

There are not many examples yet, but you can derive the specific things you 
need by looking at the admin interface, also mentioned there. If you get it 
working, make sure to add your use case there as an example!

PS The only other source where you could find download statistics is log files.

Regards,
~~helix84


--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_sfd2d_oct
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Dspace statistics--where is download information

[Kirti Bodhmage]

Hi,

We are on Dspace 1.6.2.

Is there any way of getting download count of all files held in repository ?

I need to extract following information from database. 

File name  collection name ---  author download count/view count

Looking at the database tables , I couldn't figure out  where is the
download count. 

We got SOLR statistics enabled but that shows statistics for each paper, is
there anyway of collating download information for all the papers in
repository. 

Thanks
Kirti
 







--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_sfd2d_oct
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] location of robots.txt on the Dspace

[Kirti Bodhmage]

Hi 

 

In our Dspace installation, we got apache in front of tomcat.

I saw errors in apache log 

 

[Sun Oct 07 04:44:19 2012] [error] [client 138.37.31.252] File does not
exist: /var/www/html/robots.txt

 

Does this mean that our robots.txt is not visible?

 

We have our robots.txt for dspace in jspui and xmlui  directory.

 

https://qmro.qmul.ac.uk/jspui/robots.txt

https://qmro.qmul.ac.uk/xmlui/robots.txt

 

Should we keep our robots.txt at the root of apache i.e. in /var/www/html
directory ?

There is no other application on this server. Apache /tomcat are solely
installed for Dspace.

 

Thanks

Kirti

--
Don't let slow site performance ruin your business. Deploy New Relic APM
Deploy New Relic app performance management and know exactly
what is happening inside your Ruby, Python, PHP, Java, and .NET app
Try New Relic at no cost today and get our sweet Data Nerd shirt too!
http://p.sf.net/sfu/newrelic-dev2dev___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Changing Messages.properties

[Kirti Bodhmage]

Hi ,

 

I have changed few fields in Messges.properties.

 

Followed Dspace rebuild steps from wiki.

https://wiki.duraspace.org/display/DSPACE/Rebuild+DSpace

 

Carried

Full Refresh/Rebuild: (Completely refresh all of DSpace)

  mvn clean package (removes all old compiled code and recompiles all DSpace
code and rebuilds the DSpace installation package) 

 cd [dspace-source]/dspace/target/dspace-[version]-build.dir/ (move into the
target directory where DSpace has been rebuilt) 

ant update_webapps -Dwars=true

 

Restarted tomcat.

 

Why does doesn't changes are not appearing on the web page.

 

Thanks

Kirti

--
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://ad.doubleclick.net/clk;258768047;13503038;j?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Dspace Upgrade 1.6.2 to 1.8.2

[Kirti Bodhmage]

Hi,

At our institution we are planning to upgrade Dspace 1.6.2 to 1.8.2.
Looking at the Duraspace documentation,  I think we need 3 upgrades.

1.6.2  to  1.7
1.7  to  1.8
1.8  to 1.8.2

Could anybody confirm this?

Thanks
Kirti Bodhmage


--
Got visibility?
Most devs has no idea what their production app looks like.
Find out how fast your code is with AppDynamics Lite.
http://ad.doubleclick.net/clk;262219671;13503038;y?
http://info.appdynamics.com/FreeJavaPerformanceDownload.html
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Changing Handle URL

[Kirti Bodhmage]

Hi,

<<< The 123456789 prefix is a bogus, non-existent prefix and the default value 
if you don't specify your actual handle prefix (assuming you have one).>>>

We are not registered with Handle server so we do not have handle prefix that’s 
the reason we are using 123456789.

I came across few handles:

http://www.dspace.cam.ac.uk/handle/1810/221922
http://cadair.aber.ac.uk/dspace/handle/2160/1

Does this mean that these universities have registered with Handle server and 
has 2160 or 1810 registered as institution id?
How do we get this institution id generated for us?

One more thing to notice in these handles that they do not have 'jspui' in the 
URL.
We got of jspui in the handle url, making it longer. 
https://qmro.qmul.ac.uk/jspui/handle/123456789/2564

Is there any way to get rid of jspui here, we haven't got  xmlui  yet?

Thanks
Kirti

-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 07 August 2012 12:44
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Changing Handle URL

Hi Kirti,

On Tue, Aug 7, 2012 at 1:27 PM, Kirti Bodhmage  wrote:
> I think this question has been asked many times on this list.

I believe this is the first time :)

> My requirement is to change handle url to something smaller.
>
> Instead of https://qmro.qmul.ac.uk/jspui/handle/123456789/2564 can we 
> change it to https://qmro.qmul.ac.uk/2564 .

The 123456789 prefix is a bogus, non-existent prefix and the default value if 
you don't specify your actual handle prefix (assuming you have one).

> As I want to reduce URL to something smaller, is there any way to 
> avoid handle.prefix all together?

No, for now, you have to keep it.

> I tried removing it but didn't work.  Although setting it to something 
> like
> handle.prefix=1 does work.

Do not do this. This indicates you're the institution with handle prefix "1", 
which you surely aren't. Handle redirects would be broken (there's a 
hdl.handle.net permaling automatically generated with this prefix).

SOLUTION: I assume you're running a web server (e.g. Apache HTTPD) in front of 
your servlet contaniner (e.g. Tomcat). What you want to do is add an URL 
rewriting module (e.g. mod_rewrite) that will intercept all reqests in form of 
"^/[1-9]*$" (regex notation) and turn them into redirects to 
"/jspui/handle/123456789/$1". In mod_rewrite notation, this would be:

RewriteEngine on
RewriteRule ^/[1-9]*$ /jspui/handle/123456789/$1$1 [L]

(This is off the top of my head, I didn't test it)

> I assume any change in handle prefix will be applied to newly 
> submitted records not the existing records in repository.

That's right, there's the "[dspace]/bin/dspace update-handle-prefix"
command for updating existing items, but DO NOT change the prefix for the 
reasons I said above.

> If I change the handle prefix then the old records will have 
> handle.prefix set to 123456789  and new one handle.prefix = 1.
>
> Is there any problem having both handle in repository?
>
> We have Symplectic Elements and repository tools depositing records 
> into Dspace.  Will changing the handle url create any issue with 
> publications?( a question for Symplectic)

Like I said above, don't change the handle prefix.

Regards,
~~helix84
--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Changing Handle URL

[Kirti Bodhmage]

Hi,

I think this question has been asked many times on this list.

My requirement is to change handle url to something smaller.

Instead of https://qmro.qmul.ac.uk/jspui/handle/123456789/2564 can we change
it to https://qmro.qmul.ac.uk/2564 .

Looking into the previous email discussions on this list , I think I need to
change handle.canonical.prefix parameter in Handle settings section in
dspace.cfg.

# to change
# CNRI Handle prefix
handle.prefix = 123456789

As I want to reduce URL to something smaller, is there any way to avoid
handle.prefix all together?
I tried removing it but didn't work.  Although setting it to something like
handle.prefix=1 does work.

I assume any change in handle prefix will be applied to newly submitted
records not the existing records in repository.
If I change the handle prefix then the old records will have handle.prefix
set to 123456789  and new one handle.prefix = 1.
Is there any problem having both handle in repository?

We have Symplectic Elements and repository tools depositing records into
Dspace.  Will changing the handle url create any issue with publications?( a
question for Symplectic)

Thanks
Kirti Bodhmage


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Theses count is 0 in stats

[Kirti Bodhmage]

Hi,
Thank you for all your reply.

I changed following entry to Thesis and ran stats generation.
That has displayed theses count on stats page.

#item.type=Thesis or Dissertation
item.type=Thesis

Also ran
[dspace]/bin/dspace itemcounter
That has displayed Community and Collection strength on community-list page.

Is it a good idea to run itemcounter on weekly basis ?

thanks
Kirti


On 03/08/2012 11:10, Hilton Gibson wrote:
This wiki page may help: 
http://wiki.lib.sun.ac.za/index.php/SUNScholar/Indexes



On 3 August 2012 11:58, Sean Carte <mailto:sean.ca...@gmail.com>> wrote:


On 2 August 2012 23:23, Kirti Bodhmage mailto:k.bodhm...@qmul.ac.uk>> wrote:
> Yes. It is specified in dstat.cfg file.
> Here is the screen shot of my statistic page.
> The theses is mapped to dc.type = thesis.
>
> We do have collection type as Theses where all our theses goes. On
> statistics page theses appears to be 0.

I believe you need to change the item.type parameter in your dstat.cfg
file, e.g.:

# The item types in the archive that you need number breakdowns on
#item.type=Thesis or Dissertation
item.type=Thesis

Then you'll probably need to regenerate your stats.

Sean
--
Sean Carte
DUT E-Repository Administrator
+27 72 898 8775 
+27 31 373 2490 
fax: 0866741254
ir.dut.ac.za <http://ir.dut.ac.za>


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond.
Discussions
will include endpoint security, mobile security and the latest in
malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
<mailto:DSpace-tech@lists.sourceforge.net>
https://lists.sourceforge.net/lists/listinfo/dspace-tech




--
*Hilton Gibson*
Systems Administrator
JS Gericke Library
Room 1025D
Stellenbosch University
Private Bag X5036
Stellenbosch
7599
South Africa

Tel: +27 21 808 4100 | Cell: +27 84 646 4758
http://library.sun.ac.za
http://scholar.sun.ac.za



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/


___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Theses count is 0 in stats

[Kirti Bodhmage]

Hi,

We have quite a lot of theses in our repository.  They are submitted as 
dc.type = Thesis in repository.
But statistics page that display all the statistic of the repository 
does not show any theses count.


Do we need to any tweaking any of the config file?

thanks
Kirti

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Problem with XPDF media filter

[Kirti Bodhmage]

Hi,

I am trying to implement xpdf based media filter to create  thumbnail for
pdf file.

I have followed the steps in
https://wiki.duraspace.org/display/DSDOC18/Configuration#Configuration-XPDFF
ilter
However its failing with following error: 

java.io.IOException: Unknown failure while transforming file to preview: no
image produced.
java.io.IOException: Unknown failure while transforming file to preview: no
image produced.
at
org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2
humbnail.java:274)
at
org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaF

>From dspace log

2012-07-23 11:05:01,278 DEBUG
org.dspace.storage.bitstore.BitstreamStorageManager @ Local filename for
161051830620288644016828917358339903238 is
C:\Apps\Dspace\assetstore\16\10\51\161051830620288644016828917358339903238
2012-07-23 11:05:01,302 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
DPI: pdfinfo method got dpi=68 for max dim=842 (points, 1/72")
2012-07-23 11:05:01,303 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
Running xpdf command:
 [C:/Software/xpdfbin-win-3.03/bin64/pdftoppm, -q, -f, 1, -l, 1, -r, 68,
C:\Users\aaw278\AppData\Local\Temp\DSfilt5250205036264284127.pdf,
C:\Users\aaw278\AppData\Local\Temp\prevu6435142189971505908out]
2012-07-23 11:05:01,487 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
PDFTOPPM output is:
C:\Users\aaw278\AppData\Local\Temp\prevu6435142189971505908out-01.ppm,
exists=true

On the command line

FILTERED: bitstream 22 (item: 100/11) and created 'Symplectic Elements v3.7
- HR Data Import & User Groups.pdf.txt'
ERROR filtering, skipping bitstream:
Item Handle: 100/11
Bundle Name: ORIGINAL
File Size: 248040
Checksum: 7b9d6f574aa5800d0b8b0e5f3bcb5a86 (MD5)
Asset Store: 0
java.io.IOException: Unknown failure while transforming file to preview: no
image produced.
java.io.IOException: Unknown failure while transforming file to preview: no
image produced.
at
org.dspace.app.mediafilter.XPDF2Thumbnail.getDestinationStream(XPDF2Thumbnai
l.java:274)
at
org.dspace.app.mediafilter.MediaFilterManager.processBitstream(MediaFilterMa
nager.java:674)
at
org.dspace.app.mediafilter.MediaFilterManager.filterBitstream(MediaFilterMan
ager.java:575)
at
org.dspace.app.mediafilter.MediaFilterManager.filterItem(MediaFilterManager.
java:525)
at
org.dspace.app.mediafilter.MediaFilterManager.applyFiltersItem(MediaFilterMa
nager.java:493)

Dspace log doesn't say its failing while command line says no image
produced. Is there any tweaking needs to be done ?
I am running Dspace on windows.

Thanks
Kirti



--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Rebuilding dspace after change in dspace.cfg

[Kirti Bodhmage]

Hi,

Came across this in one of the answer in the mailing list.

---
After having changed dspace.cfg,
1. rebuild dspace,
2. run [dspace]/bin/filter-media,
3. and run [dspace]/bin/index-all
---

I just change dspace.cfg for thumbnails .  Do I need to rebuilt Dspace ?

Thanks
Kirti


-Original Message-
From: Kirti Bodhmage [mailto:k.bodhm...@qmul.ac.uk] 
Sent: 22 June 2012 16:37
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Thumbnail Priview. in 1.6.2

Richard,
Your reply explains why media-filters not generating icon or image for
WU_T_FINAL.pdf instead it creates WU_T_FINAL.pdf.txt. 

But it did generate a thumbnail for png file.
I uploaded  a png file to Dspace , ran media-filter job and then refreshed
the page I could see jpg next to item on browse page Attaching a screenshot.

helix84,
You were correct.  We had a database refresh from live to test long back and
not sure if we had sync on asset store. And that causing
java.io.FileNotFoundException .

But now the question is how to I get thumbanail for pdfs, word or any other
text?  Is anybody using xpdf  for that ?

Thanks
Kirti


-Original Message-
From: Martínez Zuñiga, Enrique [mailto:enri...@iteso.mx]
Sent: 22 June 2012 15:55
To: 
Subject: Re: [Dspace-tech] Thumbnail Priview. in 1.6.2

Hi All,

I've found a similar situation with 1.8.2 and the problem still is with the
pdftoppm tool when extract the PDF's thumbnail, the tool has changed the
output file naming schema.

In the logs (in debug mode) throws this:

2012-06-20 12:54:21,219 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
DPI: pdfinfo method got dpi=56 for max dim=1026 (points, 1/72")
2012-06-20 12:54:21,219 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
Running xpdf command: [/usr/bin/pdftoppm, -q, -f, 1, -l, 1, -r, 56,
/tmp/DSfilt2572793846402123318.pdf, /tmp/prevu6465374009455317236out]
2012-06-20 12:54:21,606 DEBUG org.dspace.app.mediafilter.XPDF2Thumbnail @
PDFTOPPM output is: /tmp/prevu6465374009455317236out-01.ppm,
exists=false
2012-06-20 12:54:21,606 ERROR org.dspace.app.mediafilter.XPDF2Thumbnail @
Unable to delete file

And DSpace is looking for a file with the name
prevu6465374009455317236out-01.ppm but pdftoppm created this file
prevu6465374009455317236out-001.ppm hence the file not found exception.

I've fixed with a script that wraps the pdftoppm tool, and replaced the
xpdf.path.pdftoppm parameter in dspace.cfg to point to this script.

In dspace.cfg I replaced this line:

xpdf.path.pdftoppm = /usr/bin/pdftoppm

With this:

xpdf.path.pdftoppm = /dspace/bin/pdftoppm.sh

And the script is in /dspace/bin/pdftoppm.sh

Please change the path to pdftoppm according to yours.

START SCRIPT --
#!/bin/sh
# Enrique Martinez
# Para corregir el nombre de archivo de la extracion de la caratula.

/usr/bin/pdftoppm $1 $2 $3 $4 $5 $6 $7 $8 $9 CONVERTRESULT=$?

SOURCEFILE=$9-*.ppm
TARGETFILE=$9-01.ppm

for file in $SOURCEFILE; do mv $file $TARGETFILE; exit; done

return $CONVERTRESULT
END SCRIPT --


Hope this helps,


Enrique Martínez


-Mensaje original-
De: Richard Rodgers [mailto:rrodg...@mit.edu] Enviado el: Viernes, 22 de
Junio de 2012 07:55 a.m.
Para: Kirti Bodhmage
CC: 
Asunto: Re: [Dspace-tech] Thumbnail Priview. in 1.6.2

Hi Kirti:

Not sure if you are having other problems, but I did want to clarify how
MediaFilter works.
It is a general set of tools for operating on your bitstream content, and
the primary use for most people is to extract text (for indexing) from PDFs
Word files etc, not to produce thumbnails of those formats.
These functions are configured in dspace.cfg (search for 'mediafilter'
properties) - and each 'filter' is given a list of formats to process. It
further optimizes its work by not recreating a derivative (i.e. the text
file, or thumbnail, etc) if it already exists - that is the message you are
seeing below (SKIPPED). 

Hope this helps,

Richard R

On Jun 22, 2012, at 6:34 AM, Kirti Bodhmage wrote:

> Hi,
> We have Dspace 1.6.2.
> I am trying to enable  thumbnail creation.
> Ran ./filter-media  in dspace/bin directory
> 
> Got following errors while executing script. After the execution I 
> could see thumbnail image for png item but couldn't see anything for 
> the pdf and other text items.
> 
> I was expecting filter-media will create image file from pdf and Word 
> documents but its creating .txt file instead.
> 
> Saw previous emails on thumbnail creation in this mailing list.  Is 
> xpdf filter is better choice for  pdfs and docs ?
> 
> ---
> SKIPPED: bitstream 401 (item: 123456789/131) because 
> 'thesisJPWoodcock1997-1.pdf.txt' already exists
> SKIPPED: bitstream 415 (item: 123456789/300) because 
> 'SHAHTransnationalHindu2009FINAL.pdf.txt' already exists
> SKIPPED: bitstream 439 (item: 123456789/135

[Dspace-tech] Thumbnail Priview. in 1.6.2

[Kirti Bodhmage]

Hi,
We have Dspace 1.6.2.
I am trying to enable  thumbnail creation.
Ran ./filter-media  in dspace/bin directory

Got following errors while executing script. After the execution I could see
thumbnail image for png item but couldn't see anything for the pdf and other
text items.

I was expecting filter-media will create image file from pdf and Word
documents but its creating .txt file instead.

Saw previous emails on thumbnail creation in this mailing list.  Is  xpdf
filter is better choice for  pdfs and docs ?
 
---
SKIPPED: bitstream 401 (item: 123456789/131) because
'thesisJPWoodcock1997-1.pdf.txt' already exists
SKIPPED: bitstream 415 (item: 123456789/300) because
'SHAHTransnationalHindu2009FINAL.pdf.txt' already exists
SKIPPED: bitstream 439 (item: 123456789/135) because
'CARBONI_D_FINAL.pdf.txt' already exists
ERROR filtering, skipping bitstream:
Item Handle: 123456789/136
Bundle Name: ORIGINAL
File Size: 110763816
Checksum: 044ce0fc33dbaf9299248cd17cf24828 (MD5)
Asset Store: 0
java.io.FileNotFoundException:
/opt/dspace/assetstore-ad1/16/32/42/163242047713616019554023286382622639427
(No such file or directory)
SKIPPED: bitstream 445 (item: 123456789/137) because
'RAMSDEN_PhD_FINAL.pdf.txt' already exists
SKIPPED: bitstream 447 (item: 123456789/138) because 'WU_T_FINAL.pdf.txt'
already exists
SKIPPED: bitstream 578 (item: 123456789/1113) because
'ADETORONumericalAndExperimental2009FINAL.pdf.txt' already exists
ERROR filtering, skipping bitstream:
Item Handle: 123456789/163
Bundle Name: ORIGINAL
Bundle Name: ORIGINAL
Bundle Name: ORIGINAL
File Size: 270417
Checksum: 8360d7bd72fe23ead9de220a78b047e3 (MD5)
Asset Store: 0
java.io.FileNotFoundException:
/opt/dspace/assetstore-ad1/10/21/49/102149325471428675497688294414612838518
(No such file or directory)
ERROR filtering, skipping bitstream:

-

Here are my settings in dpspace.cfg

---
webui.itemlist.columns = thumbnail, dc.date.issued(date), dc.title,
dc.contributor.*
webui.itemlist.widths = *, 130, 60%, 40%
webui.itemlist.dateaccessioned.columns = thumbnail,
dc.date.accessioned(date), dc.title, dc.contributor.*
publications.bundles.allowed = ORIGINAL, DELETED, LICENSE, THUMBNAILS
webui.browse.thumbnail.show = true
webui.browse.thumbnail.maxheight = 80
webui.browse.thumbnail.maxwidth = 80
webui.item.thumbnail.show = true
webui.browse.thumbnail.linkbehaviour = item
# maximum width and height of generated thumbnails
thumbnail.maxwidth  80
thumbnail.maxheight 80

---


Thanks
Kirti


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Re: [Dspace-tech] Dspace code in subversion repository

[Kirti Bodhmage]

Hi,
I meant subversion code control at my University.
I want to keep my live code in my local subversion repository so that I can 
keep track of changes and development  in Dspace code.

Dspace out of box means Dspace without much customisation.
Hope this will clarify my previous email.

Thanks
Kirti


-Original Message-
From: ivan.ma...@gmail.com [mailto:ivan.ma...@gmail.com] On Behalf Of helix84
Sent: 11 June 2012 17:02
To: Kirti Bodhmage
Cc: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Dspace code in subversion repository

On Mon, Jun 11, 2012 at 12:26 PM, Kirti Bodhmage  wrote:
> We got Dspace 1.6 with Repository tools and Symplectic elements 
> running at Queen Mary. We are using Dspace out of box.
> We are planning to do few customization and few bug fixing in Dspace.
> As Dspace is already in live, I can't understand how to set up 
> subversion repository.
>
> With normal development cycle we setup the repository , checkout the 
> code , built it and deploy it. Now we got deployed service, original 
> source code, few customization in config file plus repository 
> tools/crosswalk.
> What is the best way of setting up a repository ?

Hi Kirti,

I'm sorry, but in your question it's difficult to understand what exactly you 
mean by "repository", because there are 2 possible
options: subversion repository for DSpace source code and deployed DSpace as a 
repository of electronic publications.

I'll assume you're using repository always in the sense of "Subversion 
repository". In this case, I have to ask - do you mean the official DSpace 
Subversion repository (which has been recently closed and migrated to GitHub) 
or a private, local repository with custom modifications?

I also noticed you mentioned "Dspace out of box". Do you mean DSpace downloaded 
from dspace.org or DSpace pre-packaged by someone else?

Regards,
~~helix84


--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech

[Dspace-tech] Dspace code in subversion repository

[Kirti Bodhmage]

Hi,

We got Dspace 1.6 with Repository tools and Symplectic elements running 
at Queen Mary. We are using Dspace out of box.
We are planning to do few customization and few bug fixing in Dspace.
As Dspace is already in live, I can't understand how to set up 
subversion repository.

With normal development cycle we setup the repository , checkout the 
code , built it and deploy it. Now we got deployed service, original 
source code, few customization in config file plus repository 
tools/crosswalk.
What is the best way of setting up a repository ?

thanks
Kirti Bodhmage

--
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech