[Dspace-tech] Adding a prompt to complete a survey on bitstream download event in XMLUI

2015-07-07 Thread Nason Bimbe
We have a requirement to capture user data via a survey from users who are
downloading bitstreams. We need to provide a prompt about the survey on
bitstream download event. This is a one off task and is needed for a
particular collection. We are on DSpace 4.2 using XMLUI (Mirage 1). Has
anyone done this before or would know how it could be done?

Regards
Nason
--
Don't Limit Your Business. Reach for the Cloud.
GigeNET's Cloud Solutions provide you with the tools and support that
you need to offload your IT needs and focus on growing your business.
Configured For All Businesses. Start Your Cloud Today.
https://www.gigenetcloud.com/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Forcing users to upload a bitstream for items in all collections except for certain one or two collections

2014-05-15 Thread Nason Bimbe
In our workflow we have made it mandatory (I can't remember how we did
this) for all items to have a full text uploaded and this is enforced
within the workflow. We now have a new use case where we want to relax this
rule for one collection. Does anyone know how can we go about doing this?

Thanks
Nason
--
"Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
Instantly run your Selenium tests across 300+ browser/OS combos.
Get unparalleled scalability from the best Selenium testing platform available
Simple to use. Nothing to install. Get started now for free."
http://p.sf.net/sfu/SauceLabs___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not running and can not be started

2014-08-29 Thread Nason Bimbe
Hello,

I have upgraded the dspace from 3.1 to 4.2 but when I try to access XMLUI
webapp I get a 404. Checking the Tomcat manager shows that xmlui webapp is
not running but the rest are, that is oai and solr. When I try to start the
webapp in Tomcat manager I get a FAIL error (FAIL - Application at contect
path /xmlui could not be started).

The dspace logs to not show any errors but the catalina out shows the
following...

Aug 29, 2014 2:16:01 PM org.apache.catalina.loader.WebappClassLoader
validateJarFile
INFO:
validateJarFile(/usr/local/dspace/webapps/xmlui/WEB-INF/lib/jsp-api-2.1.jar)
- jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class:
javax/el/Expression.class
Aug 29, 2014 2:16:12 PM org.apache.catalina.core.StandardContext
startInternal
SEVERE: Error listenerStart
Aug 29, 2014 2:16:12 PM org.apache.catalina.core.StandardContext
startInternal
SEVERE: Context [/xmlui] startup failed due to previous errors

The platform I am using has: -
OS: Debian Wheezy
Java: 1.7.0_65 (OpenJDK)
Tomcat: 7.0.54
Maven: 3.2.1


Has anyone encountered this problem or does anyone know a solution or where
I am going wrong?

Thanks
Nason
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not running and can not be started

2014-09-01 Thread Nason Bimbe
Hi,
I am still having the same problem. I have made sure dspace is the owner of
all files and I am also using dspace user to build the DSpace. I am running
Debian Wheezy.

This is how Tomcat was installed
=
- downloaded, copied  Tomact 7 files into /usr/local, created a symbolic
link
mv /home/dspace/Downloads/apache-tomcat-7.0.54 /usr/local
unlink tomcat
ln -s apache-tomcat-7.0.54 tomcat
- made sure that tomcat folder is owned by the dspace user
cd /usr/local
chown -R dspace:dspace apache-tomcat-7.0.54
- restarted tomcat
/etc/init.d/tomcat restart
- checked if tomcat is running and is running ok
http://localhost:8080


This the change I  made to the top level POM as advised by Bram by adding
scope tag
===

 javax.servlet
 servlet-api
 2.5
 provided


Regards
Nason


On 1 September 2014 00:38, Pottinger, Hardy J. 
wrote:

>  Peter is right, you can ignore the info line. You probably have a permission 
> issue. How did you install and start Tomcat? What OS are you using?
>
> --Hardy
>
> Sent from my Zact Mobile phone.
>
> Peter Dietz  wrote:
>
>
>  Hmm, I don't know what's wrong in this case. Check your logs further
> back for a line that starts with ERROR, the INFO line might not be too much
> to worry about.
>
>  When you built the DSpace 4 code, I would try mvn -U clean package.
> Also, double check that your tomcat/dspace user is the owner of all the
> files.
>
> 
> Peter Dietz
> Longsight
> www.longsight.com
> pe...@longsight.com
> p: 740-599-5005 x809
>
>
> On Fri, Aug 29, 2014 at 11:56 AM, Nason Bimbe 
> wrote:
>
>> Hello,
>>
>>  I have upgraded the dspace from 3.1 to 4.2 but when I try to access
>> XMLUI webapp I get a 404. Checking the Tomcat manager shows that xmlui
>> webapp is not running but the rest are, that is oai and solr. When I try to
>> start the webapp in Tomcat manager I get a FAIL error (FAIL - Application
>> at contect path /xmlui could not be started).
>>
>>  The dspace logs to not show any errors but the catalina out shows the
>> following...
>>
>>  Aug 29, 2014 2:16:01 PM org.apache.catalina.loader.WebappClassLoader
>> validateJarFile
>> INFO:
>> validateJarFile(/usr/local/dspace/webapps/xmlui/WEB-INF/lib/jsp-api-2.1.jar)
>> - jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class:
>> javax/el/Expression.class
>> Aug 29, 2014 2:16:12 PM org.apache.catalina.core.StandardContext
>> startInternal
>> SEVERE: Error listenerStart
>> Aug 29, 2014 2:16:12 PM org.apache.catalina.core.StandardContext
>> startInternal
>> SEVERE: Context [/xmlui] startup failed due to previous errors
>>
>>  The platform I am using has: -
>> OS: Debian Wheezy
>> Java: 1.7.0_65 (OpenJDK)
>> Tomcat: 7.0.54
>> Maven: 3.2.1
>>
>>
>>  Has anyone encountered this problem or does anyone know a solution or
>> where I am going wrong?
>>
>>  Thanks
>>  Nason
>>
>>
>> --
>> Slashdot TV.
>> Video for Nerds.  Stuff that matters.
>> http://tv.slashdot.org/
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
>
>
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not running and can not be started

2014-09-02 Thread Nason Bimbe
Hi Hardy,
I will be trying it out again tomorrow afresh after restoring the system to
before the attempted upgrade. I am using a script I created in /etc/init.d
for starting/stopping Tomcat. I will also try Shaun Donovan's information
which he sent directly to me and shown below. I will update you how it on
progress. Thanks again for the help.

Best
Nason

 I had this problem, not on xmlui but on oai. I found the following on the
web and tried it, and it worked.

Check Inside the Following Directory for the jar file el-api.jar
:C:\apache-tomcat-7.0.39\lib\el-api.jar  if it exists then in this
directory of your web application  WEB-INF\lib\el-api.jar   the jar
should be removed

What I did is find the file, and moved it, then the app started without
issues. This was on a development machine. I then tried it on the
production machine and my oai would still not start. I had other issues in
my catalina.out which pointed to the web.xml file in tomcats conf directory
which had >> Slashdot TV.
>>> Video for Nerds.  Stuff that matters.
>>> http://tv.slashdot.org/
>>> ___
>>> DSpace-tech mailing list
>>> DSpace-tech@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>> List Etiquette:
>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>
>>
>>
>
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not running and can not be started

2014-09-02 Thread Nason Bimbe
Thanks for this, will try it out.


On 2 September 2014 15:43, Pottinger, Hardy J. 
wrote:

>  Hi, Nason, here is the init script I use for running a binary install of
> Tomcat 7 on RHEL [1] Note that it gets progressively more aggressive when
> shutting down Tomcat. This script is a "mash-up" of a few sample Tomcat
> init scripts I found online, citations are given in the code.
>
>  [1] https://gist.github.com/hardyoyo/9903387
>
>
>   *From:* Nason Bimbe [nasonbi...@gmail.com]
> *Sent:* Tuesday, September 02, 2014 9:25 AM
> *To:* Pottinger, Hardy J.
> *Cc:* Peter Dietz; dspace-tech
> *Subject:* Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not
> running and can not be started
>
>   Hi Hardy,
> I will be trying it out again tomorrow afresh after restoring the system
> to before the attempted upgrade. I am using a script I created in
> /etc/init.d for starting/stopping Tomcat. I will also try Shaun Donovan's
> information which he sent directly to me and shown below. I will update you
> how it on progress. Thanks again for the help.
>
>  Best
> Nason
>
>   I had this problem, not on xmlui but on oai. I found the following on
> the web and tried it, and it worked.
>
> Check Inside the Following Directory for the jar file el-api.jar
> :C:\apache-tomcat-7.0.39\lib\el-api.jar  if it exists then in this
> directory of your web application  WEB-INF\lib\el-api.jar   the jar
> should be removed
>
> What I did is find the file, and moved it, then the app started without
> issues. This was on a development machine. I then tried it on the
> production machine and my oai would still not start. I had other issues in
> my catalina.out which pointed to the web.xml file in tomcats conf directory
> which had >>> Slashdot TV.
>>>> Video for Nerds.  Stuff that matters.
>>>> http://tv.slashdot.org/
>>>> ___
>>>> DSpace-tech mailing list
>>>> DSpace-tech@lists.sourceforge.net
>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>> List Etiquette:
>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>
>>>
>>>
>>
>
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not running and can not be started

2014-09-03 Thread Nason Bimbe
Hi,
I just wanted to let you know that I have now successfully upgraded the
Dspace on my dev. The problem was actually to do with @mire cua module
which was being referenced in spring configs but whose jar files are not
deployed for now.

Thank you so much for your help.

Best
Nason


On 2 September 2014 15:44, Nason Bimbe  wrote:

> Thanks for this, will try it out.
>
>
> On 2 September 2014 15:43, Pottinger, Hardy J. 
> wrote:
>
>>  Hi, Nason, here is the init script I use for running a binary install
>> of Tomcat 7 on RHEL [1] Note that it gets progressively more aggressive
>> when shutting down Tomcat. This script is a "mash-up" of a few sample
>> Tomcat init scripts I found online, citations are given in the code.
>>
>>  [1] https://gist.github.com/hardyoyo/9903387
>>
>>
>>   *From:* Nason Bimbe [nasonbi...@gmail.com]
>> *Sent:* Tuesday, September 02, 2014 9:25 AM
>> *To:* Pottinger, Hardy J.
>> *Cc:* Peter Dietz; dspace-tech
>> *Subject:* Re: [Dspace-tech] Dspace 3.1 to 4.2 upgrade: XMLUI webapp not
>> running and can not be started
>>
>>   Hi Hardy,
>> I will be trying it out again tomorrow afresh after restoring the system
>> to before the attempted upgrade. I am using a script I created in
>> /etc/init.d for starting/stopping Tomcat. I will also try Shaun Donovan's
>> information which he sent directly to me and shown below. I will update you
>> how it on progress. Thanks again for the help.
>>
>>  Best
>> Nason
>>
>>   I had this problem, not on xmlui but on oai. I found the following on
>> the web and tried it, and it worked.
>>
>> Check Inside the Following Directory for the jar file el-api.jar
>> :C:\apache-tomcat-7.0.39\lib\el-api.jar  if it exists then in this
>> directory of your web application  WEB-INF\lib\el-api.jar   the jar
>> should be removed
>>
>> What I did is find the file, and moved it, then the app started without
>> issues. This was on a development machine. I then tried it on the
>> production machine and my oai would still not start. I had other issues in
>> my catalina.out which pointed to the web.xml file in tomcats conf directory
>> which had >>>> Slashdot TV.
>>>>> Video for Nerds.  Stuff that matters.
>>>>> http://tv.slashdot.org/
>>>>> ___
>>>>> DSpace-tech mailing list
>>>>> DSpace-tech@lists.sourceforge.net
>>>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>>>> List Etiquette:
>>>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>>>
>>>>
>>>>
>>>
>>
>
--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] OAI server could not be reached, harvesting on 4.2

2014-10-02 Thread Nason Bimbe
Hi,
I have setup a Dspace 4.2 and created a collection to be populated by
harvesting. What ever target I try to grab content from, I get the above
error. I have tried to get content from http://demo.dspace.org/oai/request
as well as http://scholar.sun.ac.za/oai/request.

Has anyone encountered this problem and how did you get around it?

Thanks
Nason
--
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] OAI server could not be reached, harvesting on 4.2

2014-10-10 Thread Nason Bimbe
Hi,
I wish to report that I was able to harvest the content from dspace demo
installation successfully on a newly installed dspace 4.2 platform.

Thank you for your help.

Regards
Nason

On 2 October 2014 09:33, Adan Roman  wrote:

>  Hi Nason
>
> Try beggining with http://demo.dspace.org/oai/request?verb=Identify
>
> regards
>
>
>  Hi,
> I have setup a Dspace 4.2 and created a collection to be populated by
> harvesting. What ever target I try to grab content from, I get the above
> error. I have tried to get content from http://demo.dspace.org/oai/request
> as well as http://scholar.sun.ac.za/oai/request.
>
>  Has anyone encountered this problem and how did you get around it?
>
>  Thanks
> Nason
>
>
> --
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog 
> Analyzerhttp://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
>
>
>
> ___
> DSpace-tech mailing 
> listDSpace-tech@lists.sourceforge.nethttps://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette: 
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
>
>
> --
>
>
>
> --
>
>
> Este mensaje no contiene virus ni malware porque la protección de avast!
> Antivirus  está activa.
>
>
>
> --
> Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
> Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
> Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
> Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
>
> http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
--
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311&iu=/4140/ostg.clktrk___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] OAI Web app throwing exception in Dspace 4.2

2014-10-17 Thread Nason Bimbe
Hi,
I have just upgraded my production box with DSpace 4.2 from 3.1. All works
well on my dev box but I getting the following exception when I hit the oai
webapp on the browser. Has anyone encountered this problem and how did they
resolve it.

Thanks
Nason

HTTP Status 500 - Servlet.init() for servlet oai threw exception
--

*type* Exception report

*message* *Servlet.init() for servlet oai threw exception*

*description* *The server encountered an internal error that prevented it
from fulfilling this request.*

*exception*

javax.servlet.ServletException: Servlet.init() for servlet oai threw exception

org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)

org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)

org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:193)

org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)

org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)

java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.lang.Thread.run(Thread.java:745)

*root cause*

java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory

org.apache.http.impl.client.AbstractHttpClient.(AbstractHttpClient.java:187)

org.apache.http.impl.client.DefaultHttpClient.(DefaultHttpClient.java:127)

org.apache.http.impl.client.SystemDefaultHttpClient.(SystemDefaultHttpClient.java:113)

org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:104)

org.apache.solr.client.solrj.impl.HttpSolrServer.(HttpSolrServer.java:154)

org.apache.solr.client.solrj.impl.HttpSolrServer.(HttpSolrServer.java:127)

org.dspace.xoai.solr.DSpaceSolrServer.getServer(DSpaceSolrServer.java:34)

org.dspace.xoai.DSpaceOAIDataProvider.init(DSpaceOAIDataProvider.java:62)
javax.servlet.GenericServlet.init(GenericServlet.java:158)

org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:501)

org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)

org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950)

org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:193)

org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:607)

org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314)

java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
java.lang.Thread.run(Thread.java:745)

*note* *The full stack trace of the root cause is available in the Apache
Tomcat/7.0.54 logs.*
--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Batch data change

2015-03-06 Thread Nason Bimbe
Hi Hakim,
You can also use Dspace batch metadata  editing facility, see the
instructions at
https://wiki.duraspace.org/display/DSDOC4x/Batch+Metadata+Editing

Nason

On 6 March 2015 at 08:47, Hilton Gibson  wrote:

> Hi Hakan
>
> Perahsp this will help:
> http://wiki.lib.sun.ac.za/index.php/SUNScholar/SQL_Tips
>
> Cheers
>
> hg
>
> *Hilton Gibson*
> Ubuntu Linux Systems Administrator
> JS Gericke Library
> Room 1025C
> Stellenbosch University
> Private Bag X5036
> Stellenbosch
> 7599
> South Africa
>
> Tel: +27 21 808 4100 | Cell: +27 84 646 4758
>
> On 4 March 2015 at 16:36, Hakan Yanaz  wrote:
>
>> Hi,
>>
>> I want to change document type of all items inserted as "Article" to
>> "article".
>>
>> I do some research about that and the result is :
>>
>> in Postgresql, pgAdmin interface:
>>
>> The "metadata_field_id" of "type" field is "66" in
>> "metadatafieldregistry" table.
>>
>> I can listed all Articles from "metadatavalue" table where
>> metadata_field_id = 66 and text_value = "Article"
>>
>> If I change all text_value fields to "article" which I can listed like
>> above, all things is that?
>>
>> Thanks for any advice.
>>
>> Best Regards
>>
>> Hakan Yanaz
>>
>>
>> --
>> Dive into the World of Parallel Programming The Go Parallel Website,
>> sponsored
>> by Intel and developed in partnership with Slashdot Media, is your hub
>> for all
>> things parallel software development, from weekly thought leadership
>> blogs to
>> news, videos, case studies, tutorials and more. Take a look and join the
>> conversation now. http://goparallel.sourceforge.net/
>> ___
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
>
>
>
> --
> Dive into the World of Parallel Programming The Go Parallel Website,
> sponsored
> by Intel and developed in partnership with Slashdot Media, is your hub for
> all
> things parallel software development, from weekly thought leadership blogs
> to
> news, videos, case studies, tutorials and more. Take a look and join the
> conversation now. http://goparallel.sourceforge.net/
> ___
> DSpace-tech mailing list
> DSpace-tech@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/dspace-tech
> List Etiquette:
> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Help with Solr on DSpace 3.1

2013-05-08 Thread Nason Bimbe
We have upgraded from 1.8.2 to 3.1 and since then new items added can not
be found via search neither are they visible in the latest submission lists
but the items can be accessed directly if one knows the uri.

When I ran update-discovery-index -f I get the following

ris:/usr/local/dspace# bin/dspace update-discovery-index -f
 INFO [main] (DSpaceKernelInit.java:52) - Created new kernel:
DSpaceKernel:org.dspace:name=dc341a12-aca7-4e50-a578-4d20d2a909e7,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
 INFO [main] (ConfigurationManager.java:1224) - Loading from classloader:
file:/usr/local/dspace/config/dspace.cfg
 INFO [main] (ConfigurationManager.java:1224) - Using dspace provided log
configuration (log.init.config)
 INFO [main] (ConfigurationManager.java:1224) - Loading:
/usr/local/dspace/config/log4j.properties
Exception: Internal Server Error

Internal Server Error

request: http://localhost:8080/solr/search/update?wt=javabin&version=2
org.dspace.discovery.SearchServiceException: Internal Server Error

Internal Server Error

request: http://localhost:8080/solr/search/update?wt=javabin&version=2
at
org.dspace.discovery.SolrServiceImpl.cleanIndex(SolrServiceImpl.java:418)
at org.dspace.discovery.IndexClient.main(IndexClient.java:119)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
Caused by: org.apache.solr.common.SolrException: Internal Server Error

Internal Server Error

request: http://localhost:8080/solr/search/update?wt=javabin&version=2
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435)
at
org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
at
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
at
org.apache.solr.client.solrj.SolrServer.deleteByQuery(SolrServer.java:110)
at
org.dspace.discovery.SolrServiceImpl.cleanIndex(SolrServiceImpl.java:384)


and in the catalina.out I get this

07-May-2013 14:51:24 org.apache.solr.core.SolrCore execute
INFO: [search] webapp=/solr path=/update params={wt=javabin&version=2}
status=500 QTime=11291
07-May-2013 14:51:24 org.apache.solr.common.SolrException log
SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain
timed out: NativeFSLock@./solr/data/index/write.lock
at org.apache.lucene.store.Lock.obtain(Lock.java:84)
at
org.apache.lucene.index.IndexWriter.(IndexWriter.java:1108)
at
org.apache.solr.update.SolrIndexWriter.(SolrIndexWriter.java:83)
at
org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:101)
at
org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:171)
at
org.apache.solr.update.DirectUpdateHandler2.deleteByQuery(DirectUpdateHandler2.java:324)
at
org.apache.solr.update.processor.RunUpdateProcessor.processDelete(RunUpdateProcessorFactory.java:71)
at
org.apache.solr.update.processor.LogUpdateProcessor.processDelete(LogUpdateProcessorFactory.java:137)
at
org.apache.solr.handler.XMLLoader.processDelete(XMLLoader.java:256)
at
org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:202)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.dspace.solr.filters.LocalHostRestrictionFilter.doFilter(LocalHostRestrictionFilter.java:60)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValv

Re: [Dspace-tech] Help with Solr on DSpace 3.1

2013-05-08 Thread Nason Bimbe
Thanks Hilton,
I have done what you suggested and I am still getting the same error.

Thanks
Nason


On 8 May 2013 11:10, Hilton Gibson  wrote:

> Hi Nason
>
> "SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain
> timed out: NativeFSLock@./solr/data/index/write.lock "
>
> I would suspect file permissions as the fault.
> To put the app in "/usr/local/dspace" is unusual.
> Try the following at your own risk:
>
> chmod 0777 -R /usr/local/dspace/solr
>
> My preference for app location is "/home/dspace" which is on
> a separate volume/partition.
> See:
> http://wiki.lib.sun.ac.za/index.php/SUNScholar/Install_Ubuntu/S03/Disk_Partitioning
>
> Regards
>
> hg
>
>
> On 8 May 2013 12:00, Nason Bimbe  wrote:
>
>> We have upgraded from 1.8.2 to 3.1 and since then new items added can not
>> be found via search neither are they visible in the latest submission lists
>> but the items can be accessed directly if one knows the uri.
>>
>> When I ran update-discovery-index -f I get the following
>>
>> ris:/usr/local/dspace# bin/dspace update-discovery-index -f
>>  INFO [main] (DSpaceKernelInit.java:52) - Created new kernel:
>> DSpaceKernel:org.dspace:name=dc341a12-aca7-4e50-a578-4d20d2a909e7,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
>>  INFO [main] (ConfigurationManager.java:1224) - Loading from classloader:
>> file:/usr/local/dspace/config/dspace.cfg
>>  INFO [main] (ConfigurationManager.java:1224) - Using dspace provided log
>> configuration (log.init.config)
>>  INFO [main] (ConfigurationManager.java:1224) - Loading:
>> /usr/local/dspace/config/log4j.properties
>> Exception: Internal Server Error
>>
>> Internal Server Error
>>
>> request: http://localhost:8080/solr/search/update?wt=javabin&version=2
>> org.dspace.discovery.SearchServiceException: Internal Server Error
>>
>> Internal Server Error
>>
>> request: http://localhost:8080/solr/search/update?wt=javabin&version=2
>> at
>> org.dspace.discovery.SolrServiceImpl.cleanIndex(SolrServiceImpl.java:418)
>> at org.dspace.discovery.IndexClient.main(IndexClient.java:119)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
>> Caused by: org.apache.solr.common.SolrException: Internal Server Error
>>
>> Internal Server Error
>>
>> request: http://localhost:8080/solr/search/update?wt=javabin&version=2
>> at
>> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435)
>> at
>> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244)
>> at
>> org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
>> at
>> org.apache.solr.client.solrj.SolrServer.deleteByQuery(SolrServer.java:110)
>> at
>> org.dspace.discovery.SolrServiceImpl.cleanIndex(SolrServiceImpl.java:384)
>>
>>
>> and in the catalina.out I get this
>>
>> 07-May-2013 14:51:24 org.apache.solr.core.SolrCore execute
>> INFO: [search] webapp=/solr path=/update params={wt=javabin&version=2}
>> status=500 QTime=11291
>> 07-May-2013 14:51:24 org.apache.solr.common.SolrException log
>> SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain
>> timed out: NativeFSLock@./solr/data/index/write.lock
>> at org.apache.lucene.store.Lock.obtain(Lock.java:84)
>> at
>> org.apache.lucene.index.IndexWriter.(IndexWriter.java:1108)
>> at
>> org.apache.solr.update.SolrIndexWriter.(SolrIndexWriter.java:83)
>> at
>> org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:101)
>> at
>> org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:171)
>> at
>> org.apache.solr.update.DirectUpdateHandler2.deleteByQuery(DirectUpdateHandler2.java:324)
>> at
>> org.apache.solr.update.processor.RunUpdateProcessor.processDelete(RunUpdateProcessorFactory.java:71)
>> at
>> org.apache.solr.update.processor.LogUpdateProcessor.processDelete(LogUpdateProc

Re: [Dspace-tech] Help with Solr on DSpace 3.1

2013-05-08 Thread Nason Bimbe
Hi Bram,
I have now found that the solr folder is actually in /home/dspace/solr/
rather than /usr/local/dspace/solr/. Why the difference because I intended
the solr folder to be in /usr/local/dspace/solr?


Thanks
Nason


On 8 May 2013 12:11, Bram Luyten  wrote:

> Hi Nason,
>
> do you see any of these write.lock files on your system? You should be
> able to safely delete them.
> Does that help in any way?
>
> SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain
> timed out: NativeFSLock@./solr/data/index/write.lock
>
> best regards,
>
> Bram
>
> --
> [image: logo]
> *Bram Luyten* *@mire*
>
> *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010*
> *Esperantolaan 4, Heverlee 3001, Belgium*
> www.atmire.com<http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=braml>
>
>
> On Wed, May 8, 2013 at 12:28 PM, Hilton Gibson wrote:
>
>> Hi Nason
>>
>> Then I am out of ideas without access to your server.
>> Perhaps others on the list can help.
>>
>> Regards
>>
>> hg
>>
>>
>> On 8 May 2013 12:22, Nason Bimbe  wrote:
>>
>>> Thanks Hilton,
>>> I have done what you suggested and I am still getting the same error.
>>>
>>>  Thanks
>>> Nason
>>>
>>>
>>> On 8 May 2013 11:10, Hilton Gibson  wrote:
>>>
>>>> Hi Nason
>>>>
>>>> "SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock
>>>> obtain timed out: NativeFSLock@./solr/data/index/write.lock "
>>>>
>>>> I would suspect file permissions as the fault.
>>>> To put the app in "/usr/local/dspace" is unusual.
>>>> Try the following at your own risk:
>>>>
>>>> chmod 0777 -R /usr/local/dspace/solr
>>>>
>>>> My preference for app location is "/home/dspace" which is on
>>>> a separate volume/partition.
>>>> See:
>>>> http://wiki.lib.sun.ac.za/index.php/SUNScholar/Install_Ubuntu/S03/Disk_Partitioning
>>>>
>>>> Regards
>>>>
>>>> hg
>>>>
>>>>
>>>> On 8 May 2013 12:00, Nason Bimbe  wrote:
>>>>
>>>>> We have upgraded from 1.8.2 to 3.1 and since then new items added can
>>>>> not be found via search neither are they visible in the latest submission
>>>>> lists but the items can be accessed directly if one knows the uri.
>>>>>
>>>>> When I ran update-discovery-index -f I get the following
>>>>>
>>>>> ris:/usr/local/dspace# bin/dspace update-discovery-index -f
>>>>>  INFO [main] (DSpaceKernelInit.java:52) - Created new kernel:
>>>>> DSpaceKernel:org.dspace:name=dc341a12-aca7-4e50-a578-4d20d2a909e7,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
>>>>>  INFO [main] (ConfigurationManager.java:1224) - Loading from
>>>>> classloader: file:/usr/local/dspace/config/dspace.cfg
>>>>>  INFO [main] (ConfigurationManager.java:1224) - Using dspace provided
>>>>> log configuration (log.init.config)
>>>>>  INFO [main] (ConfigurationManager.java:1224) - Loading:
>>>>> /usr/local/dspace/config/log4j.properties
>>>>> Exception: Internal Server Error
>>>>>
>>>>> Internal Server Error
>>>>>
>>>>> request: http://localhost:8080/solr/search/update?wt=javabin&version=2
>>>>> org.dspace.discovery.SearchServiceException: Internal Server Error
>>>>>
>>>>> Internal Server Error
>>>>>
>>>>> request: http://localhost:8080/solr/search/update?wt=javabin&version=2
>>>>> at
>>>>> org.dspace.discovery.SolrServiceImpl.cleanIndex(SolrServiceImpl.java:418)
>>>>> at org.dspace.discovery.IndexClient.main(IndexClient.java:119)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>>> at
>>>>> org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)
>>>>> Caused by: org.apache.solr.common.SolrException: Internal Server

Re: [Dspace-tech] Help with Solr on DSpace 3.1

2013-05-08 Thread Nason Bimbe
Hi Guys,
I think I have solved the problem. This line in solrconfig.xml was
uncommented.



Thank you so much for the help. Your question on finding the lock file
helped me trace where the solr stuff was being placed.

Best
Nason


On 8 May 2013 14:51, Bram Luyten  wrote:

> Hi Nason,
>
> just to ensure that I understand you correctly: are you talking about the
> installation directory, the source directory or the web deployment
> directory?
>
> cfr
> https://wiki.duraspace.org/display/DSDOC3x/Installation#Installation-OverviewofDSpaceDirectories
>
> Bram
>
>
> --
> [image: logo]
> *Bram Luyten* *@mire*
> *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010*
> *Esperantolaan 4, Heverlee 3001, Belgium*
> www.atmire.com<http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=braml>
>
>
> On Wed, May 8, 2013 at 3:18 PM, Nason Bimbe  wrote:
>
>> Hi Bram,
>> I have now found that the solr folder is actually in /home/dspace/solr/
>> rather than /usr/local/dspace/solr/. Why the difference because I intended
>> the solr folder to be in /usr/local/dspace/solr?
>>
>>
>> Thanks
>> Nason
>>
>>
>> On 8 May 2013 12:11, Bram Luyten  wrote:
>>
>>> Hi Nason,
>>>
>>> do you see any of these write.lock files on your system? You should be
>>> able to safely delete them.
>>> Does that help in any way?
>>>
>>> SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain
>>> timed out: NativeFSLock@./solr/data/index/write.lock
>>>
>>> best regards,
>>>
>>> Bram
>>>
>>> --
>>> [image: logo]
>>> *Bram Luyten* *@mire*
>>>
>>> *2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010*
>>> *Esperantolaan 4, Heverlee 3001, Belgium*
>>> www.atmire.com<http://atmire.com/website/?q=services&utm_source=emailfooter&utm_medium=email&utm_campaign=braml>
>>>
>>>
>>> On Wed, May 8, 2013 at 12:28 PM, Hilton Gibson 
>>> wrote:
>>>
>>>> Hi Nason
>>>>
>>>> Then I am out of ideas without access to your server.
>>>> Perhaps others on the list can help.
>>>>
>>>> Regards
>>>>
>>>> hg
>>>>
>>>>
>>>> On 8 May 2013 12:22, Nason Bimbe  wrote:
>>>>
>>>>> Thanks Hilton,
>>>>> I have done what you suggested and I am still getting the same error.
>>>>>
>>>>>  Thanks
>>>>> Nason
>>>>>
>>>>>
>>>>> On 8 May 2013 11:10, Hilton Gibson  wrote:
>>>>>
>>>>>> Hi Nason
>>>>>>
>>>>>> "SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock
>>>>>> obtain timed out: NativeFSLock@./solr/data/index/write.lock "
>>>>>>
>>>>>> I would suspect file permissions as the fault.
>>>>>> To put the app in "/usr/local/dspace" is unusual.
>>>>>> Try the following at your own risk:
>>>>>>
>>>>>> chmod 0777 -R /usr/local/dspace/solr
>>>>>>
>>>>>> My preference for app location is "/home/dspace" which is on
>>>>>> a separate volume/partition.
>>>>>> See:
>>>>>> http://wiki.lib.sun.ac.za/index.php/SUNScholar/Install_Ubuntu/S03/Disk_Partitioning
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> hg
>>>>>>
>>>>>>
>>>>>> On 8 May 2013 12:00, Nason Bimbe  wrote:
>>>>>>
>>>>>>> We have upgraded from 1.8.2 to 3.1 and since then new items added
>>>>>>> can not be found via search neither are they visible in the latest
>>>>>>> submission lists but the items can be accessed directly if one knows the
>>>>>>> uri.
>>>>>>>
>>>>>>> When I ran update-discovery-index -f I get the following
>>>>>>>
>>>>>>> ris:/usr/local/dspace# bin/dspace update-discovery-index -f
>>>>>>>  INFO [main] (DSpaceKernelInit.java:52) - Created new kernel:
>>>>>>> DSpaceKernel:org.dspace:name=dc341a12-aca7-4e50-a578-4d20d2a909e7,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
>>>>>>>  INFO [main] (ConfigurationManager.java:1224

[Dspace-tech] DSpace statistics

2013-05-31 Thread Nason Bimbe
I am running Dspace 3.1 and I am interested in getting the number of
downloads from SOLR.

I run this
http://localhost:8080/solr/statistics/select?indent=on&version=2.2&start=0&rows=100&fl=*%2Cscore&qt=standard&wt=standard&explainOther=&hl.fl=&facet=true&facet.field=owningComm&q=type:0

and when I look at the results in the facets section, the numbers seems too
high for a month's data. Looking into some of the docs returned I can see
that some are bots yet my config says bots should be omitted.

Can some please help me explain this? I have looked at
http://iplists.com/google.txt and this ip address is not on the list. What
is going on here?

[config snippet]
# control solr statistics querying to filter out spider IPs
# false by default
#query.filter.spiderIp = false

# control solr statistics querying to look at "isBot" field to determine
# if record is a bot. true by default.
#query.filter.isBot = true


[result snippet]

3.504466
ORIGINAL
Mountain View
NA
US
crawl-66-249-75-222.googlebot.com.
1673
66.249.75.222
false
37.419205
-122.0574
12
922
829
view
2013-05-08T17:20:01.295Z
0
7f7a6135-6c0a-4e2d-b8a3-2c022c2ab20e
Mozilla/5.0 (iPhone; U; CPU iPhone OS 4_1 like
Mac OS X; en-us) AppleWebKit/532.9 (KHTML, like Gecko) Version/4.0.5
Mobile/8B117 Safari/6531.22.7 (compatible; Googlebot-Mobile/2.1; +
http://www.google.com/bot.html)
  

  
3.504466
ORIGINAL
Moscow
EU
RU
spider-178-154-243-100.yandex.com.
1056
178.154.243.100
false
55.752197
37.6156
10
1
175
view
2013-05-08T16:52:12.106Z
0
1943f4fe-3ce8-4793-8c3e-3c5e34fa7975
Mozilla/5.0 (compatible; YandexBot/3.0; +
http://yandex.com/bots)
  


Thanks
Nason
--
Get 100% visibility into Java/.NET code with AppDynamics Lite
It's a free troubleshooting tool designed for production
Get down to code-level detail for bottlenecks, with <2% overhead.
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap2___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace statistics

2013-06-03 Thread Nason Bimbe
Hello, People,
Has anyone got an answer to this problem. I am kind of stuck here.

Regards
Nason




--
View this message in context: 
http://dspace.2283337.n4.nabble.com/DSpace-statistics-tp4664534p4664559.html
Sent from the DSpace - Tech mailing list archive at Nabble.com.

--
Get 100% visibility into Java/.NET code with AppDynamics Lite
It's a free troubleshooting tool designed for production
Get down to code-level detail for bottlenecks, with <2% overhead.
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap2
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette


Re: [Dspace-tech] DSpace statistics

2013-06-04 Thread Nason Bimbe
Hi Andrea,
Thank you very much for your reply. Yes the stats data was for one month
only (May) that's why I did not add the date filter.

I have run
[dspace]/bin/dspace stats-util -u
[dspace]/bin/dspace stats-util -i

Then the SOLR query and nothing has changed.

If I may ask do you now the query used by the 'View Usage Statistics' link
in XMLUI because the stats displayed look more reasonable, in other words
can I replicate the query by querying SOLR directly? Would you also be in a
position to explain the possible values for type in the query for me
please? For example I have seen posts describing number of downloads as
being of type = 0 in SOLR.

Thanking you in advance.

Nason

   -




On 4 June 2013 01:19, Andrea Schweer  wrote:

>  Hi Nason,
>
>
> On 01/06/13 02:01, Nason Bimbe wrote:
>
> I am running Dspace 3.1 and I am interested in getting the number of
> downloads from SOLR.
>
>  I run this
> http://localhost:8080/solr/statistics/select?indent=on&version=2.2&start=0&rows=100&fl=*%2Cscore&qt=standard&wt=standard&explainOther=&hl.fl=&facet=true&facet.field=owningComm&q=type:0
>
>  and when I look at the results in the facets section, the numbers seems
> too high for a month's data. Looking into some of the docs returned I can
> see that some are bots yet my config says bots should be omitted.
>
>
> The dspace config setting doesn't apply to manual queries like the one
> you're running. You will need to manually append &fq=-isBot:true to your
> query to exclude downloads by known bots.
>
> http://localhost:8080/solr/statistics/select?indent=on&version=2.2&start=0&rows=100&fl=*%2Cscore&qt=standard&wt=standard&explainOther=&hl.fl=&facet=true&facet.field=owningComm&q=type:0&fq=-isBot:true<http://localhost:8080/solr/statistics/select?indent=on&version=2.2&start=0&rows=100&fl=*%2Cscore&qt=standard&wt=standard&explainOther=&hl.fl=&facet=true&facet.field=owningComm&q=type:0>
>
> You may wish to run
> [dspace]/bin/dspace stats-util -u
> [dspace]/bin/dspace stats-util -i
> beforehand if you aren't running these regularly -- the first one ensures
> your bot IP lists are at the most recent version and the second one goes
> through all stats and marks hits from these IPs with "isBot:true".
>
> Finally, you say you want a month's data yet your query shows no
> restriction by date. So unless your stats data only covers 1 month, your
> results will be for a much longer time period.
>
> cheers,
> Andrea
>
> --
> Dr Andrea Schweer
> IRR Technical Specialist, ITS Information Systems
> The University of Waikato, Hamilton, New Zealand
>
>
--
How ServiceNow helps IT people transform IT departments:
1. A cloud service to automate IT design, transition and operations
2. Dashboards that offer high-level views of enterprise services
3. A single system of record for all IT processes
http://p.sf.net/sfu/servicenow-d2d-j___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace statistics

2013-06-05 Thread Nason Bimbe
Hi Andrea,
Thank you very much, it is what I needed and the information has been
helpful.

Regards
Nason


On 4 June 2013 23:59, Andrea Schweer  wrote:

>  Hi Nason,
>
>
> On 05/06/13 02:18, Nason Bimbe wrote:
>
> Thank you very much for your reply. Yes the stats data was for one month
> only (May) that's why I did not add the date filter.
>
>  I have run
> [dspace]/bin/dspace stats-util -u
> [dspace]/bin/dspace stats-util -i
>
>  Then the SOLR query and nothing has changed.
>
>
> Did you add &fq=-isBot:true to your query? You need to add this, otherwise
> "bot" hits will still be included in your query results even after the two
> commands above.
>
>
>  If I may ask do you now the query used by the 'View Usage Statistics'
> link in XMLUI because the stats displayed look more reasonable, in other
> words can I replicate the query by querying SOLR directly?
>
>
> I've customised the stats for "my" repository so much that I have no idea
> what's normally on that page. From the demo server, it looks like this
> lists the 10 items with the most downloads. To get those, you'd use:
>
> http://localhost:8080/solr/statistics/select?indent=true&rows=0&q=type:0&facet=true&facet.limit=10&facet.field=owningItem&fq=-isBot:true
>
> The English version of this query is something like
>
>- Show me the 10 most frequent (facet=true&facet.limit=10)
>- items (facet.field=owningItem)
>- where "frequent" means going by bitstream downloads (q=type:0)
> - but I don't want to see any individual events in additio(rows=0)
>- and exclude all hits by bots (fq=-isBot:true) -- this counts only
>events that don't have an isBot value at all or where the isBot value is
>false
>
> The "indent=true" just makes the output easier to read.
>
>
>   Would you also be in a position to explain the possible values for type
> in the query for me please? For example I have seen posts describing number
> of downloads as being of type = 0 in SOLR.
>
>
> The type refers to the constants in Constants.java (
> https://github.com/DSpace/DSpace/blob/master/dspace-api/src/main/java/org/dspace/core/Constants.java).
> Probably the most important ones are 0 (bitstream downloads) and 2 (item
> page views). The id is always the internal id of the object concerned; for
> bitstreams, owningItem will hold the id of the bitstream's item. All other
> fields for view/download events look pretty self-explanatory to me; please
> ask if you have specific questions.
>
> There is documentation about all fields here:
> https://wiki.duraspace.org/display/DSDOC3x/DSpace+Statistics
> In particular, this section explains what fields are available for
> querying / faceting:
> https://wiki.duraspace.org/display/DSDOC3x/DSpace+Statistics#DSpaceStatistics-Whatisexactlybeinglogged?
>
>
> And this section explains a bit about custom queries:
> https://wiki.duraspace.org/display/DSDOC3x/DSpace+Statistics#DSpaceStatistics-CustomReporting-QueryingSOLRDirectlythough
>  much of figuring this out is just getting your head around Solr.
> Again, ask if you have specific questions.
>
>
> cheers,
> Andrea
>
> --
> Dr Andrea Schweer
> IRR Technical Specialist, ITS Information Systems
> The University of Waikato, Hamilton, New Zealand
>
>
--
How ServiceNow helps IT people transform IT departments:
1. A cloud service to automate IT design, transition and operations
2. Dashboards that offer high-level views of enterprise services
3. A single system of record for all IT processes
http://p.sf.net/sfu/servicenow-d2d-j___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette