[Dspace-tech] DSpace 5.x Legacy Statistics - Item Type Breakdowns

[Sean Carte]

Since upgrading (from 3.2) to DSpace 5, I no longer get item type
breakdowns in my legacy stats.

I have the following in dstat.cfg:

item.type=Thesis or Dissertation
item.type=Preprint
item.type=Research Paper

and I run the following via crontab every night:

/dspace/bin/dspace stat-general
/dspace/bin/dspace stat-monthly
/dspace/bin/dspace stat-report-general
/dspace/bin/dspace stat-report-monthly

But my Statistics shows:

Archive Information
Content TypeNumber of items
All Items1,096
Preprint0
Thesis or Dissertation0
Research Paper0

Is there something I've misconfigured somewhere?

Sean
--
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Solr and IP authentication

[Stefanie Behnke]

Dear Bram,

 

thanks for your interest and help.

 

Best regards

Stefanie

 

Von: bluy...@gmail.com [mailto:bluy...@gmail.com] Im Auftrag von Bram Luyten
Gesendet: Montag, 2. März 2015 16:34
An: Stefanie Behnke
Cc: DSpace Tech
Betreff: Re: [Dspace-tech] Solr and IP authentication

 

Hi Stefanie,

 

I don't think the SOLR logger lookup error you are seeing is related to your IP 
authentication problem.

This lookup tries to identify the country/region of your IP, in order to 
include geo information into the usage events.

 

It makes sense that this fails if the IP you are hiding is an internal IP, for 
these kinds of IPs, it's impossible to lookup the location in the Geomind 
database that is used for this purpose.

 

There must be a different problem why your IP authentication isn't working.

 

with kindest regards,

 

Bram Luyten




-- 


 logo   

Bram Luyten 
2888 Loker Avenue East, Suite 315, Carlsbad, CA. 92010
Esperantolaan 4, Heverlee 3001, Belgium
www.atmire.com 

  

 

On 25 February 2015 at 09:49, Stefanie Behnke 
 wrote:

Dear all,

 

I am using Dspace 3.1 with XMLUI.

 

I have inserted the patch, described at

https://github.com/DSpace/DSpace/pull/632/files

 

but got the ERROR message in dspace.log:

ERROR org.dspace.statistics.SolrLogger @ Failed DNS Lookup for IP: hidden

And although the IP address (here: hidden) is listed in the 
authentication-ip.cfg file,

there is no further check, with the result that the IP address is not 
authenticated.

 

Any help is appreciated.

Best regards

Stefanie

 

 

Von: Stefanie Behnke [mailto:dsp...@eurographics-office-goslar.de] 
Gesendet: Montag, 9. Februar 2015 17:39
An: 'Riese Wolfgang'; dspace-tech@lists.sourceforge.net
Betreff: Re: [Dspace-tech] IP Authentification Problems

 

Dear Wolfgang,

 

I did already uses this patch, you mentioned

dspace-api/src/main/java/org/dspace/authenticate/IPMatcher.java 

 

rebuilt Maven, ant and started Tomcat.

 

This does not work for me.

 

Best regards

Stefanie

 

 

 

 

 

Von: Riese Wolfgang [mailto:w.ri...@zbw.eu] 
Gesendet: Montag, 9. Februar 2015 17:24
An: 'Stefanie Behnke';   
dspace-tech@lists.sourceforge.net
Betreff: AW: [Dspace-tech] IP Authentification Problems

 

Hi,

 

for me on Dspace 3.2 XMLUI, Patch DS-1235 does the trick.

https://jira.duraspace.org/browse/DS-1235

 

 

Hope it helps,

Wolfgang

 

 

--

WOLFGANG RIESE

IIPT

 

HH, Raum 414

T:  +49-40-42834-240  

http://www.zbw.eu

 

ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften 
Leibniz-Informationszentrum Wirtschaft

- Standort Hamburg -

Neuer Jungfernstieg 21

 

20354 Hamburg

 

Von: Stefanie Behnke [mailto:dsp...@eurographics-office-goslar.de] 
Gesendet: Montag, 9. Februar 2015 15:54
An:   
dspace-tech@lists.sourceforge.net
Betreff: [Dspace-tech] IP Authentification Problems

 

Dear all,

 

we are using Dspace 3.1 with the XMLUI (Mirage).

 

I have set the IP configuration:

In authentification.cfg:

plugin.sequence.org.dspace.authenticate.AuthenticationMethod = \

org.dspace.authenticate.IPAuthentication, \

org.dspace.authenticate.LDAPAuthentication, \

org.dspace.authenticate.PasswordAuthentication

 

I have visit   
https://github.com/DSpace/DSpace/pull/632/files and added the patch to my 
system.

Also I added the patch from https://github.com/DSpace/DSpace/pull/255/files

 

In our repository all items are visible to all users, but the bitsteams are 
only accessible with read right group 

“eg-member”.

 

So I have configured 

authentication-ip.cfg (see attachment)

 

Full IPs, partial IPs are working,

but using network/netmask or network/CIDR then only one entry works.

 

For example:

….

129.27, \

139.174, \

…. Is working

But

….

129.27.0.0/16, \

139.174.0.0/16, \

….

does not work.

 

As you can see I have a lot of IP ranges where I have to use network/netmask or 
network/CIDR,

I tried both, with same result: If the CIDR is not 32 or the netmask not 
255.255.255.255,

it only works for one IP range.

 

I hope you can help me, thanking you in advance

Stefanie

 

 


--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Eti

Re: [Dspace-tech] Changing the community/collection name

[Anja Radoicic]

Hi Andrea,

Thank you for your time, this is exactly the explanation that I needed. 
I made my own templates and now everything is working nicely.


Also thank you for the links, I have read the first one before, but the 
second one is new to me. Maybe it has some information that I missed 
earlier, I will sure read it.


Thanks once and again, cheers,
Anja

On 3/3/2015 2:08 AM, Andrea Schweer wrote:

Hi Anja,

there are a few resources out there for XMLUI; an older (but still 
good) one is 
http://www.slideshare.net/tdonohue/making-dspace-xmlui-your-own
I see TDL have just released their training material for XMLUI 
themeing under a CC license, I haven't looked at it yet myself though: 
http://www.slideshare.net/DuraSpace/dspace-42-xmlui-theming


For your specific question, look at the XML representation of the 
collection page, http://demo.dspace.org/xmlui/handle/10673/22?XML
You'll see that the corresponding element is now |1st 
sem| (the data on the test server re-sets every Saturday, so 
it's no longer the same as in your question). This is rendered in the 
HTML as|<||h2class||="||ds-div-head page-header 
first-page-header||">||1st sem|||


So you will need to find templates that match dri:head elements and 
create first-page-header h2 elements. You don't say which theme you 
are looking at; essentially what I would do next is do a recursive 
grep through the theme directory to find such templates. (Keep in mind 
that eg the Mirage theme extends the dri2xhtml-alt theme as seen by 
the imports in Mirage.xsl, so if you're looking at Mirage, you need to 
run the grep in both of these theme directories.) In the case of 
Mirage2, rgrep -l first-page-header 
dspace-xmlui-mirage2/src/main/webapp/xsl/ shows


dspace-xmlui-mirage2/src/main/webapp/xsl/core/elements.xsl
dspace-xmlui-mirage2/src/main/webapp/xsl/aspect/artifactbrowser/item-view.xsl

We aren't interested in items, so let's look at the first file. You'll 
see

|||
||||
||ds-div-head||
||||
|||

and

|||
||||
||select="count(ancestor::dri:*[dri:head])"/>||
||select="(//dri:head)[1] = ."/>||

||||
||||
||||
||||
||||

|| page-header||
||||
||||
|| first-page-header||
||||
||||
||||
||||
||||
||||
|
Now you could change these templates, However, these render _all_ head 
elements, regardless of which page you're looking at. To change just 
the ones on collection pages, I would make a custom template (in the 
main xsl file of your theme) that matches on eg 
|dri:div[@n='collection-home']/dri:head| and does whatever processing 
is needed, with or without calling the renderHead template. (For 
example, if you want to change the HTML structure, there is probably 
no point in calling the renderHead template. But if you just want to 
pre-pend the string "Collection: " to the collection name, just call 
renderHead with "Collection: " plus the actual name.) Likewise for 
community home pages; as you can see from 
http://demo.dspace.org/xmlui/handle/10673/21?XML, your custom template 
would then need to match |dri:div[@n='community-home']/dri:head|


This is a little bit stream-of-consciousness, but I hope it makes 
sense to you and helps you understand how it all hangs together / 
where to find things in the XSL.


cheers,
Andrea

On 03/03/15 03:10, Anja Radoicic wrote:

Hi,

Can someone at least point us to the document where this is explained?

Thanks ahead,
A.

On 2/27/2015 2:43 PM, Anja Radoicic wrote:

Hi,

I have a question regarding one community/collection view. Can 
anyone tell me the name of the XSL file where I can change the way 
the title is neing written? I went through most of the files and I 
dont see the part where the title can be changed.


For example in demo, it would be "The scramble for and Partition of 
Africa" in this page: http://demo.dspace.org/xmlui/handle/10673/22.


Thanks ahead,
Anja



--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the
conversation now.http://goparallel.sourceforge.net/


___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette:https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette




--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and

Re: [Dspace-tech] Solr and IP authentication

[helix84]

Hi Stefanie,

try copying IPAuthentication.java, IPMatcher.java and
IPMatcherException.java [1] from DSpace 5 to your source, then rebuild
and redeploy. It should be the same thing you already have with
patches, but try this just to make sure. If it still doesn't work,
please provide an example netmask (from your configuration) and IP
(you tried to login with). There are now unit tests for CIDR, so they
are expected to catch any mistakes (you may copy them, too [2]).


On Mon, Mar 2, 2015 at 4:33 PM, Bram Luyten  wrote:
> I don't think the SOLR logger lookup error you are seeing is related to your 
> IP authentication problem.
> This lookup tries to identify the country/region of your IP, in order to 
> include geo information into the usage events.

This message is about reverse DNS lookup, not a GeoIP lookup. But the
message is harmless, nevertheless.


> It makes sense that this fails if the IP you are hiding is an internal IP, 
> for these kinds of IPs, it's impossible to lookup the location in the Geomind 
> database that is used for this purpose.

SolrLogger actually should already respect X-Forwarded-For if
useProxies is enabled:


[1] 
https://github.com/DSpace/DSpace/tree/dspace-5.0/dspace-api/src/main/java/org/dspace/authenticate
[2] 
https://github.com/DSpace/DSpace/blob/dspace-5.0/dspace-api/src/test/java/org/dspace/authenticate/IPMatcherTest.java#L187-241
[3] 
https://github.com/DSpace/DSpace/blob/dspace-5_x/dspace-api/src/main/java/org/dspace/statistics/SolrLogger.java#L300-311


Regards,
~~helix84

Compulsory reading: DSpace Mailing List Etiquette
https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] Log file attached: Dspace migration from 1.7 to 5 in new setup(due to harddisk crash)

[Andrea Schweer]

  
  
Hi,

did you do the two steps that Tim mentioned in his response to you a
few days ago? I don't think I can help you with the actual problem.
However, you would make it easier for others to help you if you
could send a clear list of the steps you've run and then what
results / error messages you are seeing. 

cheers,
Andrea

On 03/03/15 00:58, इन्‍दु भूषण Indu
  Bhushan wrote:


  


  Apache Maven 3.0.5 , Java
version: 1.8.0_31, Apache
  Ant(TM) version 1.8.2
, postgres (PostgreSQL) 9.0.3, Linux RHEL 5 
   
  Dear Team,
   
  Now i have tried with old backup and error are less.
Please advice to solve database error menationed below.
  LOG: unexpected EOF on client connection
ERROR: constraint "metadatavalue_item_id_fkey" of
relation "metadatavalue" does not exist
STATEMENT: ALTER TABLE metadatavalue DROP CONSTRAINT
metadatavalue_item_id_fkey
   
  With Regardds
  Indu Bhushan
  SIRC, RRCAT 
  Indore MP
   
   
  Folowing error in the  middle of  database import
process.
  ---
  ERROR:  canceling autovacuum task
CONTEXT:  automatic analyze of table
"dspace.public.checksum_history"
  ---
  [dspace@sircdl bin]$ /opt/dspace/bin/dspace database
info
  Database URL: jdbc:postgresql://localhost:5432/dspace
Database Schema: public
Database Software: PostgreSQL version 9.0.3
Database Driver: PostgreSQL Native Driver version
PostgreSQL 9.1 JDBC4 (build 901)
  +++-+-+
| Version    | Description    |
Installed on    | State   |
+++-+-+
| 1.1    | Initial DSpace 1.1 databas
| | PreInit |
| 1.2    | Upgrade to DSpace 1.2 sche
| | PreInit |
| 1.3    | Upgrade to DSpace 1.3 sche
| | PreInit |
| 1.3.9  | Drop constraint for DSpace
| | PreInit |
| 1.4    | Upgrade to DSpace 1.4 sche
| | PreInit |
| 1.5    | Upgrade to DSpace 1.5 sche
| | PreInit |
| 1.5.9  | Drop constraint for DSpace
| | PreInit |
| 1.6    | Upgrade to DSpace 1.6 sche
| | PreInit |
| 1.7    | Initializing from DSpace 1 |
2015-03-02 02:42:13 | Success |
| 1.8    | Upgrade to DSpace 1.8 sche |
2015-03-02 02:42:13 | Success |
| 3.0    | Upgrade to DSpace 3.x sche |
2015-03-02 02:42:14 | Success |
| 4.0    | Upgrade to DSpace 4.x sche |
2015-03-02 02:42:15 | Success |
| 5.0.2014.08.08 | DS-1945 Helpdesk Request a |
2015-03-02 02:42:16 | Success |
| 5.0.2014.09.25 | DS 1582 Metadata For All O
| | Pending |
| 5.0.2014.09.26 | DS-1582 Metadata For All O
| | Pending |
+++-+-+
  
  Following error on postgres screen.
   
  LOG:  unexpected EOF on client connection
ERROR:  constraint "metadatavalue_item_id_fkey" of
relation "metadatavalue" does not exist
STATEMENT:  ALTER TABLE metadatavalue DROP CONSTRAINT
metadatavalue_item_id_fkey
ERROR:  constraint "metadatavalue_item_id_fkey" of
relation "metadatavalue" does not exist
STATEMENT:  ALTER TABLE metadatavalue DROP CONSTRAINT
metadatavalue_item_id_fkey
LOG:  unexpected EOF on client connection
LOG:  unexpected EOF on client connection
LOG:  unexpected EOF on client connection
 
   

  
  
 
  


  
  
  
  
  --

[Dspace-tech] Library and Archives Canada Harvesting

[Cameron, Jacob]

Hello Everyone,

Is there anyone out there that has DSpace harvesting with Library and Archives 
Canada in version 1.8.x of DSpace?  The configuration has changed and I'm 
unable to get it going.  Any help would be appreciated.

Jake

--
Jake Cameron, BCS(UNB)
Systems Support Specialist III
Information Systems and Technical Services University of Lethbridge Library
Phone:(403)329-2756

This e-mail, including any and all attachments, is only for the use of the 
intended recipient(s) and may contain information that is confidential or 
privileged. If you are not the intended recipient, you are advised that any 
dissemination, copying or other use of this e-mail is prohibited. Please notify 
the sender of the error in communication by return e-mail and destroy all 
copies of this e-mail.  Thank you.

--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] install error for upstream/master

[Monika C. Mevenkamp]

I am trying to run upstream/master with code changes of mine inside dspace-api

I created a new database
did mvn package  and ran fresh_install
when going to home page I get the following error

http://localhost:8080/jspui/internal-error
-- Method: GET
-- Parameters were:

org.apache.jasper.JasperException: Unable to compile class for JSP:

An error occurred at line: [94] in the generated java file: 
[/usr/local/Cellar/tomcat/8.0.17/libexec/work/Catalina/localhost/jspui/org/apache/jsp/index_jsp.java]
The method getDispatcherType() is undefined for the type HttpServletRequest

I am running with tomcat  which I installed via homebrew on my MAC

The offending line in the generated index.jsp.java file reads

if (!"GET".equals(_jspx_method) && !"POST".equals(_jspx_method) && 
!"HEAD".equals(_jspx_method) && 
!javax.servlet.DispatcherType.ERROR.equals(request.getDispatcherType())) {


It looks to me that I ended up with a bad version of something somewhere - can 
somebody I’ve a tip ?

Monika



Monika Mevenkamp
phone: 609-258-4161
Lewis Library,Washington Road and Ivy Lane, Princeton University, Princeton, NJ 
08544


--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] install error for upstream/master

[Andrea Schweer]

  
  
Hi Monika,

On 04/03/15 12:42, Monika C. Mevenkamp
  wrote:


  
  I am trying to run upstream/master with code changes of mine
  inside dspace-api 
  
  
  I created a new database 
  did mvn package  and ran fresh_install 
  when going to home page I get the following error 
  
  
  
http://localhost:8080/jspui/internal-error
-- Method: GET
-- Parameters were:

  
org.apache.jasper.JasperException:
Unable to compile class for JSP:

  
An error occurred at line: [94]
in the generated java file:
[/usr/local/Cellar/tomcat/8.0.17/libexec/work/Catalina/localhost/jspui/org/apache/jsp/index_jsp.java]
The method getDispatcherType()
is undefined for the type HttpServletRequest
  


My first suspect would be the version of servlet-api that comes with
your tomcat install. A quick web search for "The method
getDispatcherType() is undefined for the type HttpServletRequest"
leads to this:
http://stackoverflow.com/questions/26436463/getdispatchertype-is-undefined-for-the-type-httpservletrequest

From this line in the top-level pom, it looks to me like DSpace
expects version 2.5 of servlet-api to be provided by your web
application container:
https://github.com/DSpace/DSpace/blob/master/pom.xml#L1030

I don't know whether you can just swap out the servlet-api jar that
comes with tomcat. One of the answers to the stackoverflow question
suggests going the other direction, ie changing the version number
in the DSpace pom file to what is provided by your web application
container (3.1, it looks like?). I suspect in that case you'll get
compile-time errors about the same thing.

The DSpace docs say we support Tomcat 7 or newer; if this problem
persists for Tomcat 8 then this might be worth a Jira issue.

cheers,
Andrea

-- 
Dr Andrea Schweer
IRR Technical Specialist, ITS Information Systems
The University of Waikato, Hamilton, New Zealand
  


--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

[Dspace-tech] Anomalies in Usage Statistics 4.1

[Gary Browne]

Hi all,

I hope the DSpace community can help with this one.
Since our upgrade to 4.1 in January this year (from 1.8.2, JSPUI with 
PostGreSQL on RHEL 6) we have noticed some anomalies coming into our usage 
statistics noticeably in the monthly reports.
Both bitstream views and item views have virtually doubled for no reason.
As well as this the item views list report shows something strange and I’ve 
made a comparison of the Dec 2014 top 10 items views with those of Jan and Feb 
15 (both are post 4.1 upgrade). As you can see in Jan and Feb there are some 
strange groupings that are not reflected in the “individual item statistics” 
pages. Note there is a large number from  the “370 to 380” range of items 
represented.
 

Item view for Dec 12
item.2123/12257  4836
item.2123/8878 1282
item.2123/6835 720
item.2123/8977 554
item.2123/11883  340
item.2123/12235  270
item.2123/9793 240
item.2123/11882  212
item.2123/673   200
item.2123/894   200
 
 
Item view for Jan 15
item.2123/12257  3150
item.2123/383   1114
item.2123/377   1080
item.2123/379   1070
item.2123/380   1068
item.2123/381   1068
item.2123/386   1060
item.2123/376   1056
item.2123/653   1054
item.2123/858   1046
 
 
Item view for Jan 15  item.2123/12257  4836
item.2123/8878 1282
item.2123/6835 720
item.2123/8977 554
item.2123/11883  340
item.2123/12235  270
item.2123/9793 240
item.2123/11882  212
item.2123/673   200
item.2123/894   200
 
Item view for Feb 15
 
item.2123/12257  1284
item.2123/379   1124
item.2123/380   1122
item.2123/376   1086
item.2123/653   1084
item.2123/858   1084
item.2123/383   1080
item.2123/378   1078
item.2123/385   1076
item.2123/381   1074

We noticed that there has been an increase in Searches Performed; browses and  
browse_by_item as well  we noticed new things  in Number of searches i.e.
null 646,721
scope=null  366,071
dspace  292,496
content292,495
scope=org   292,495
community@2ca  35,540
community@311  31,794
community@2ad 16,262
 
We are not sure if these are dspace internal indexing being counted and how to 
filter if this is the case. When we try to filter spiders we lose our 
individual item statistics.
 
 
What we have tried with the dspace statistics to correct the outcomes is the 
following:
 
# Changed  value in solr-statistics.cfg to filter out spiders
query.filter.spiderIp = true
 
However, this causes the individual item statistics to disappear altogether 
(perhaps due to the query string becoming too long?) So, we reset that value 
back to its default (i.e. false).
 
Next thing we tried, was to remove records that were bots from the statistics:
 
# Ran solr stats utilities with the following options
stats-util -m # mark as isBot
stats-util -i # remove by spider IP
stats-util -f # remove by isBot flag
stats-util -o # optimize
 
index-discovery -f # force re-index
index-discovery -b # rebuild
index-discovery -c # cleanup
index-discovery -o # optimize
 
# Then ran the normal sequence of overnight processing, which essentially is 
this:
stat-general
stat-monthly
stat-report-general
stat-report-monthly
stats-util -i
stats-util -o
index-discovery
index-discovery -o
 
All this resulted in no change on the outcome of the monthly reports.
 
Next we tried to switch to using Lucene instead of solr
 
# Changed values in dspace.cfg to enable lucene search and indexing
ItemCountDAO.class = org.dspace.browse.ItemCountDAOPostgres
browseDAO.class = org.dspace.browse.BrowseDAOPostgres
browseCreateDAO.class = org.dspace.browse.BrowseCreateDAOPostgres
 
# Ran lucene stats utilities with the following options
index-lucene-init -f # full build
index-lucene-init -r # reindex
 
These configuration changes and run of utilities, had no effect on the monthly 
reports either.
We would be grateful for any suggestions as to the reason for the anomalies in 
the monthly usage statistics and how to filter DSpace indexing activity.

Thanks a lot,
Gary
 
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] DSpace 5.x Legacy Statistics - Item Type Breakdowns

[Sean Carte]

On 3 March 2015 at 12:06, Sean Carte  wrote:

> Since upgrading (from 3.2) to DSpace 5, I no longer get item type
> breakdowns in my legacy stats.
>
> I have the following in dstat.cfg:
>
> item.type=Thesis or Dissertation
> item.type=Preprint
> item.type=Research Paper
>
> and I run the following via crontab every night:
>
> /dspace/bin/dspace stat-general
> /dspace/bin/dspace stat-monthly
> /dspace/bin/dspace stat-report-general
> /dspace/bin/dspace stat-report-monthly
>
> But my Statistics shows:
>
> Archive Information
> Content TypeNumber of items
> All Items1,096
> Preprint0
> Thesis or Dissertation0
> Research Paper0
>
> Is there something I've misconfigured somewhere?
>

Does nobody else have this problem, or does everybody experience the same
thing and nobody have any solution?

Sean
--
--
Dive into the World of Parallel Programming The Go Parallel Website, sponsored
by Intel and developed in partnership with Slashdot Media, is your hub for all
things parallel software development, from weekly thought leadership blogs to
news, videos, case studies, tutorials and more. Take a look and join the 
conversation now. http://goparallel.sourceforge.net/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette