[Dspace-tech] directory size
Dear All, Current size of our dspace is like this: /log: 90 Gb /assetstore: 12 Gb /SOLR: 5.4 Gb Can you give suggestions on how to 'cut' the size of log directory? any hints for future daily operational to minimize the log? Best Regards, Ady W. Paundu Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- Managing the Performance of Cloud-Based Applications Take advantage of what the Cloud has to offer - Avoid Common Pitfalls. Read the Whitepaper. http://pubads.g.doubleclick.net/gampad/clk?id=121051231iu=/4140/ostg.clktrk ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] another unscheduled shutdown
I,ve done several hardware test these couple of days using memtest86+ and`IBM DSA Memory stress test. IBM DSA Memory Stress Test gave me 'Passed' result, but memtest86+ showed errors. I don't know which one to believe, so i think i will try Dr.Andrea's option. Dr.Andrea, which jvm version now you are running? Regards, AdyWP On Wed, 03 Jul 2013 16:01:33 +1200, Andrea Schweer wrote: Hi, On 03/07/13 14:20, Ady Wahyudi Paundu wrote: is it a known problem? because i've read several article about bugs on java 7, something about loops? so, did you downgrade your jvm? We downgraded the jvm; I haven't had time to do a root cause investigation. cheers, Andrea Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] catalina.out - HEYYY
Dear All, I have messages like this on my Catalina.out can somebody kindly explain what is the line with HE means??? INFO: [statistics] Registered new searcher Searcher@4c018a6c main Jul 01, 2013 8:30:07 AM org.apache.solr.search.SolrIndexSearcher close INFO: Closing Searcher@574f879e main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumula$ filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative$ queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=2,cumul$ documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulati$ Jul 01, 2013 8:41:54 AM org.apache.solr.core.SolrDeletionPolicy onInit INFO: SolrDeletionPolicy.onInit: commits:num=1 commit{dir=/usr/local/dspace/solr/statistics/data/index,segFN=segments_1xi,version=1368514545243,generation=2502,fil$ Jul 01, 2013 8:41:54 AM org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: newest commit = 1368514545243 Jul 01, 2013 8:41:54 AM org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {add=[(null)]} 0 18 Jul 01, 2013 8:41:54 AM org.apache.solr.core.SolrCore execute INFO: [statistics] webapp=/solr path=/update params={wt=javabinversion=2} status=0 QTime=18 Jul 01, 2013 8:41:54 AM org.apache.solr.core.SolrCore execute INFO: [search] webapp=/solr path=/select params={mlt.minwl=5mlt.fl=dc.title_mlt,dc.contributor.author_mlt,dc.creator_mlt,dc$ 2013-06-15T03:47:52.000Z HE 2013-07-01T03:42:52.999Z Jul 01, 2013 8:44:10 AM org.apache.solr.core.SolrCore execute INFO: [oai] webapp=/solr path=/select params={sort=item.id+ascstart=0q=((item.lastmodified:[2013\-06\-15T03\:47\:52.000Z+T$ 2013-06-15T03:47:52.000Z HE 2013-07-01T03:42:52.999Z Jul 01, 2013 8:44:44 AM org.apache.solr.core.SolrCore execute INFO: [oai] webapp=/solr path=/select params={sort=item.id+ascstart=100q=((item.lastmodified:[2013\-06\-15T03\:47\:52.000Z$ Jul 01, 2013 8:45:06 AM org.apache.solr.update.processor.LogUpdateProcessor finish INFO: {add=[(null)]} 0 5 Jul 01, 2013 8:45:06 AM org.apache.solr.core.SolrCore execute INFO: [statistics] webapp=/solr path=/update params={wt=javabinversion=2} status=0 QTime=5 2013-06-15T03:47:52.000Z HE 2013-07-01T03:42:52.999Z Jul 01, 2013 8:45:17 AM org.apache.solr.core.SolrCore execute - TIA AdyWP Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- This SF.net email is sponsored by Windows: Build for Windows Store. http://p.sf.net/sfu/windows-dev2dev ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] forbidden oai import
Hi Lighton, i kept having the same result, forbidden error, even when not using 'o' flag. however, every time i try, it stopped at different items, one time at 700.. the other time at 100... i had also look at the issue you mentioned, but i dont know which protocol should i extend its connection timeout, since i use both http and ajp. i will try changing both of them then and tell you how it goes best regards, adywp On Thu, 30 May 2013 18:45:55 +0200, Lighton Phiri wrote: Hello, What happens if you re-run the import without optimising your index --running it without the 'o' flag? Perhaps it has something to do with this [1]? [dspace]/bin/dspace oai import -c [1] https://issues.apache.org/jira/browse/SOLR-2832 Lighton Phiri http://lightonphiri.org On 30 May 2013 14:07, Ady Wahyudi Paundu ad...@unhas.ac.id wrote: hi all, another question, i ran [dspace]/bin/dspace oai import -c -o it went successfully up until 3600 items, then it show forbidden error: ... 3300 items imported so far... 3400 items imported so far... 3500 items imported so far... 3600 items imported so far... org.apache.solr.common.SolrException: Forbidden Forbidden request: http://repository.unhas.ac.id/solr/oai/update?wt=javabinversion=2 at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:64) at org.dspace.xoai.app.XOAI.index(XOAI.java:229) at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:210) at org.dspace.xoai.app.XOAI.index(XOAI.java:128) at org.dspace.xoai.app.XOAI.main(XOAI.java:439) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) ... what went wrong? additional info: both in [dspace]/config/modules/discovery.cfg and [dspace]/config/modules/solr-statistics.cfg, i set the server attribut to http://localhost/solr/ another thing: why it just went error at somewhere around 3600? best regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] forbidden oai import
Yes Sir, i also have found several similar case from internet, however all of them happened at start and caused by mis-configured server attribut for either discovery or solr. i dont know about the infrastructure problem, but all of dspace resources to index are on localhost (including database) thank you. best regards, adywp On Thu, 30 May 2013 18:11:10 +0100, João Melo wrote: Hi Ady, this exception is thrown whenever the OAI indexer is trying to access some SOLR server which replies with a HTTP 403 Forbidden error. The request: http://repository.unhas.ac.id/solr/oai/update?wt=javabinversion=2 [8] If you try to access it, it will, in fact, return a 403 error. It shouldn't work at all (never), it's weird watching it happening after a while. I'm not able to figure it out what is happening, it could be an infrastructure problem (firewall, url redirects, url rewrites...) On 30 May 2013 13:07, Ady Wahyudi Paundu wrote: hi all, another question, i ran [dspace]/bin/dspace oai import -c -o it went successfully up until 3600 items, then it show forbidden error: ... 3300 items imported so far... 3400 items imported so far... 3500 items imported so far... 3600 items imported so far... org.apache.solr.common.SolrException: Forbidden Forbidden request: http://repository.unhas.ac.id/solr/oai/update?wt=javabinversion=2 [1] at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:435) at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.java:244) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:64) at org.dspace.xoai.app.XOAI.index(XOAI.java:229) at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:210) at org.dspace.xoai.app.XOAI.index(XOAI.java:128) at org.dspace.xoai.app.XOAI.main(XOAI.java:439) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183) ... what went wrong? additional info: both in [dspace]/config/modules/discovery.cfg and [dspace]/config/modules/solr-statistics.cfg, i set the server attribut to http://localhost/solr/.. [2].. another thing: why it just went error at somewhere around 3600? best regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- Get 100% visibility into Java/.NET code with AppDynamics Lite It's a free troubleshooting tool designed for production Get down to code-level detail for bottlenecks, with 2% overhead. Download for free and get started troubleshooting in minutes. http://p.sf.net/sfu/appdyn_d2d_ap2 ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] search feature doesnt work after move over from 1.7 to 3.1
oohh geezzz... i forgot that... after 'dspace cleanup' and 'dspace index-init' the search feature works again. thank you Mr.Kapila side note: why do i feel that this new system (3.1) a bit slower than my old one (1.7)? best regards, adywp On Fri, 17 May 2013 12:14:32 +0530, Amandeep Kapila wrote: Hello, Have you reindexed using [dspace]/bin/dspace script? On Fri, May 17, 2013 at 10:48 AM, wrote: Hi all, after successfully move my data from 1.7 system to 3.1, now it seems the search feature cannot work. it simply cannot find anything. i'm, using xmlui-mirage. This is what i did to move my data: 1) dump 1.7 database 2) restore it into 3.1 database (have to truncate the 3.1 db first) 3) apply database schema upgrade scripts from 1.7 - 1.8 - 3.1 following guidance from this: (wiki.duraspace.org/display/DSDOC3x/Upgrading+a+DSpace+Installation [1]) and (dspacebromley.blogspot.com [2]) 4) copy over the assetstore directory how can i fix this? best regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ [3] -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d [4] ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net [5] https://lists.sourceforge.net/lists/listinfo/dspace-tech [6] List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette [7] -- Cheers, aman, (Amandeep Kapila), New Delhi, INDIA. Links: -- [1] http://wiki.duraspace.org/display/DSDOC3x/Upgrading+a+DSpace+Installation [2] http://dspacebromley.blogspot.com [3] http://unhas.ac.id/ [4] http://p.sf.net/sfu/alienvault_d2d [5] mailto:DSpace-tech@lists.sourceforge.net [6] https://lists.sourceforge.net/lists/listinfo/dspace-tech [7] https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette [8] mailto:ad...@unhas.ac.id Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] search feature doesnt work after move over from 1.7 to 3.1
Hi all, after successfully move my data from 1.7 system to 3.1, now it seems the search feature cannot work. it simply cannot find anything. i'm, using xmlui-mirage. This is what i did to move my data: 1) dump 1.7 database 2) restore it into 3.1 database (have to truncate the 3.1 db first) 3) apply database schema upgrade scripts from 1.7 - 1.8 - 3.1 following guidance from this: (wiki.duraspace.org/display/DSDOC3x/Upgrading+a+DSpace+Installation) and (dspacebromley.blogspot.com) 4) copy over the assetstore directory how can i fix this? best regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] how to export dspace 1.7 content to 3.1
Well... it sure look easy..., finally succeed to move all my data from old 1.7 system to 3.1 system. Thanks to Mr Kapila (kapila.amand...@gmail.com), Mr. Gibson and Mr. Phiri. This is what i did: 1) dump 1.7 database 2) restore it into 3.1 database (have to truncate the 3.1 db first) 3) apply database schema upgrade scripts from 1.7 - 1.8 - 3.1 following guidance from this: (wiki.duraspace.org/display/DSDOC3x/Upgrading+a+DSpace+Installation) and (dspacebromley.blogspot.com) 4) copy over the assetstore directory now.. onto faceoff-overlaying :) again, thanks all best regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
[Dspace-tech] how to export dspace 1.7 content to 3.1
Hiy'all, First of all thank you for accepting me into this milist. straight to the point, i have dspace 1.7 with xmlui manakin for about two years now. my repository site (repository.unhas.ac.id) have also been listed in dspace list. right now i have a new machine and already setup dspace 3.1 with xmlui on it. can someone give me a guidance on how to move all the contents on my old system to the new one? for your kind attention i thank you regards, adywp Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
Re: [Dspace-tech] how to export dspace 1.7 content to 3.1
Thank you Mr.Gibson and Mr.Phiri, i'll work on it and let you know the result regards, adywp On Wed, 15 May 2013 19:15:55 +0200, Hilton Gibson wrote: You can also consult this hardware upgrade guide: http://wiki.lib.sun.ac.za/index.php/SUNScholar/Upgrading/Hardware [15] All the contents have to be moved during a hardware upgrade, similar to your situation. On 15 May 2013 17:10, Lighton Phiri wrote: Hello there, See this [1] Wiki page. Interestingly, Helix recommended an alternative method in this [2] post. [1] https://wiki.duraspace.org/display/DSDOC3x/Transferring+or+Copying+Content+Between+Repositories [1] [2] http://sourceforge.net/mailarchive/message.php?msg_id=30430890 [2] -- Phiri http://lightonphiri.org [3] Powered by PTIK UNHAS ~ http://unhas.ac.id/ -- AlienVault Unified Security Management (USM) platform delivers complete security visibility with the essential security capabilities. Easily and efficiently configure, manage, and operate all of your security controls from a single console and one unified framework. Download a free trial. http://p.sf.net/sfu/alienvault_d2d ___ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette