Hi, Tim:
1) I did the "lucene-core-3.5.0.jar" manual update of the indexes. For the
search index, I got no errors, but for the statistics core, I got:
Exception in thread "main" org.apache.lucene.index.IndexNotFoundException:
org.apache.lucene.store.MMapDirectory@/cul/app/dspace/solr/statistics/data/index
lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e888d65
at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:118)
at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:85)
2) I deleted the statistics core and did the ant update. I brought up my
DSpace 5.1 test system and when I tried to do a search, I got no results. When
I went to do a browse, I got:
ERROR org.dspace.app.xmlui.aspect.discovery.SidebarFacetsTransformer @
anonymous:session_id=5749DBA88953D8B0ABDDA3FFD1DFF5F2:ip_addr=128.84.117.195:Error
in Discovery while setting up date facet range:date facet\colon;
dateIssued.year
SolrCore 'search' is not available due to init failure: Index locked for write
for core search,trace=org.apache.solr.common.SolrException: SolrCore 'search'
is not available due to init failure: Index locked for write for core search
3) I stopped tomcat, deleted the search index (as you suggested) and did the
mvn build and ant update and then copied the new webapps over to tomcat.
Everything looked good. I started tomcat and my site came up. Before doing
anything more I ran "./dspace index-discovery -b". It ran to completion, but
all searches return no hits and the browses give me the same write lock error
as above.
I made sure the permissions are correct (dspace user owns the solr indexes and
tomcat) and removed the write lock and tried again, but again I get the same
error.
George Kozak
Digital Library Specialist
Cornell University Library Information Technologies (CUL-IT)
218 Olin Library
Cornell University
Ithaca, NY 14853
607-255-8924
-----Original Message-----
From: Tim Donohue [mailto:tdono...@duraspace.org]
Sent: Tuesday, April 07, 2015 11:52 AM
To: George Stanley Kozak; dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional
information)
Hi George,
What happens if you do the following against your old 1.8.2 indexes:
1. wget
"http://search.maven.org/remotecontent?filepath=org/apache/lucene/lucene-core/3.5.0/lucene-core-3.5.0.jar";
2. java -cp lucene-core-3.5.0.jar org.apache.lucene.index.IndexUpgrader
/cul/app/dspace/solr/statistics/data/index
3. java -cp lucene-core-3.5.0.jar org.apache.lucene.index.IndexUpgrader
/cul/app/dspace/solr/search/data/index
Do either of those "IndexUpgrader" commands succeed against your *old*
1.8.2 indexes? If not, could you send along the exception stacktrace?
I'm just trying to determine if the issue is actually in these old 1.8.2
indexes. It may be either they are indexes from an unexpected, older version of
Solr, or there's some minor index corruption here.
--
To be honest, another thing to note here is that your *search* indexes can be
easily rebuilt in DSpace 5.x (simply run "./dspace index-discovery -b"). The
only older index that really requires this upgrade process is the *statistics*
index (as currently it doesn't have a reindex command).
So, if your statistics index is of no importance, you could just delete both of
these old indexes and upgrade to 5.1. As part of the 5.1 upgrade, a full
reindex of the search index will be kicked off (when you start Tomcat). So,
after a few minutes, your content should be fully reindexed and working.
- Tim
On 4/7/2015 10:12 AM, George Stanley Kozak wrote:
> Thanks for your help, Tim:
>
> I'm afraid that I keep hitting a wall when I try to upgrade to DSpace
> 5.1
>
> I tried to go directly from DSpace 1.8.2 to DSpace 5.1 and got:
> ERROR occurred while checking Solr index version:
> Exception in thread "main" java.io.IOException: Could not read Lucene
> segments files in /cul/app/dspace/solr/statistics/data/index
>
> We have been using our own stats gathering system instead of the one within
> DSpace. So, I removed the statistics index but then I got:
> Exception in thread "main" java.io.IOException: Could not read Lucene
> segments files in /cul/app/dspace/solr/search/data/index
> This version of Lucene only supports indexes created with release 3.0 and
> later.
>
> So, I went ahead and used the DSpace 4.3 version of our solr indexes (without
> the statistics). It ran fine and everything got upgraded, but when I tried
> to do any searching, I get the "write lock error". If I turn off tomcat,
> delete the write lock and restart things, I get the same thing. Also, I
> cannot update the discovery index because of the write lock problem.
>
> By the way, I did try the manual upgrade of the Solr indexes defined in the
> manual, but that didn't work for me, either.
>
> So, right now, it looks like I can only upgrade to DSpace 4.3, unless you
> have some more suggestions for me.
>
>
> George Kozak
> Digital Library Specialist
> Cornell University Library Information Technologies (CUL-IT)
> 218 Olin Library
> Cornell University
> Ithaca, NY 14853
> 607-255-8924
>
>
>
> -----Original Message-----
> From: Tim Donohue [mailto:tdono...@duraspace.org]
> Sent: Tuesday, April 07, 2015 9:31 AM
> To: George Stanley Kozak; dspace-tech@lists.sourceforge.net
> Subject: Re: [Dspace-tech] Error after install of DSpace 5.1
> (Additional information)
>
> Hi George,
>
> Yes, that is what I was suggesting...upgrading directly from 1.8.2 or
> 3.3 (whichever was your starting point) to 5.1. The "ant update" should take
> care of the necessary Solr index upgrades for you.
>
> - Tim
>
> On 4/6/2015 6:21 PM, George Stanley Kozak wrote:
>> Tim:
>>
>> Thank you for your advice. I did try the 5.1 ant update, but it failed.
>> Maybe if I tried it going from DSpace 3.3 or 1.8.2 directly to DSpace 5.1
>> instead of doing the intermediate step to 4.3, this might work? I will try
>> a few other things and let everyone know what works.
>>
>> George Kozak
>> Digital Library Specialist
>> Cornell University Library Information Technologies (CULIT)
>> 218 Olin Library
>> Cornell University
>> Ithaca, NY 14853
>> 607-255-8924
>>
>> ________________________________________
>> From: Tim Donohue <tdono...@duraspace.org>
>> Sent: Monday, April 6, 2015 4:44 PM
>> To: dspace-tech@lists.sourceforge.net
>> Subject: Re: [Dspace-tech] Error after install of DSpace 5.1 (Additional
>> information)
>>
>> Hi George,
>>
>> The error below is essentially saying that your Solr statistics index
>> is "too old" for the version of Solr packages with DSpace 4.3 to upgrade.
>>
>> However, in the DSpace 5.1 upgrade process, during the "ant update"
>> step, we've attempted to catch this scenario automatically -- we try
>> to determine the version of a Solr index, and upgrade it
>> automatically to the latest version.
>>
>> So, I'd recommend trying to point DSpace 5.1 at your old Solr index,
>> and running "ant update". It is supposed to upgrade an old index
>> automatically.
>>
>> If that doesn't work for some reason, another option is to do a more
>> manual upgrade, as described in the DSpace 5.x documentation. This
>> manual upgrade essentially requires downloading multiple versions of
>> the Solr/Lucene core JAR, and running it against your index in order
>> to upgrade it to the latest compatible version (this is essentially
>> the same process that is now automated by "ant update" though)
>>
>> https://wiki.duraspace.org/display/DSDOC5x/Upgrading+DSpace#Upgrading
>> D
>> Space-ManuallyUpgradingSolrIndexes
>>
>> By the way, from your earlier messages, recently I also did encounter
>> that odd Solr "write.lock" error ("Index locked for write..") during
>> a recent upgrade I tried to 5.1. In my situation, it seemed like it
>> was a stale "write.lock" file which was somehow sitting around. After
>> clearing it out, the upgrade proceeded. Admittedly, I still need to
>> dig a bit further and ensure my analysis is correct.
>>
>> - Tim
>>
>> On 4/1/2015 3:16 PM, George Stanley Kozak wrote:
>>> Hi, Everyone:
>>>
>>> I have discovered that when I try to optimize my Solr indexes when I
>>> upgraded from DSpace 3.3 to 4.3
>>>
>>> (wget 'http://localhost:8080/solr/statistics/update?optimize=true')
>>>
>>> I get the following errors in the solr logs:
>>>
>>> ERROR org.apache.solr.core.CoreContainer @ Unable to create core:
>>> statistics
>>>
>>> Format version is not supported (resource: segment _32 in resource
>>> ChecksumIndexInput(MMapIndexInput(path="/cul/app/dspace/solr/statistics/data/index/segments_1p0"))):
>>> 2.x. This version of Lucene only supports indexes created with
>>> release
>>> 3.0 and later.
>>>
>>> If I later try to upgrade to 5.1, I see during the ant update:
>>>
>>> /cul/app/dspace/src/dspace-5.1-src-release/dspace/target/dspace-installer/build.xml:1061:
>>> ERROR occurred while checking Solr index version:
>>>
>>> Exception in thread "main" java.io.IOException: Could not read
>>> Lucene segments files in /cul/app/dspace/solr/statistics/data/index
>>>
>>> I know the 5.1 documentation states that you can manually update the
>>> Solr indexes. Should that be done in my 4.3 upgrade before I try to
>>> go to 5.1 or should it be done in the 5.1 upgrade?
>>>
>>> George Kozak
>>>
>>> Digital Library Specialist
>>>
>>> Cornell University Library Information Technologies (CUL-IT)
>>>
>>> 218 Olin Library
>>>
>>> Cornell University
>>>
>>> Ithaca, NY 14853
>>>
>>> 607-255-8924
>>>
>>>
>>>
>>>
>>>
>>> --------------------------------------------------------------------
>>> -
>>> --------- Dive into the World of Parallel Programming The Go
>>> Parallel Website, sponsored by Intel and developed in partnership
>>> with Slashdot Media, is your hub for all things parallel software
>>> development, from weekly thought leadership blogs to news, videos,
>>> case studies, tutorials and more. Take a look and join the
>>> conversation now. http://goparallel.sourceforge.net/
>>>
>>>
>>>
>>> _______________________________________________
>>> DSpace-tech mailing list
>>> DSpace-tech@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>>> List Etiquette:
>>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>>
>>
>> ---------------------------------------------------------------------
>> -
>> -------- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard Learn
>> Process modeling best practices with Bonita BPM through live
>> exercises
>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>> event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_S
>> F _______________________________________________
>> DSpace-tech mailing list
>> DSpace-tech@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/dspace-tech
>> List Etiquette:
>> https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
>>
------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
