Happened again….

I got 3 directories in my index dir

4096 Nov  4 09:31 index.20111104083156
4096 Nov 21 10:04 index.20111121090440
4096 Nov 30 14:55 index.20111129024919

as you can se the first two are old and also empty , the last one from
today is and containing 9 files none of the are 0 size
and total size 7 GB. The size of the index on the master is 14GB.

Any ideas on what to look for ?

Thanks
Ruben Chadien




On 29 November 2011 15:58, Mark Miller <markrmil...@gmail.com> wrote:

> Hmm...I've seen a bug like this, but I don't think it would be tickled if
> you are replicating config files...
>
> It def looks related though ... I'll try to dig around.
>
> Next time it happens, take a look on the slave for 0 size files - also if
> the index dir on the slave is plain 'index' or has a timestamp as part of
> the name (eg timestamp.index).
>
> On Tue, Nov 29, 2011 at 9:53 AM, Ruben Chadien <ruben.chad...@aspiro.com
> >wrote:
>
> > Hi, for the moment there are no 0 sized files, but all indexes are
> working
> > now. I will have to look next time it breaks.
> > Yes, the directory name is "index" and it replicates the schema and a
> > synonyms file.
> >
> > /Ruben Chadien
> >
> > On 29 November 2011 15:29, Mark Miller <markrmil...@gmail.com> wrote:
> >
> > > Also, on your master, what is the name of the index directory? Just
> > > 'index'?
> > >
> > > And are you replicating config files as well or no?
> > >
> > >
> > > On Nov 29, 2011, at 9:23 AM, Mark Miller wrote:
> > >
> > > > Does the problem index have any 0 size files in it?
> > > >
> > > > On Nov 29, 2011, at 2:54 AM, Ruben Chadien wrote:
> > > >
> > > >> HI all
> > > >>
> > > >> After upgrading tol Solr 3.4 we are having trouble with the
> > replication.
> > > >> The setup is one indexing master with a few slaves that replicate
> the
> > > >> indexes once every night.
> > > >> The largest index is 20 GB and the master and slaves are on the same
> > > DMZ.
> > > >>
> > > >> Almost every night one of the indexes (17 in total) fail after the
> > > >> replication with an EOF file.
> > > >>
> > > >> SEVERE: Error during auto-warming of
> > > >> key:org.apache.solr.search.QueryResultKey@bda006e3
> > :java.io.IOException:
> > > >> seek past EOF
> > > >> at
> > > >>
> > >
> >
> org.apache.lucene.store.MMapDirectory$MMapIndexInput.seek(MMapDirectory.java:347)
> > > >> at
> > > org.apache.lucene.index.SegmentTermEnum.seek(SegmentTermEnum.java:114)
> > > >> at
> > > >>
> > >
> >
> org.apache.lucene.index.TermInfosReader.seekEnum(TermInfosReader.java:203)
> > > >> at
> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:273)
> > > >> at
> > org.apache.lucene.index.TermInfosReader.get(TermInfosReader.java:210)
> > > >> at
> > org.apache.lucene.index.SegmentReader.docFreq(SegmentReader.java:507)
> > > >> at
> > >
> org.apache.solr.search.SolrIndexReader.docFreq(SolrIndexReader.java:309)
> > > >> at
> > > org.apache.lucene.search.TermQuery$TermWeight$1.add(TermQuery.java:56)
> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:77)
> > > >> at org.apache.lucene.util.ReaderUtil$Gather.run(ReaderUtil.java:82)
> > > >>
> > > >>
> > > >> After a restart the errors are gone, anyone else seen this ?
> > > >>
> > > >> Thanks
> > > >> Ruben Chadien
> > > >
> > > > - Mark Miller
> > > > lucidimagination.com
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > > - Mark Miller
> > > lucidimagination.com
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> > --
> > *Ruben Chadien
> > *Senior Developer
> > Mobile +47 900 35 371
> > ruben.chad...@aspiro.com
> > *
> >
> > Aspiro Music AS*
> > Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo
> > Tel +47 452 86 900, fax +47 22 37 36 59
> > www.aspiro.com/music
> >
>
>
>
> --
> - Mark
>
> http://www.lucidimagination.com
>



-- 
*Ruben Chadien
*Senior Developer
Mobile +47 900 35 371
ruben.chad...@aspiro.com
*

Aspiro Music AS*
Øvre Slottsgate 25, P.O. Box 8710 Youngstorget, N-0028 Oslo
Tel +47 452 86 900, fax +47 22 37 36 59
www.aspiro.com/music

Reply via email to