Does any solr version use lucene concurrent flush

2014-11-25 Thread Aaron Beach
-- 
Aaron Beach
Senior Data Scientist
w: +1-303-625-7043

SendGrid -- Email Delivery. Simplified.
http://sendgrid.com/careers.html


Re: Does any solr version use lucene concurrent flush

2014-11-25 Thread Shawn Heisey
On 11/25/2014 2:37 PM, Aaron Beach wrote:

I'm fairly clueless when it comes to how Lucene internals work or how
Solr uses those internals ... but I remember hearing a LOT about
concurrent flushing in the leadup to the Lucene/Solr 4.0 release, and
what a performance boost it was for indexing speed.

I would be REALLY surprised to learn that Solr does NOT use it ... but I
would guess (again, no idea) that it uses it simply by accepting Lucene
defaults, not an through an explicit choice.

Thanks,
Shawn



Re: Does any solr version use lucene concurrent flush

2014-11-25 Thread Otis Gospodnetic
Yes.

Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr  Elasticsearch Support * http://sematext.com/


On Tue, Nov 25, 2014 at 4:37 PM, Aaron Beach aaron.be...@sendgrid.com
wrote:

 --
 Aaron Beach
 Senior Data Scientist
 w: +1-303-625-7043

 SendGrid -- Email Delivery. Simplified.
 http://sendgrid.com/careers.html



Re: Format version is not supported in file 'segments_gw': 0 (needs to be between -9 and -10). This version of Lucene only supports indexes created with release 3.0 and later.

2012-02-13 Thread Erick Erickson
It *looks* like you've attached a trunk Solr to a 1.4 index, is that possible?

Best
Erick

On Sun, Feb 12, 2012 at 12:42 PM, PeterKerk vettepa...@hotmail.com wrote:
 Im getting the error below all of a sudden. AFAIK i haven't touched anything
 with Lucene.
 I did add a fields to my schema and data-config.xml:
 data-config.xml:
 field name=userid column=userid /
 schema.xml:
 field name=userid type=string indexed=true stored=true /

 But removed those again later. I restarted my machine several times, and
 also restarted cygwin and reloaded my data-config. the error remains:


 * erron in browser when loading:
 http://localhost:8983/solr/zz_healthprof/dataimport?command=full-import*

 HTTP ERROR 500

 Problem accessing /solr/zz_healthprof/dataimport. Reason:

    Severe errors in solr configuration.

 Check your log files for more detailed information on what may be wrong.

 -
 java.lang.RuntimeException:
 org.apache.lucene.index.IndexFormatTooOldException: Format version is not
 supported in file 'segments_gw': 0 (needs to be between -9 and -10). This
 version of Lucene only supports indexes created with release 3.0 and later.
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1068)
        at org.apache.solr.core.SolrCore.init(SolrCore.java:582)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:455)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:310)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:200)
        at
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:125)
        at
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:86)
        at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
        at 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:662)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
        at
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
        at
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
        at 
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
        at 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at
 org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
        at 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.mortbay.start.Main.invokeMain(Main.java:194)
        at org.mortbay.start.Main.start(Main.java:534)
        at org.mortbay.start.Main.start(Main.java:441)
        at org.mortbay.start.Main.main(Main.java:119)
 Caused by: org.apache.lucene.index.IndexFormatTooOldException: Format
 version is not supported in file 'segments_gw': 0 (needs to be between -9
 and -10). This version of Lucene only supports indexes created with release
 3.0 and later.
        at
 org.apache.lucene.index.codecs.DefaultSegmentInfosReader.read(DefaultSegmentInfosReader.java:47)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:220)
        at
 org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:95)
        at
 org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:630)
        at 
 org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:91)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:435)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:314)
        at
 org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1057)
        ... 31 more


 * The error in my cygwin logfile:*



 WARNING: The abortOnConfigurationError option is no longer supported in
 solrconf
 ig.xml.  Setting it has no effect.
 Feb 12, 2012 6:37:08 PM

Re: Format version is not supported in file 'segments_gw': 0 (needs to be between -9 and -10). This version of Lucene only supports indexes created with release 3.0 and later.

2012-02-13 Thread PeterKerk
I have no idea how to check that. Also I have no idea how I would attach a
trunk Solr to a 1.4 index, so it's not very likely I actually did that :)

My Solr folder looks like this:
C:\My
Dropbox\Dropbox\inetpub\apache-solr-4.0-2010-10-12_08-05-48\example\example-DIH\solr

How would I check what version my index is? If the version is wrong, could I
perhaps delete that index and re-index again to generate a correct version?
Or is that a stupid suggestion? :)

Thanks!

--
View this message in context: 
http://lucene.472066.n3.nabble.com/Format-version-is-not-supported-in-file-segments-gw-0-needs-to-be-between-9-and-10-This-version-of-L-tp3737761p3740372.html
Sent from the Solr - User mailing list archive at Nabble.com.


Format version is not supported in file 'segments_gw': 0 (needs to be between -9 and -10). This version of Lucene only supports indexes created with release 3.0 and later.

2012-02-12 Thread PeterKerk
Im getting the error below all of a sudden. AFAIK i haven't touched anything
with Lucene. 
I did add a fields to my schema and data-config.xml:
data-config.xml:
field name=userid column=userid /
schema.xml:
field name=userid type=string indexed=true stored=true /

But removed those again later. I restarted my machine several times, and
also restarted cygwin and reloaded my data-config. the error remains:


* erron in browser when loading:
http://localhost:8983/solr/zz_healthprof/dataimport?command=full-import*
 

HTTP ERROR 500

Problem accessing /solr/zz_healthprof/dataimport. Reason:

Severe errors in solr configuration.

Check your log files for more detailed information on what may be wrong.

-
java.lang.RuntimeException:
org.apache.lucene.index.IndexFormatTooOldException: Format version is not
supported in file 'segments_gw': 0 (needs to be between -9 and -10). This
version of Lucene only supports indexes created with release 3.0 and later.
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1068)
at org.apache.solr.core.SolrCore.init(SolrCore.java:582)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:455)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:310)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:200)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:125)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:86)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:662)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1250)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:517)
at 
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:467)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at 
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
Caused by: org.apache.lucene.index.IndexFormatTooOldException: Format
version is not supported in file 'segments_gw': 0 (needs to be between -9
and -10). This version of Lucene only supports indexes created with release
3.0 and later.
at
org.apache.lucene.index.codecs.DefaultSegmentInfosReader.read(DefaultSegmentInfosReader.java:47)
at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:220)
at
org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:95)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:630)
at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:91)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:435)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:314)
at
org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1057)
... 31 more


* The error in my cygwin logfile:* 



WARNING: The abortOnConfigurationError option is no longer supported in
solrconf
ig.xml.  Setting it has no effect.
Feb 12, 2012 6:37:08 PM org.apache.solr.common.SolrException log
SEVERE: java.lang.RuntimeException:
org.apache.lucene.index.IndexFormatTooOldExc
eption: Format version is not supported in file 'segments_gw': 0 (needs to
be be
tween -9 and -10

version of lucene

2009-06-15 Thread JCodina

I have the solr-nightly build of last week, and in the lib foloder i can find
the lucene-core-2.9-dev.jar
I need to do some changes to the shingle filter in order to remove stopwords
from bigrams, but to do so I need to compile lucene, 
the problem is, lucene is in version 2.4 not 2.9
If I take, with subverison, version 2.4 then compiling solr I get the next
error:
.../apache-solr-nightly/src/java/org/apache/solr/search/DocSetHitCollector.java:21:
cannot find symbol
[javac] symbol  : class Collector
[javac] location: package org.apache.lucene.search
[javac] import org.apache.lucene.search.Collector;


any hints on the right version of lucene/solr  to be able to use solr 1.4

Joan
-- 
View this message in context: 
http://www.nabble.com/version-of-lucene-tp24036137p24036137.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: version of lucene

2009-06-15 Thread Mark Miller

JCodina wrote:

I have the solr-nightly build of last week, and in the lib foloder i can find
the lucene-core-2.9-dev.jar
I need to do some changes to the shingle filter in order to remove stopwords
from bigrams, but to do so I need to compile lucene, 
the problem is, lucene is in version 2.4 not 2.9

If I take, with subverison, version 2.4 then compiling solr I get the next
error:
.../apache-solr-nightly/src/java/org/apache/solr/search/DocSetHitCollector.java:21:
cannot find symbol
[javac] symbol  : class Collector
[javac] location: package org.apache.lucene.search
[javac] import org.apache.lucene.search.Collector;


any hints on the right version of lucene/solr  to be able to use solr 1.4

Joan
  

You want to build from svn trunk: http://svn.apache.org/viewvc/lucene/java/

You want revision r779312, because as you can see in CHANGES.txt, the 
last time Solr updated Lucene,

it was to Lucene 2.9-dev r779312.

--
- Mark

http://www.lucidimagination.com