Re: [Neo4j] Rebuilding Lucene index
Hi all, Would like to confirm that the problem got somewhat solved after it tried to perform CheckIndex -fix on every lucene index folder. Unfortunately I could not investigate which 'corrupted' index did the tool delete, therefore a 'complete' index rebuilding would be a good last option in this case. Anyway knowing that such tool exist is already a big step ahead. Thanks for everything! Rama On Mon, Sep 19, 2011 at 1:59 AM, Rama Manusama wrote: > No problem, you could download it here > https://docs.google.com/leaf?id=0B4qYoS7piZ7PNDdhNzkzMWEtMWMyYS00MWNmLWI3YzktYjFiZjllMzk0MzA2&hl=en_US > > Thanks, > Rama > > > On Mon, Sep 19, 2011 at 12:32 AM, Michael Hunger < > michael.hun...@neotechnology.com> wrote: > >> Sorry the mailing list eats attachments, can you copy it in the mail or >> make it available somewhere? >> >> Thanks >> >> Michael >> >> Am 18.09.2011 um 23:32 schrieb Rama Manusama: >> >> > True, I reproduced the error again just now, messages.log is attached >> > >> > Thanks and cheers, >> > Rama >> > >> > On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson < >> matt...@neotechnology.com >> >> wrote: >> > >> >> I'm guessing the important stack trace regarding the loading of the >> lucene >> >> index provider is found in /messages.log. Could you >> go >> >> look there? >> >> >> >> 2011/9/18 Rama Manusama >> >> >> >>> Hi Michael, >> >>> >> >>> Sure, here you go, thanks! >> >>> >> >>> Sep 18, 2011 9:37:39 PM >> org.neo4j.kernel.impl.transaction.TransactionImpl >> >>> doBeforeCompletion >> >>> WARNING: Caught exception from tx >> >>> >> >>> >> >> >> syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 >> >>> ] >> >>> beforeCompletion() >> >>> java.lang.RuntimeException: org.jruby.exceptions.RaiseException: >> Native >> >>> Exception: 'class java.lang.IllegalArgumentException'; Message: No >> index >> >>> provider 'lucene' found; StackTrace: >> java.lang.IllegalArgumentException: >> >> No >> >>> index provider 'lucene' found >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) >> >>> at >> >> org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) >> >>> >> >>>at >> >>> >> >>> >> >> >> org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) >> >>> at >> >>> org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) >> >>> at >> >>> >> >>> >> >> >> org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) >> >>> at >> >>> >> org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) >> >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> >>> at >> >>> >> >>> >> >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> >>> at >> >>> >> >>> >> >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> >>> at java.lang.reflect.Method.invoke(Method.java:616) >> >>> at >> >>> >> >>> >> >> >> org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) >> >>>
Re: [Neo4j] Rebuilding Lucene index
No problem, you could download it here https://docs.google.com/leaf?id=0B4qYoS7piZ7PNDdhNzkzMWEtMWMyYS00MWNmLWI3YzktYjFiZjllMzk0MzA2&hl=en_US Thanks, Rama On Mon, Sep 19, 2011 at 12:32 AM, Michael Hunger < michael.hun...@neotechnology.com> wrote: > Sorry the mailing list eats attachments, can you copy it in the mail or > make it available somewhere? > > Thanks > > Michael > > Am 18.09.2011 um 23:32 schrieb Rama Manusama: > > > True, I reproduced the error again just now, messages.log is attached > > > > Thanks and cheers, > > Rama > > > > On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson < > matt...@neotechnology.com > >> wrote: > > > >> I'm guessing the important stack trace regarding the loading of the > lucene > >> index provider is found in /messages.log. Could you > go > >> look there? > >> > >> 2011/9/18 Rama Manusama > >> > >>> Hi Michael, > >>> > >>> Sure, here you go, thanks! > >>> > >>> Sep 18, 2011 9:37:39 PM > org.neo4j.kernel.impl.transaction.TransactionImpl > >>> doBeforeCompletion > >>> WARNING: Caught exception from tx > >>> > >>> > >> > syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 > >>> ] > >>> beforeCompletion() > >>> java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native > >>> Exception: 'class java.lang.IllegalArgumentException'; Message: No > index > >>> provider 'lucene' found; StackTrace: > java.lang.IllegalArgumentException: > >> No > >>> index provider 'lucene' found > >>> at > >>> > >>> > >> > org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) > >>> at > >>> > >>> > >> > org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) > >>> at > >>> > >>> > >> > org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) > >>> at > >>> > >>> > >> > org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) > >>> at > >> org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) > >>> > >>>at > >>> > >>> > >> > org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) > >>> at > >>> > >>> > >> > org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) > >>> at > >>> org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) > >>> at > >>> > >>> > >> > org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) > >>> at > >>> > org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) > >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >>> at > >>> > >>> > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >>> at > >>> > >>> > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >>> at java.lang.reflect.Method.invoke(Method.java:616) > >>> at > >>> > >>> > >> > org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) > >>> at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) > >>> at > >>> > >>> > >> > org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) > >>> at > >>> > >>> > >> > org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) > >>> at > >>> > org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) > >>> at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) > >>> at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) > >>> at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) > >>> at > >>> > >> > org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) > >>> at > >>> > >>> > >> >
Re: [Neo4j] Rebuilding Lucene index
True, I reproduced the error again just now, messages.log is attached Thanks and cheers, Rama On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson wrote: > I'm guessing the important stack trace regarding the loading of the lucene > index provider is found in /messages.log. Could you go > look there? > > 2011/9/18 Rama Manusama > > > Hi Michael, > > > > Sure, here you go, thanks! > > > > Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl > > doBeforeCompletion > > WARNING: Caught exception from tx > > > > > syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 > > ] > > beforeCompletion() > > java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native > > Exception: 'class java.lang.IllegalArgumentException'; Message: No index > > provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: > No > > index provider 'lucene' found > >at > > > > > org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) > >at > > > > > org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) > >at > > > > > org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) > >at > > > > > org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) > >at > org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) > > > > at > > > > > org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) > >at > > > > > org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) > >at > > org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) > >at > > > > > org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) > >at > > org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >at > > > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > >at > > > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >at java.lang.reflect.Method.invoke(Method.java:616) > >at > > > > > org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) > >at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) > >at > > > > > org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) > >at > > > > > org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) > >at > > org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) > >at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) > >at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) > >at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) > >at > > > org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) > >at > > > > > org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) > >at > > > > > org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) > >at > > > > > org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) > >at > > org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) > >at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) > >at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) > >at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) > >at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) > >at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) > >at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) > >at org.jruby.ast.IfNode.interpret(IfNode.java:119) > >at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) > >at > > > org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) > >at > > > > > org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) > >at > > > > > org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) > >at > > > > > org.jruby.runtime.callsite.CachingCallSite.cach
Re: [Neo4j] Rebuilding Lucene index
uebox112/gems/neo4j-1.2.2-java/lib/neo4j/traversal/traverser.rb:152:in `each' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/site_ruby/shared/builtin/java/java.lang.rb:12:in `each' from /home/rama/.rvm/gems/jruby-1.6.4@rails31-torquebox112/gems/neo4j-1.2.2-java/lib/neo4j/traversal/traverser.rb:152:in `each' from (irb):7:in `evaluate' from org/jruby/RubyKernel.java:1088:in `eval' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:158:in `eval_input' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:271:in `signal_status' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:155:in `eval_input' from org/jruby/RubyKernel.java:1419:in `loop' from org/jruby/RubyKernel.java:1191:in `catch' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:154:in `eval_input' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:71:in `start' from org/jruby/RubyKernel.java:1191:in `catch' from /home/rama/.rvm/rubies/jruby-1.6.4/lib/ruby/1.8/irb.rb:70:in `start' from /home/rama/.rvm/gems/jruby-1.6.4@rails31-torquebox112/gems/railties-3.1.0/lib/rails/commands/console.rb:45:in `start' from /home/rama/.rvm/gems/jruby-1.6.4@rails31-torquebox112/gems/railties-3.1.0/lib/rails/commands/console.rb:8:in `start' from /home/rama/.rvm/gems/jruby-1.6.4@rails31-torquebox112/gems/railties-3.1.0/lib/rails/commands.rb:40:in `(root)' from org/jruby/RubyKernel.java:1038:in `require' from script/rai Unable to close logical log java.io.IOException: Logical log[/home/rama/wspace/criticube/db/nioneo_logical.log.1] not found at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.deleteCurrentLogFile(XaLogicalLog.java:646) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.close(XaLogicalLog.java:704) at org.neo4j.kernel.impl.transaction.xaframework.XaContainer.close(XaContainer.java:109) at org.neo4j.kernel.impl.nioneo.xa.NeoStoreXaDataSource.close(NeoStoreXaDataSource.java:250) at org.neo4j.kernel.impl.nioneo.xa.NioNeoDbPersistenceSource.stop(NioNeoDbPersistenceSource.java:69) at org.neo4j.kernel.GraphDbInstance.shutdown(GraphDbInstance.java:293) at org.neo4j.kernel.EmbeddedGraphDbImpl.shutdown(EmbeddedGraphDbImpl.java:349) at org.neo4j.kernel.EmbeddedGraphDatabase.shutdown(EmbeddedGraphDatabase.java:125) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:117) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374) at org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:328) at org.jruby.runtime.BlockBody.call(BlockBody.java:73) at org.jruby.runtime.Block.call(Block.java:89) at org.jruby.RubyProc.call(RubyProc.java:274) at org.jruby.RubyProc.call(RubyProc.java:233) at org.jruby.Ruby.tearDown(Ruby.java:2739) at org.jruby.Ruby.tearDown(Ruby.java:2726) at org.jruby.Main.internalRun(Main.java:201) at org.jruby.Main.run(Main.java:164) at org.jruby.Main.run(Main.java:148) at org.jruby.util.ShellLauncher$ScriptThreadProcess.run(ShellLauncher.java:140) at java.lang.Thread.run(Thread.java:679) exit On Sun, Sep 18, 2011 at 10:02 PM, Michael Hunger < michael.hun...@neotechnology.com> wrote: > Do you have more of that s
Re: [Neo4j] Rebuilding Lucene index
Sorry apparently I made a mistake, the index that I fixed was a dir that I copied outside the app directory.. The 'new' database with index dir emptied certainly works, as it has no index on the data Once I copied back the repaired /index folder, it still show the same error message Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) So far the only way to get the database accessible is only by removing the index folder. Cheers, Rama On Sun, Sep 18, 2011 at 9:36 PM, Rama Manusama wrote: > Thanks for the link Michael, tried CheckIndex: > > (1) It solves one problem with some (hopefully) minor losses by removing > the corrupted index without having to delete the whole '/index' folder. > > (2) However, I am not very sure if the tool only deletes the lucene index > or also the underlying data the index refers to, as I was not very sure > which entry in the database causes the problem It would be quite scary > to imagine that some critical data have to be deleted or lose their index in > production environment (although the next safety net would be the backups). > Perhaps there is still a way to rebuild the whole index? > > In any case this is already a big step ahead, thanks alot!! > > Cheers, > Rama > > > > On Sun, Sep 18, 2011 at 6:02 PM, Peter Neubauer < > peter.neuba...@neotechnology.com> wrote: > >> Rama, >> if you have good results with this, please report back and we can put >> a link into the docs ... >> >> Cheers, >> >> /peter neubauer >> >> GTalk: neubauer.peter >> Skype peter.neubauer >> Phone +46 704 106975 >> LinkedIn http://www.linkedin.com/in/neubauer >> Twitter http://twitter.com/peterneubauer >> >> http://www.neo4j.org - Your high performance graph >> database. >> http://startupbootcamp.org/- Öresund - Innovation happens HERE. >> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. >> >> >> >> On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger >> wrote: >> > Perhaps this helps: >> > >> > CheckIndex is a tool available in the Lucene library, which allows you >> to check the files and create new segments that do not contain problematic >> entries. This means that this tool, with little loss of data is able to >> repair a broken index. >> > >> > http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ >> > >> > >> > Michael >> > >> > Am 18.09.2011 um 17:39 schrieb Mattias Persson: >> > >> >> I believe it is integrated (correct me if I'm wrong) but there might >> still >> >> be cases where i kill -9 or power outage might put some lucene files in >> a >> >> bad state. It's pretty much outside of neo4j's control and is very, >> very >> >> rare. It'd be great to come up with some mechanism to be able to >> prevent >> >> that, but for the time beimg I'm not aware of a way... Maybe there are >> tools >> >> for repairing a corrupted lucene index out there? >> >> >> >> Den lördagen den 17:e september 2011 skrev Peter Neubauer< >> >> peter.neuba...@neotechnology.com>: >> >>> Yes, >> >>> messages.log is good, I am just not sure if in neo4j.rb Lucene is >> >>> transactionally integrated at all, Andreas? >> >>> >> >>> Cheers, >> >>> >> >>> /peter neubauer >> >>> >> >>> GTalk: neubauer.peter >> >>> Skype peter.neubauer >> >>> Phone +46 704 106975 >> >>> LinkedIn http://www.linkedin.com/in/neubauer >> >>> Twitter http://twitter.com/peterneubauer >&
Re: [Neo4j] Rebuilding Lucene index
Thanks for the link Michael, tried CheckIndex: (1) It solves one problem with some (hopefully) minor losses by removing the corrupted index without having to delete the whole '/index' folder. (2) However, I am not very sure if the tool only deletes the lucene index or also the underlying data the index refers to, as I was not very sure which entry in the database causes the problem It would be quite scary to imagine that some critical data have to be deleted or lose their index in production environment (although the next safety net would be the backups). Perhaps there is still a way to rebuild the whole index? In any case this is already a big step ahead, thanks alot!! Cheers, Rama On Sun, Sep 18, 2011 at 6:02 PM, Peter Neubauer < peter.neuba...@neotechnology.com> wrote: > Rama, > if you have good results with this, please report back and we can put > a link into the docs ... > > Cheers, > > /peter neubauer > > GTalk: neubauer.peter > Skype peter.neubauer > Phone +46 704 106975 > LinkedIn http://www.linkedin.com/in/neubauer > Twitter http://twitter.com/peterneubauer > > http://www.neo4j.org - Your high performance graph database. > http://startupbootcamp.org/- Öresund - Innovation happens HERE. > http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > > > > On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger > wrote: > > Perhaps this helps: > > > > CheckIndex is a tool available in the Lucene library, which allows you to > check the files and create new segments that do not contain problematic > entries. This means that this tool, with little loss of data is able to > repair a broken index. > > > > http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ > > > > > > Michael > > > > Am 18.09.2011 um 17:39 schrieb Mattias Persson: > > > >> I believe it is integrated (correct me if I'm wrong) but there might > still > >> be cases where i kill -9 or power outage might put some lucene files in > a > >> bad state. It's pretty much outside of neo4j's control and is very, very > >> rare. It'd be great to come up with some mechanism to be able to prevent > >> that, but for the time beimg I'm not aware of a way... Maybe there are > tools > >> for repairing a corrupted lucene index out there? > >> > >> Den lördagen den 17:e september 2011 skrev Peter Neubauer< > >> peter.neuba...@neotechnology.com>: > >>> Yes, > >>> messages.log is good, I am just not sure if in neo4j.rb Lucene is > >>> transactionally integrated at all, Andreas? > >>> > >>> Cheers, > >>> > >>> /peter neubauer > >>> > >>> GTalk: neubauer.peter > >>> Skype peter.neubauer > >>> Phone +46 704 106975 > >>> LinkedIn http://www.linkedin.com/in/neubauer > >>> Twitter http://twitter.com/peterneubauer > >>> > >>> http://www.neo4j.org - Your high performance graph > database. > >>> http://startupbootcamp.org/- Öresund - Innovation happens HERE. > >>> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing > party. > >>> > >>> > >>> > >>> On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama < > rama.manus...@gmail.com> > >> wrote: > >>>> Thanks Peter, Andreas, > >>>> > >>>> Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 > as > >>>> server > >>>> > >>>> I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web > >>>> request process that took forever (strangely did not follow the > timeout > >>>> config due to some reason). I should not use kill -9 anymore I guess > >>>> > >>>> I also enclose messages.log if it would be useful/interesting for you > to > >> see > >>>> > >>>> > >>>> Perhaps Andreas could help with how index rebuilding works here? > Thanks > >>>> alot! > >>>> > >>>> Cheers, > >>>> > >>>> Rama > >>>> > >>>> > >>>> > >>>> On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer < > >>>> peter.neuba...@neotechnology.com> wrote: > >>>> > >>>>> Mmh, > >>>>> so what did you do to get the index corrupted? Are you running > >>&g
Re: [Neo4j] Rebuilding Lucene index
Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer < peter.neuba...@neotechnology.com> wrote: > Mmh, > so what did you do to get the index corrupted? Are you running > neo4j.rb? In there, I am not sure that the Lucene index is integrated > into the transactional system like in Neo4j java, so maybe Andreas can > shed some light? > > Cheers, > > /peter neubauer > > GTalk: neubauer.peter > Skype peter.neubauer > Phone +46 704 106975 > LinkedIn http://www.linkedin.com/in/neubauer > Twitter http://twitter.com/peterneubauer > > http://www.neo4j.org - Your high performance graph database. > http://startupbootcamp.org/- Öresund - Innovation happens HERE. > http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > > > > On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama > wrote: > > Hi all, > > > > Sorry for a noobish question, my knowledge in Java is limited so reading > the > > source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and > > neo4j 1.4) > > > > I ran into index corruption due to non-clean shutdown (through kill -9) > and > > could not start the database anymore. Looking to discussions like > > http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I > decided to > > delete the index folder and it was solved. However I still need to > rebuild > > the index and have no clue on how to do this, have looked on the docs and > > cannot really find either. Could anybody please help? > > > > I also posted my question here > > > http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but > > neo4j activities seem to be low in stackoverflow > > > > Thanks all, appreciate your help!, > > > > Rama > > ___ > > Neo4j mailing list > > User@lists.neo4j.org > > https://lists.neo4j.org/mailman/listinfo/user > > > ___ > Neo4j mailing list > User@lists.neo4j.org > https://lists.neo4j.org/mailman/listinfo/user > -- Rama John Gabriel Manusama rama.manus...@gmail.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Rebuilding Lucene index
Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user