Re: [Neo4j] Rebuilding Lucene index
Good, thanks for reporting back Rama! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 23, 2011 at 1:16 AM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Would like to confirm that the problem got somewhat solved after it tried to perform CheckIndex -fix on every lucene index folder. Unfortunately I could not investigate which 'corrupted' index did the tool delete, therefore a 'complete' index rebuilding would be a good last option in this case. Anyway knowing that such tool exist is already a big step ahead. Thanks for everything! Rama On Mon, Sep 19, 2011 at 1:59 AM, Rama Manusama rama.manus...@gmail.comwrote: No problem, you could download it here https://docs.google.com/leaf?id=0B4qYoS7piZ7PNDdhNzkzMWEtMWMyYS00MWNmLWI3YzktYjFiZjllMzk0MzA2hl=en_US Thanks, Rama On Mon, Sep 19, 2011 at 12:32 AM, Michael Hunger michael.hun...@neotechnology.com wrote: Sorry the mailing list eats attachments, can you copy it in the mail or make it available somewhere? Thanks Michael Am 18.09.2011 um 23:32 schrieb Rama Manusama: True, I reproduced the error again just now, messages.log is attached Thanks and cheers, Rama On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson matt...@neotechnology.com wrote: I'm guessing the important stack trace regarding the loading of the lucene index provider is found in my-neo4j-db-folder/messages.log. Could you go look there? 2011/9/18 Rama Manusama rama.manus...@gmail.com Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 ] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at
Re: [Neo4j] Rebuilding Lucene index
Hi all, Would like to confirm that the problem got somewhat solved after it tried to perform CheckIndex -fix on every lucene index folder. Unfortunately I could not investigate which 'corrupted' index did the tool delete, therefore a 'complete' index rebuilding would be a good last option in this case. Anyway knowing that such tool exist is already a big step ahead. Thanks for everything! Rama On Mon, Sep 19, 2011 at 1:59 AM, Rama Manusama rama.manus...@gmail.comwrote: No problem, you could download it here https://docs.google.com/leaf?id=0B4qYoS7piZ7PNDdhNzkzMWEtMWMyYS00MWNmLWI3YzktYjFiZjllMzk0MzA2hl=en_US Thanks, Rama On Mon, Sep 19, 2011 at 12:32 AM, Michael Hunger michael.hun...@neotechnology.com wrote: Sorry the mailing list eats attachments, can you copy it in the mail or make it available somewhere? Thanks Michael Am 18.09.2011 um 23:32 schrieb Rama Manusama: True, I reproduced the error again just now, messages.log is attached Thanks and cheers, Rama On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson matt...@neotechnology.com wrote: I'm guessing the important stack trace regarding the loading of the lucene index provider is found in my-neo4j-db-folder/messages.log. Could you go look there? 2011/9/18 Rama Manusama rama.manus...@gmail.com Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 ] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:119) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) at
Re: [Neo4j] Rebuilding Lucene index
I believe it is integrated (correct me if I'm wrong) but there might still be cases where i kill -9 or power outage might put some lucene files in a bad state. It's pretty much outside of neo4j's control and is very, very rare. It'd be great to come up with some mechanism to be able to prevent that, but for the time beimg I'm not aware of a way... Maybe there are tools for repairing a corrupted lucene index out there? Den lördagen den 17:e september 2011 skrev Peter Neubauer peter.neuba...@neotechnology.com: Yes, messages.log is good, I am just not sure if in neo4j.rb Lucene is transactionally integrated at all, Andreas? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama rama.manus...@gmail.com wrote: Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmh, so what did you do to get the index corrupted? Are you running neo4j.rb? In there, I am not sure that the Lucene index is integrated into the transactional system like in Neo4j java, so maybe Andreas can shed some light? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Rama John Gabriel Manusama -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Rebuilding Lucene index
Rama, if you have good results with this, please report back and we can put a link into the docs ... Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger michael.hun...@neotechnology.com wrote: Perhaps this helps: CheckIndex is a tool available in the Lucene library, which allows you to check the files and create new segments that do not contain problematic entries. This means that this tool, with little loss of data is able to repair a broken index. http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ Michael Am 18.09.2011 um 17:39 schrieb Mattias Persson: I believe it is integrated (correct me if I'm wrong) but there might still be cases where i kill -9 or power outage might put some lucene files in a bad state. It's pretty much outside of neo4j's control and is very, very rare. It'd be great to come up with some mechanism to be able to prevent that, but for the time beimg I'm not aware of a way... Maybe there are tools for repairing a corrupted lucene index out there? Den lördagen den 17:e september 2011 skrev Peter Neubauer peter.neuba...@neotechnology.com: Yes, messages.log is good, I am just not sure if in neo4j.rb Lucene is transactionally integrated at all, Andreas? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama rama.manus...@gmail.com wrote: Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmh, so what did you do to get the index corrupted? Are you running neo4j.rb? In there, I am not sure that the Lucene index is integrated into the transactional system like in Neo4j java, so maybe Andreas can shed some light? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Rama John Gabriel Manusama -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org
Re: [Neo4j] Rebuilding Lucene index
Sorry apparently I made a mistake, the index that I fixed was a dir that I copied outside the app directory.. The 'new' database with index dir emptied certainly works, as it has no index on the data Once I copied back the repaired /index folder, it still show the same error message Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) So far the only way to get the database accessible is only by removing the index folder. Cheers, Rama On Sun, Sep 18, 2011 at 9:36 PM, Rama Manusama rama.manus...@gmail.comwrote: Thanks for the link Michael, tried CheckIndex: (1) It solves one problem with some (hopefully) minor losses by removing the corrupted index without having to delete the whole '/index' folder. (2) However, I am not very sure if the tool only deletes the lucene index or also the underlying data the index refers to, as I was not very sure which entry in the database causes the problem It would be quite scary to imagine that some critical data have to be deleted or lose their index in production environment (although the next safety net would be the backups). Perhaps there is still a way to rebuild the whole index? In any case this is already a big step ahead, thanks alot!! Cheers, Rama On Sun, Sep 18, 2011 at 6:02 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Rama, if you have good results with this, please report back and we can put a link into the docs ... Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger michael.hun...@neotechnology.com wrote: Perhaps this helps: CheckIndex is a tool available in the Lucene library, which allows you to check the files and create new segments that do not contain problematic entries. This means that this tool, with little loss of data is able to repair a broken index. http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ Michael Am 18.09.2011 um 17:39 schrieb Mattias Persson: I believe it is integrated (correct me if I'm wrong) but there might still be cases where i kill -9 or power outage might put some lucene files in a bad state. It's pretty much outside of neo4j's control and is very, very rare. It'd be great to come up with some mechanism to be able to prevent that, but for the time beimg I'm not aware of a way... Maybe there are tools for repairing a corrupted lucene index out there? Den lördagen den 17:e september 2011 skrev Peter Neubauer peter.neuba...@neotechnology.com: Yes, messages.log is good, I am just not sure if in neo4j.rb Lucene is transactionally integrated at all, Andreas? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama rama.manus...@gmail.com wrote: Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer
Re: [Neo4j] Rebuilding Lucene index
Do you have more of that stack-trace? Michael Am 18.09.2011 um 21:42 schrieb Rama Manusama: Sorry apparently I made a mistake, the index that I fixed was a dir that I copied outside the app directory.. The 'new' database with index dir emptied certainly works, as it has no index on the data Once I copied back the repaired /index folder, it still show the same error message Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) So far the only way to get the database accessible is only by removing the index folder. Cheers, Rama On Sun, Sep 18, 2011 at 9:36 PM, Rama Manusama rama.manus...@gmail.comwrote: Thanks for the link Michael, tried CheckIndex: (1) It solves one problem with some (hopefully) minor losses by removing the corrupted index without having to delete the whole '/index' folder. (2) However, I am not very sure if the tool only deletes the lucene index or also the underlying data the index refers to, as I was not very sure which entry in the database causes the problem It would be quite scary to imagine that some critical data have to be deleted or lose their index in production environment (although the next safety net would be the backups). Perhaps there is still a way to rebuild the whole index? In any case this is already a big step ahead, thanks alot!! Cheers, Rama On Sun, Sep 18, 2011 at 6:02 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Rama, if you have good results with this, please report back and we can put a link into the docs ... Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sun, Sep 18, 2011 at 5:57 PM, Michael Hunger michael.hun...@neotechnology.com wrote: Perhaps this helps: CheckIndex is a tool available in the Lucene library, which allows you to check the files and create new segments that do not contain problematic entries. This means that this tool, with little loss of data is able to repair a broken index. http://solr.pl/en/2011/01/17/checkindex-for-the-rescue/ Michael Am 18.09.2011 um 17:39 schrieb Mattias Persson: I believe it is integrated (correct me if I'm wrong) but there might still be cases where i kill -9 or power outage might put some lucene files in a bad state. It's pretty much outside of neo4j's control and is very, very rare. It'd be great to come up with some mechanism to be able to prevent that, but for the time beimg I'm not aware of a way... Maybe there are tools for repairing a corrupted lucene index out there? Den lördagen den 17:e september 2011 skrev Peter Neubauer peter.neuba...@neotechnology.com: Yes, messages.log is good, I am just not sure if in neo4j.rb Lucene is transactionally integrated at all, Andreas? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama rama.manus...@gmail.com wrote: Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks
Re: [Neo4j] Rebuilding Lucene index
Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:119) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374) at org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:328) at org.jruby.runtime.BlockBody.call(BlockBody.java:73) at org.jruby.runtime.Block.call(Block.java:89) at org.jruby.RubyProc.call(RubyProc.java:274) at org.jruby.internal.runtime.methods.ProcMethod.call(ProcMethod.java:64) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:203) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:199) at org.jruby.internal.runtime.methods.AliasMethod.call(AliasMethod.java:56) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at
Re: [Neo4j] Rebuilding Lucene index
Probably this part is interesting: Unable to close logical log java.io.IOException: Logical log[/home/rama/wspace/criticube/db/nioneo_logical.log.1] not found at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.deleteCurrentLogFile(XaLogicalLog.java:646) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.close(XaLogicalLog.java:704) at org.neo4j.kernel.impl.transaction.xaframework.XaContainer.close(XaContainer.java:109) at org.neo4j.kernel.impl.nioneo.xa.NeoStoreXaDataSource.close(NeoStoreXaDataSource.java:250) at org.neo4j.kernel.impl.nioneo.xa.NioNeoDbPersistenceSource.stop(NioNeoDbPersistenceSource.java:69) at org.neo4j.kernel.GraphDbInstance.shutdown(GraphDbInstance.java:293) .. NativeException: org.neo4j.graphdb.TransactionFailureException: Unable to commit transaction from org/neo4j/kernel/TopLevelTransaction.java:98:in `finish' Am 18.09.2011 um 23:14 schrieb Mattias Persson: I'm guessing the important stack trace regarding the loading of the lucene index provider is found in my-neo4j-db-folder/messages.log. Could you go look there? 2011/9/18 Rama Manusama rama.manus...@gmail.com Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 ] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:119) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153) at
Re: [Neo4j] Rebuilding Lucene index
True, I reproduced the error again just now, messages.log is attached Thanks and cheers, Rama On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson matt...@neotechnology.com wrote: I'm guessing the important stack trace regarding the loading of the lucene index provider is found in my-neo4j-db-folder/messages.log. Could you go look there? 2011/9/18 Rama Manusama rama.manus...@gmail.com Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 ] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:119) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.InterpretedBlock.evalBlockBody(InterpretedBlock.java:374) at org.jruby.runtime.InterpretedBlock.yield(InterpretedBlock.java:328) at org.jruby.runtime.BlockBody.call(BlockBody.java:73) at org.jruby.runtime.Block.call(Block.java:89) at org.jruby.RubyProc.call(RubyProc.java:274) at org.jruby.internal.runtime.methods.ProcMethod.call(ProcMethod.java:64)
Re: [Neo4j] Rebuilding Lucene index
No problem, you could download it here https://docs.google.com/leaf?id=0B4qYoS7piZ7PNDdhNzkzMWEtMWMyYS00MWNmLWI3YzktYjFiZjllMzk0MzA2hl=en_US Thanks, Rama On Mon, Sep 19, 2011 at 12:32 AM, Michael Hunger michael.hun...@neotechnology.com wrote: Sorry the mailing list eats attachments, can you copy it in the mail or make it available somewhere? Thanks Michael Am 18.09.2011 um 23:32 schrieb Rama Manusama: True, I reproduced the error again just now, messages.log is attached Thanks and cheers, Rama On Sun, Sep 18, 2011 at 11:14 PM, Mattias Persson matt...@neotechnology.com wrote: I'm guessing the important stack trace regarding the loading of the lucene index provider is found in my-neo4j-db-folder/messages.log. Could you go look there? 2011/9/18 Rama Manusama rama.manus...@gmail.com Hi Michael, Sure, here you go, thanks! Sep 18, 2011 9:37:39 PM org.neo4j.kernel.impl.transaction.TransactionImpl doBeforeCompletion WARNING: Caught exception from tx syncronization[org.neo4j.kernel.impl.core.TransactionEventsSyncHook@1531a989 ] beforeCompletion() java.lang.RuntimeException: org.jruby.exceptions.RaiseException: Native Exception: 'class java.lang.IllegalArgumentException'; Message: No index provider 'lucene' found; StackTrace: java.lang.IllegalArgumentException: No index provider 'lucene' found at org.neo4j.kernel.IndexManagerImpl.getIndexProvider(IndexManagerImpl.java:76) at org.neo4j.kernel.IndexManagerImpl.findIndexConfig(IndexManagerImpl.java:116) at org.neo4j.kernel.IndexManagerImpl.getOrCreateIndexConfig(IndexManagerImpl.java:178) at org.neo4j.kernel.IndexManagerImpl.getOrCreateNodeIndex(IndexManagerImpl.java:267) at org.neo4j.kernel.IndexManagerImpl.forNodes(IndexManagerImpl.java:255) at org.neo4j.kernel.impl.core.TransactionEventsSyncHook.beforeCompletion(TransactionEventsSyncHook.java:95) at org.neo4j.kernel.impl.transaction.TransactionImpl.doBeforeCompletion(TransactionImpl.java:356) at org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:635) at org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:109) at org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:508) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:368) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:50) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:63) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:147) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:163) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:292) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:135) at org.jruby.ast.VCallNode.interpret(VCallNode.java:86) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:98) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:119) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:75) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:169) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:171) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:302) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:144) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:153) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:104) at
Re: [Neo4j] Rebuilding Lucene index
Yes, messages.log is good, I am just not sure if in neo4j.rb Lucene is transactionally integrated at all, Andreas? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:34 PM, Rama Manusama rama.manus...@gmail.com wrote: Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmh, so what did you do to get the index corrupted? Are you running neo4j.rb? In there, I am not sure that the Lucene index is integrated into the transactional system like in Neo4j java, so maybe Andreas can shed some light? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Rama John Gabriel Manusama rama.manus...@gmail.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Rebuilding Lucene index
Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Rebuilding Lucene index
Mmh, so what did you do to get the index corrupted? Are you running neo4j.rb? In there, I am not sure that the Lucene index is integrated into the transactional system like in Neo4j java, so maybe Andreas can shed some light? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/ - Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Rebuilding Lucene index
Thanks Peter, Andreas, Yes I am running neo4j.rb with the newest version, and torquebox 1.1.1 as server I had a non-clean shutdown through ' kill -9 ' due to a Mechanize web request process that took forever (strangely did not follow the timeout config due to some reason). I should not use kill -9 anymore I guess I also enclose messages.log if it would be useful/interesting for you to see Perhaps Andreas could help with how index rebuilding works here? Thanks alot! Cheers, Rama On Fri, Sep 16, 2011 at 7:18 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Mmh, so what did you do to get the index corrupted? Are you running neo4j.rb? In there, I am not sure that the Lucene index is integrated into the transactional system like in Neo4j java, so maybe Andreas can shed some light? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://startupbootcamp.org/- Öresund - Innovation happens HERE. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Sep 16, 2011 at 7:14 PM, Rama Manusama rama.manus...@gmail.com wrote: Hi all, Sorry for a noobish question, my knowledge in Java is limited so reading the source is kinda difficult for me (I use neo4j.rb ruby binding v1.2.2 and neo4j 1.4) I ran into index corruption due to non-clean shutdown (through kill -9) and could not start the database anymore. Looking to discussions like http://www.mail-archive.com/user@lists.neo4j.org/msg06100.html, I decided to delete the index folder and it was solved. However I still need to rebuild the index and have no clue on how to do this, have looked on the docs and cannot really find either. Could anybody please help? I also posted my question here http://stackoverflow.com/questions/7440244/how-to-rebuild-neo4j-lucene-index-neo4j-rb,but neo4j activities seem to be low in stackoverflow Thanks all, appreciate your help!, Rama ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Rama John Gabriel Manusama rama.manus...@gmail.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
