Re: [Neo4j] OnlineBackup component being upgraded (WasRe: Unrecovable transaction error)
Thanks to all, Peter and Mattias !! We will try soon !!! Cheers. On Wed, Feb 9, 2011 at 8:31 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: And the test code has moved here: https://github.com/neo4j/graphdb/blob/master/com/src/main/java/org/neo4j/com/backup/OnlineBackup.java /peter On Wed, Feb 9, 2011 at 8:01 PM, Mattias Persson matt...@neotechnology.com wrote: 2011/2/9 Gian Luca Farina Perseu farinaper...@gmail.com Thank you Peter ! Message for Mattias: the link you provided https://github.com/neo4j/graphdb/blob/master/backup/src/main/java/org/neo4j/backup/OnlineBackup.java return 404 :-( In any case, if you say that this weekend this component will be integrated into milestone ... I can wait for it ;-) Exactly, it won't require HA... you can do it off of a normal EmbeddedGraphDatabase. With this next milestone there'll be a (at the least) decent documentation about how to use the new and great backup utility. Thank you very much ! Cheers. On Wed, Feb 9, 2011 at 6:11 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian, no, the message is that the new Online Backup component is using the same communication protocols as HA, but does not require HA and ZooKeeper to be set up. So, using the code Mattias pointed out, you should be able to back up a running embedded 1.3 Neo4j DB out of the 1.3 box. The next milestone will hopefully include this code (due this week). So, even without HA setup, the Online Backup can be used to do both full and incremental backups. If you have questions, feel free to ask more! /peter On Wed, Feb 9, 2011 at 5:53 PM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Sorry for delay in response, but I follow older thread and I miss this response :-( Peter, yes I was using 1.2 M2 with Neo4jBackup class for onlinebackup BUT the (previous indicated) bug obligate me to run on latest 1.3. I tried to use 1.2 after db recovery but the error (nullPointer on lucene) persist and now it's running all the day without issue. I have some users that are heavly inserting data into the DB in this phase I need to create periodical backups without stop the server. Keep in mind, I'm using embedded server without any remote interface !! So, I don't understand your response (and Mattias also) is the online backup feature ONLY available in High Availability logic ? So, how can I provide online backup without High Availability ? At the moment I cannot use 1.2, I need to run on 1.3 but 1.3 does not provide onlinebackup :-(( Any advice ? Thanks ! Gianluca Farina Perseu skype: farinaperseu On Wed, Feb 9, 2011 at 9:09 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian and all, we are moving the OnlineBackup component onto the Hich Availability logic. It will be included into Neo4j 1.3, but we didn't move the OnlineBackup Component over to GITHub, so for the time being, it is not included in the milestone releases. Gian, are you actively using OnlineBackup? Let's connect and sort out how to best move! If you are using the component, please consider staying on 1.2 or contact us so we can solve your usecase while we are on milestones, if you need it. Thanks for your consideration! /peter On Wed, Feb 9, 2011 at 8:00 AM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Starting from now I'll try to use M3 but with this release I have this error related to java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup I didn't check yet in documentation (I'm involved in some other topics ...) . Neo4jBackup is simply missing from build or backup management is different from M2 ? Many thanks !! -- [INFO] BaseResource - 2011.02.09 08:00:02 - ServiceResource Constructor. [INFO] TimeoutHandler - Time: Wed Feb 09 08:00:02 CET 2011 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup\nioneo_logical.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[online backup] extension:org.neo4j.graphdb.index.IndexProvider[lucene] 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [C:\temp\graphdb\neo4j_online_backup\index/lucene.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[kernel jmx] extension:org.neo4j.kernel.KernelExtension[shell] extension:org.neo4j.kernel.KernelExtension[kernel udc] 9-feb-2011 8.00.02 com.sun.jersey.spi.container.ContainerResponse mapMappableContainerException GRAVE: The exception contained within MappableContainerException could not be mapped to a response, re-throwing to the H TTP container java.lang.NoClassDefFoundError: org
Re: [Neo4j] OnlineBackup component being upgraded (WasRe: Unrecovable transaction error)
Sorry for delay in response, but I follow older thread and I miss this response :-( Peter, yes I was using 1.2 M2 with Neo4jBackup class for onlinebackup BUT the (previous indicated) bug obligate me to run on latest 1.3. I tried to use 1.2 after db recovery but the error (nullPointer on lucene) persist and now it's running all the day without issue. I have some users that are heavly inserting data into the DB in this phase I need to create periodical backups without stop the server. Keep in mind, I'm using embedded server without any remote interface !! So, I don't understand your response (and Mattias also) is the online backup feature ONLY available in High Availability logic ? So, how can I provide online backup without High Availability ? At the moment I cannot use 1.2, I need to run on 1.3 but 1.3 does not provide onlinebackup :-(( Any advice ? Thanks ! Gianluca Farina Perseu skype: farinaperseu On Wed, Feb 9, 2011 at 9:09 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian and all, we are moving the OnlineBackup component onto the Hich Availability logic. It will be included into Neo4j 1.3, but we didn't move the OnlineBackup Component over to GITHub, so for the time being, it is not included in the milestone releases. Gian, are you actively using OnlineBackup? Let's connect and sort out how to best move! If you are using the component, please consider staying on 1.2 or contact us so we can solve your usecase while we are on milestones, if you need it. Thanks for your consideration! /peter On Wed, Feb 9, 2011 at 8:00 AM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Starting from now I'll try to use M3 but with this release I have this error related to java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup I didn't check yet in documentation (I'm involved in some other topics ...) . Neo4jBackup is simply missing from build or backup management is different from M2 ? Many thanks !! -- [INFO] BaseResource - 2011.02.09 08:00:02 - ServiceResource Constructor. [INFO] TimeoutHandler - Time: Wed Feb 09 08:00:02 CET 2011 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup\nioneo_logical.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[online backup] extension:org.neo4j.graphdb.index.IndexProvider[lucene] 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [C:\temp\graphdb\neo4j_online_backup\index/lucene.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[kernel jmx] extension:org.neo4j.kernel.KernelExtension[shell] extension:org.neo4j.kernel.KernelExtension[kernel udc] 9-feb-2011 8.00.02 com.sun.jersey.spi.container.ContainerResponse mapMappableContainerException GRAVE: The exception contained within MappableContainerException could not be mapped to a response, re-throwing to the H TTP container java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup at com.twentyonestyle.mt.service.BackupManager.doBackup(BackupManager.java:63) at com.twentyonestyle.mt.rest.app.resource.ServiceResource.doBackup(ServiceResource.java:535) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispa tch(AbstractResourceMethodDispatchProvider.java:168) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDisp atcher.java:70) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:279) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:136) at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:86) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:136) at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:74) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1357) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1289) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1239) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1229
Re: [Neo4j] OnlineBackup component being upgraded (WasRe: Unrecovable transaction error)
Thank you Peter ! Message for Mattias: the link you provided https://github.com/neo4j/graphdb/blob/master/backup/src/main/java/org/neo4j/backup/OnlineBackup.java return 404 :-( In any case, if you say that this weekend this component will be integrated into milestone ... I can wait for it ;-) Thank you very much ! Cheers. On Wed, Feb 9, 2011 at 6:11 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian, no, the message is that the new Online Backup component is using the same communication protocols as HA, but does not require HA and ZooKeeper to be set up. So, using the code Mattias pointed out, you should be able to back up a running embedded 1.3 Neo4j DB out of the 1.3 box. The next milestone will hopefully include this code (due this week). So, even without HA setup, the Online Backup can be used to do both full and incremental backups. If you have questions, feel free to ask more! /peter On Wed, Feb 9, 2011 at 5:53 PM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Sorry for delay in response, but I follow older thread and I miss this response :-( Peter, yes I was using 1.2 M2 with Neo4jBackup class for onlinebackup BUT the (previous indicated) bug obligate me to run on latest 1.3. I tried to use 1.2 after db recovery but the error (nullPointer on lucene) persist and now it's running all the day without issue. I have some users that are heavly inserting data into the DB in this phase I need to create periodical backups without stop the server. Keep in mind, I'm using embedded server without any remote interface !! So, I don't understand your response (and Mattias also) is the online backup feature ONLY available in High Availability logic ? So, how can I provide online backup without High Availability ? At the moment I cannot use 1.2, I need to run on 1.3 but 1.3 does not provide onlinebackup :-(( Any advice ? Thanks ! Gianluca Farina Perseu skype: farinaperseu On Wed, Feb 9, 2011 at 9:09 AM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian and all, we are moving the OnlineBackup component onto the Hich Availability logic. It will be included into Neo4j 1.3, but we didn't move the OnlineBackup Component over to GITHub, so for the time being, it is not included in the milestone releases. Gian, are you actively using OnlineBackup? Let's connect and sort out how to best move! If you are using the component, please consider staying on 1.2 or contact us so we can solve your usecase while we are on milestones, if you need it. Thanks for your consideration! /peter On Wed, Feb 9, 2011 at 8:00 AM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Starting from now I'll try to use M3 but with this release I have this error related to java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup I didn't check yet in documentation (I'm involved in some other topics ...) . Neo4jBackup is simply missing from build or backup management is different from M2 ? Many thanks !! -- [INFO] BaseResource - 2011.02.09 08:00:02 - ServiceResource Constructor. [INFO] TimeoutHandler - Time: Wed Feb 09 08:00:02 CET 2011 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup\nioneo_logical.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[online backup] extension:org.neo4j.graphdb.index.IndexProvider[lucene] 9-feb-2011 8.00.02 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [C:\temp\graphdb\neo4j_online_backup\index/lucene.log.1]. Recovery started ... extension:org.neo4j.kernel.KernelExtension[kernel jmx] extension:org.neo4j.kernel.KernelExtension[shell] extension:org.neo4j.kernel.KernelExtension[kernel udc] 9-feb-2011 8.00.02 com.sun.jersey.spi.container.ContainerResponse mapMappableContainerException GRAVE: The exception contained within MappableContainerException could not be mapped to a response, re-throwing to the H TTP container java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup at com.twentyonestyle.mt.service.BackupManager.doBackup(BackupManager.java:63) at com.twentyonestyle.mt.rest.app.resource.ServiceResource.doBackup(ServiceResource.java:535) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispa tch(AbstractResourceMethodDispatchProvider.java:168) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch
Re: [Neo4j] Unrecovable transaction error
Hi Mattias, some minutes ago, I use M3 release to recover another failured DB due transactions error. My application still use M2 as previously described, I change on the fly M3 libs to recover the DB. All seems to work well. Then I replace M3 libs with originals M2 because I tried to use Backup feature and I receive an NotClassFound. But with M2, when I launch backup I receive this error: [INFO] TimeoutHandler - Time: Tue Feb 08 17:31:37 CET 2011 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup\nioneo_logical.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup/lucene/lucene.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup/lucene-fulltext/lucene.log.1]. Recovery star ted ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [C:\temp\graphdb\neo4j_online_backup\index/lucene.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.onlinebackup.Neo4jBackup doBackup INFO: Initializing backup. 8-feb-2011 17.31.37 org.neo4j.onlinebackup.Neo4jBackup runMultiBackup INFO: Checking and preparing [lucene-index, lucene, nioneodb, lucene-fulltext] data sources. java.lang.NullPointerException at org.neo4j.index.impl.lucene.IndexType$CustomType.removeFromDocument(IndexType.java:155) at org.neo4j.index.impl.lucene.LuceneCommand$RemoveCommand.perform(LuceneCommand.java:228) at org.neo4j.index.impl.lucene.LuceneTransaction.doCommit(LuceneTransaction.java:227) at org.neo4j.kernel.impl.transaction.xaframework.XaTransaction.commit(XaTransaction.java:319) at org.neo4j.kernel.impl.transaction.xaframework.XaResourceManager.injectTwoPhaseCommit(XaResourceManager.java:3 73) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyTwoPhaseCommitEntry(XaLogicalLog.java:574) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyEntry(XaLogicalLog.java:466) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.access$200(XaLogicalLog.java:67) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog$LogApplier.readAndApplyEntry(XaLogicalLog.java:125 9) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyLog(XaLogicalLog.java:1316) at org.neo4j.kernel.impl.transaction.xaframework.LogBackedXaDataSource.applyLog(LogBackedXaDataSource.java:55) at org.neo4j.onlinebackup.impl.AbstractResource.applyLog(AbstractResource.java:44) at org.neo4j.onlinebackup.Neo4jBackup$Neo4jBackupTask.run(Neo4jBackup.java:428) at org.neo4j.onlinebackup.Neo4jBackup.runMultiBackup(Neo4jBackup.java:313) at org.neo4j.onlinebackup.Neo4jBackup.doBackup(Neo4jBackup.java:240) at com.twentyonestyle.mt.service.BackupManager.doBackup(BackupManager.java:65) at com.twentyonestyle.mt.rest.app.resource.ServiceResource.doBackup(ServiceResource.java:535) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispa tch(AbstractResourceMethodDispatchProvider.java:168) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDisp atcher.java:70) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:279) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:136) at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:86) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:136) at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:74) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1357) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1289) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1239) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1229) at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:420) at
Re: [Neo4j] Unrecovable transaction error
by: java.lang.ClassNotFoundException: org.neo4j.onlinebackup.Neo4jBackup at java.net.URLClassLoader$1.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) ... 40 more On Tue, Feb 8, 2011 at 8:13 PM, Mattias Persson matt...@neotechnology.com wrote: The error you're getting is the exact same error. Recovery and incremental backup in essence uses the same functionality under the covers. You probably won't get that error with the latest builds. Great that the new builds fixed it b.t.w! 2011/2/8 Gian Luca Farina Perseu farinaper...@gmail.com Hi Mattias, some minutes ago, I use M3 release to recover another failured DB due transactions error. My application still use M2 as previously described, I change on the fly M3 libs to recover the DB. All seems to work well. Then I replace M3 libs with originals M2 because I tried to use Backup feature and I receive an NotClassFound. But with M2, when I launch backup I receive this error: [INFO] TimeoutHandler - Time: Tue Feb 08 17:31:37 CET 2011 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup\nioneo_logical.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup/lucene/lucene.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [\temp\graphdb\neo4j_online_backup/lucene-fulltext/lucene.log.1]. Recovery star ted ... 8-feb-2011 17.31.37 org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog doInternalRecovery INFO: Non clean shutdown detected on log [C:\temp\graphdb\neo4j_online_backup\index/lucene.log.1]. Recovery started ... 8-feb-2011 17.31.37 org.neo4j.onlinebackup.Neo4jBackup doBackup INFO: Initializing backup. 8-feb-2011 17.31.37 org.neo4j.onlinebackup.Neo4jBackup runMultiBackup INFO: Checking and preparing [lucene-index, lucene, nioneodb, lucene-fulltext] data sources. java.lang.NullPointerException at org.neo4j.index.impl.lucene.IndexType$CustomType.removeFromDocument(IndexType.java:155) at org.neo4j.index.impl.lucene.LuceneCommand$RemoveCommand.perform(LuceneCommand.java:228) at org.neo4j.index.impl.lucene.LuceneTransaction.doCommit(LuceneTransaction.java:227) at org.neo4j.kernel.impl.transaction.xaframework.XaTransaction.commit(XaTransaction.java:319) at org.neo4j.kernel.impl.transaction.xaframework.XaResourceManager.injectTwoPhaseCommit(XaResourceManager.java:3 73) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyTwoPhaseCommitEntry(XaLogicalLog.java:574) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyEntry(XaLogicalLog.java:466) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.access$200(XaLogicalLog.java:67) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog$LogApplier.readAndApplyEntry(XaLogicalLog.java:125 9) at org.neo4j.kernel.impl.transaction.xaframework.XaLogicalLog.applyLog(XaLogicalLog.java:1316) at org.neo4j.kernel.impl.transaction.xaframework.LogBackedXaDataSource.applyLog(LogBackedXaDataSource.java:55) at org.neo4j.onlinebackup.impl.AbstractResource.applyLog(AbstractResource.java:44) at org.neo4j.onlinebackup.Neo4jBackup$Neo4jBackupTask.run(Neo4jBackup.java:428) at org.neo4j.onlinebackup.Neo4jBackup.runMultiBackup(Neo4jBackup.java:313) at org.neo4j.onlinebackup.Neo4jBackup.doBackup(Neo4jBackup.java:240) at com.twentyonestyle.mt.service.BackupManager.doBackup(BackupManager.java:65) at com.twentyonestyle.mt.rest.app.resource.ServiceResource.doBackup(ServiceResource.java:535) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispa tch(AbstractResourceMethodDispatchProvider.java:168) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDisp atcher.java:70) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:279) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java
Re: [Neo4j] Unrecovable transaction error
Hi Mattias, I'll send you in next minutes, in your personal email, the log required. Regards. Gian Luca On Sun, Jan 30, 2011 at 8:11 PM, Mattias Persson matt...@neotechnology.com wrote: Hi Gian, could you please supply the contents of messages.log found in your neo4j database directory? It seems like the indexing jar files are missing or fails to load at the time of recovery. The messages.log file can give hints about the problem. 2011/1/29 Gian Luca Farina Perseu farinaper...@gmail.com Hi to all, we recently (for 2nd time) engaged a transaction error using neo4j embedded. We need to investigate well about this error origin, BUT I need to understand how to resolve the following error: java.lang.RuntimeException: No mapping found for branchId[0x162374] The steps: 1) two users work on the application 2) one user receive a transaction error (sorry, not traced .. maybe an error on begin transaction) 3) shutting down the server (as usual) 4) restarting the server 5) receiving the error: java.lang.RuntimeException: No mapping found for branchId[0x162374] at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:58) at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:31) .. Caused by: org.neo4j.graphdb.TransactionFailureException: No mapping found for branchId[0x162374] at org.neo4j.kernel.impl.transaction.XaDataSourceManager.getXaResource(XaDataSourceManager.java:186) at org.neo4j.kernel.impl.transaction.TxManager.getXaResource(TxManager.java:933) at org.neo4j.kernel.impl.transaction.TxManager.buildRecoveryInfo(TxManager.java:414) at org.neo4j.kernel.impl.transaction.TxManager.recover(TxManager.java:255) at org.neo4j.kernel.impl.transaction.TxManager.init(TxManager.java:181) at org.neo4j.kernel.impl.transaction.TxModule.start(TxModule.java:85) at org.neo4j.kernel.GraphDbInstance.start(GraphDbInstance.java:156) at org.neo4j.kernel.EmbeddedGraphDbImpl.init(EmbeddedGraphDbImpl.java:167) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:81) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:65) at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:41) ... 7 more We are (still) working on Neo4j 1.2M04 thru Blueprints. I dont want to understand (in this help request) why and where I create the transaction error (maybe a not well closed transaction or other) but I need to understand HOW TO RECOVER a DB that generate the error at point 5 THAT DOES NOT START ANYMORE. :-( Thank you for your support ! Regards ! Gian Luca Farina Perseu Torino - Italy ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user -- Mattias Persson, [matt...@neotechnology.com] Hacker, Neo Technology www.neotechnology.com ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
[Neo4j] Unrecovable transaction error
Hi to all, we recently (for 2nd time) engaged a transaction error using neo4j embedded. We need to investigate well about this error origin, BUT I need to understand how to resolve the following error: java.lang.RuntimeException: No mapping found for branchId[0x162374] The steps: 1) two users work on the application 2) one user receive a transaction error (sorry, not traced .. maybe an error on begin transaction) 3) shutting down the server (as usual) 4) restarting the server 5) receiving the error: java.lang.RuntimeException: No mapping found for branchId[0x162374] at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:58) at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:31) .. Caused by: org.neo4j.graphdb.TransactionFailureException: No mapping found for branchId[0x162374] at org.neo4j.kernel.impl.transaction.XaDataSourceManager.getXaResource(XaDataSourceManager.java:186) at org.neo4j.kernel.impl.transaction.TxManager.getXaResource(TxManager.java:933) at org.neo4j.kernel.impl.transaction.TxManager.buildRecoveryInfo(TxManager.java:414) at org.neo4j.kernel.impl.transaction.TxManager.recover(TxManager.java:255) at org.neo4j.kernel.impl.transaction.TxManager.init(TxManager.java:181) at org.neo4j.kernel.impl.transaction.TxModule.start(TxModule.java:85) at org.neo4j.kernel.GraphDbInstance.start(GraphDbInstance.java:156) at org.neo4j.kernel.EmbeddedGraphDbImpl.init(EmbeddedGraphDbImpl.java:167) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:81) at org.neo4j.kernel.EmbeddedGraphDatabase.init(EmbeddedGraphDatabase.java:65) at com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph.init(Neo4jGraph.java:41) ... 7 more We are (still) working on Neo4j 1.2M04 thru Blueprints. I dont want to understand (in this help request) why and where I create the transaction error (maybe a not well closed transaction or other) but I need to understand HOW TO RECOVER a DB that generate the error at point 5 THAT DOES NOT START ANYMORE. :-( Thank you for your support ! Regards ! Gian Luca Farina Perseu Torino - Italy ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Neo4j 1.2 is released
That's great ! A Happy New Year to all the Neo4j team members ! Gian Luca Farina Perseu 21Style / www.21-style.com On Thu, Dec 30, 2010 at 10:30 PM, Tobias Ivarsson tobias.ivars...@neotechnology.com wrote: Happy new year — happy new Neo4j version! The Neo4j team is happy to announce version 1.2 of the Neo4j graph database. Building on the line of milestone releases of Neo4j, version 1.2 contains only a few minor bug fixes over 1.2.M06, and should be very stable. The official announcement has been posted here: http://www.dzone.com/links/neo4j_12_final_prtporter.html If you like this version, please vote for the article on DZone, and share the link with your friends and colleagues. We would like to thank everyone on this mailing list, and all of our customers, who provided the bug reports, feedback, suggestions and patches that made this release what it is. You've already given us a lot of great ideas for the road ahead, but keep them coming, let's make Neo4j even better together! Your next stop, for downloading this version of Neo4j, is: http://neo4j.org/download The main new features in Neo4j 1.2 compared to Neo4j 1.1 are: * The Neo4j Server The Neo4j standalone server builds upon the RESTful API that was pre-released for Neo4j 1.1. The server provides a complete stand alone Neo4j graph database experience, making it easy to access Neo4j from any programming language or platform. Some of you have already provided great client libraries for languages such as Python, Ruby, PHP, the .Net stack and more. Links and further information about client libraries can be found at: http://www.delicious.com/neo4j/drivers * Neo4j High Availability The High Availability feature of Neo4j provides an easy way to set up a cluster of graph databases. This allows for read scalability and tolerates faults in any of the participating machines. Writes are allowed to any machine, but are synchronized with a slight delay across all of them. High Availability in Neo4j is still in quite an early stage of its evolution and thus still have a few limitations. While it provides scalability for read load, write operations are slightly slower. Adding new machines to a cluster still requires some manual work, and very large transactions cannot be transmitted across machines. These limitations will be addressed in the next version of Neo4j. Some other noteworthy changes include: * Additional services for the Neo4j kernel can now be loaded during startup, or injected into a running instance. Examples of such additional services are the Neo4j shell server and the Neo4j management interface. * Memory footprint and read performance has been improved. * A new cache implementation has been added for high load, low latency workloads. * A new index API has been added that is more tightly integrated with the database. This new index API supports indexing relationships as well as nodes, and also supports indexing and querying multiple properties for each node or relationship. The old index API has been deprecated but remains available and will continue to receive bug fixes for a while. * The Neo4j shell supports performing path algorithm queries. * Built in automatic feedback to improve future versions of Neo4j. See: http://blog.neo4j.org/2010/10/announcing-neo4j-12m01-and-focus-on.html Last but not least all known issues have been fixed. If you want more details, please read the change log and/or the announcements for the previous milestone releases. Happy hacking, and a happy new year 2011! - the Neo4j team, through -- Tobias Ivarsson tobias.ivars...@neotechnology.com Hacker, Neo Technology www.neotechnology.com Cellphone: +46 706 534857 ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] neo4j and GeoServer
Thanks Craig for all your informations I'll analize in deep in next days :-) Thank you very much! Gianluca On Sun, Dec 5, 2010 at 11:05 PM, Craig Taverner cr...@amanzi.com wrote: Hi Gianluca, I think perhaps my previous answer was too complex, since the link you provided started with distance queries I answered that, but below you are more specific, so I will answer again, in-line. I understand that for my purpouse Neo4j libraries are uncessary for me. Since you want an index, you want Neo4j Spatial :-) Craig (and excuse me to Anne for the intrusion), could you tell me how to managa at best some simple geo coordinates (lat e long) as Neo4j nodes ? I would suggest two double properties, latitude and longitude. Then pass these into the Neo4j Spatial index. If you do not want to write any code yourself for telling the index how to understand your node, the SimplePropertyEncoder can do this work for you, so you do not need to create a mapping between the node and the index. However, to use SimplePropertyEncoder, you do need to create a Geometry, like a Point, and pass that in. If you do not want to do that, take a look at SimplePropertyEncoder, it would be trivial to make a new version of that class that takes in two float or two doubles. I only need to store 2 properties (lat e long) some some nodes, then to retrieve the nearest points inside a box area with a center defined by a lat/long node Which is the best algorithm to do this ? Can I put lat e long as double property in a node, than find it by a lucene search ( lat between x and y lat, long between x and y long) ? I've not tried lucene for this, but if you store the position as lat and long on two properties in a node, and write a version of the encoder (as described above), then the RTree index would work on this data, and would be fast. Cheers, Craig ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] neo4j and GeoServer
Thank Peter for your reply. I'll try in next days if this code will help me ;-) Just to understand what I mean, I'm thinking about something similar: http://www.mongodb.org/display/DOCS/Geospatial+Indexing in particular the examples in paragraphs: Querying, Compound Indexes and Bounds Queries Have a good job ! Thanks for your support ! Gianluca On Sun, Dec 5, 2010 at 12:39 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian, Neo4j Spatial let's you do this easily, guess Craig will describe how to do it best in the GIS-way of things. We are thinking about a simple API which is doing what you describe, via the Neo4j Index API, see https://github.com/neo4j/neo4j-spatial/blob/300f4d1d1fbb92d6252d5be6dc334250c9514bc7/src/test/java/org/neo4j/gis/spatial/IndexProviderTest.java#L51 for an example. That would take care of all spatial internals once the index config is set up. Craig is working on such an interface. Until then, look at https://github.com/neo4j/neo4j-spatial/blob/300f4d1d1fbb92d6252d5be6dc334250c9514bc7/src/test/java/org/neo4j/gis/spatial/TestSearch.java for an example of searching with Neo4j Spatial. Does this make things clearer? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Sun, Dec 5, 2010 at 12:33 PM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Thanks to Anne and Craig for their posts. I understand that for my purpouse Neo4j libraries are uncessary for me. Craig (and excuse me to Anne for the intrusion), could you tell me how to managa at best some simple geo coordinates (lat e long) as Neo4j nodes ? I only need to store 2 properties (lat e long) some some nodes, then to retrieve the nearest points inside a box area with a center defined by a lat/long node Which is the best algorithm to do this ? Can I put lat e long as double property in a node, than find it by a lucene search ( lat between x and y lat, long between x and y long) ? Thank you for your support ! Gianluca. On Sun, Dec 5, 2010 at 12:12 PM, Craig Taverner cr...@amanzi.com wrote: Hi Paul, There is a wiki page at http://wiki.neo4j.org/content/Neo4j_Spatial_in_GeoServer http://wiki.neo4j.org/content/Neo4j_Spatial_in_GeoServerThis describes briefly how to setup GeoServer so that the Neo4j and Neo4j Spatial libraries are in the classpath and then how to expose layers from Neo4j in GeoServer. However, it assumes you used Neo4j Spatial features to create the layers in the database in the first place. This must be done with Java code (or in the case of the wiki page example, use the included test cases to create test layers). I suggest run through the case described in the wiki page, and then review the test code used to create the layers in neo4j and see if that answers your questions. But I can also say that the answer to the question on 'how do we define the nodes properties' is that it is 'up to you'. We provide an extensible mechanism so that you can use whatever graph structure you want to create spatial data and provide an adapter to expose that as geometries to the GIS. To make life easier we have a few built in adapters you can pick if you do not want to build your own. There is a WKB adapter that stores the geometries as WKB in a single property of a node, there is a lat/long one that only supports points on one node, and there is a simple sub-graph one that allows polygons in sub-graphs, and finally the most complex one we have is the OSM model that supports the entire open streetmap graph in a very similar structure to OSM itself, but exposed as multiple layers to the GIS. Regards, Craig On Sun, Dec 5, 2010 at 11:11 AM, Anne Ancey 2ae.ar...@orange.fr wrote: Hello, I'm interested in documentation concerning the integration of neo4j in GeoServer. How do we define the Nodes properties to be mapped in geographical data in GeoServer ? Regards, Paul Lambert ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user
Re: [Neo4j] Fwd: [Blueprints] Error on build on NEO4J dependencies
Hi Peter, downgrading from Maven 3.0 to Maven 2.2.1 now all classes compile ! At the end of the build I receive this output: Results : Tests in error: testVertexTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraphTest) testEdgeTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraphTest) testGraphTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraphTest) testIndexableGraphTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGrap hTest) testIndexTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraphTest) testAutomaticIndexTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGrap hTest) testTransactionalGraphTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4j GraphTest) testGraphMLReaderTestSuite(com.tinkerpop.blueprints.pgm.impls.neo4j.Neo4jGraph Test) Tests run: 40, Failures: 0, Errors: 8, Skipped: 0 But for now all is done ! Thank you very much. Ciao. Gianluca On Fri, Nov 19, 2010 at 1:21 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Hi there, even with removing ~/.m2/repository and doing a clean build, things work at my end. Is there any way you can check which versions of things you are using, etc http://maven.apache.org/plugins/maven-dependency-plugin/tree-mojo.html ? mvn dependency:dependency-tree Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Nov 19, 2010 at 1:01 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Gian, I just tried out a clean build of Blueprints, but no compile errors. will test the same after removing my maven repo and downloading half of the internet again :/ Will report back in a moment! Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Fri, Nov 19, 2010 at 12:59 PM, Gian Luca Farina Perseu farinaper...@gmail.com wrote: Hi Neo guys, could you help me ? See below mail :-) Thanks !! glfp -- Forwarded message -- From: Gian Luca Farina Perseu farinaper...@gmail.com Date: Fri, Nov 19, 2010 at 9:00 AM Subject: [Blueprints] Error on build on NEO4J dependencies To: gremlin-us...@googlegroups.com Marko, but also valid for the NEO4J guys I have some error on maven build on today Blueprints GIT STEPS: 1) cd c:\temp 2) git clone https://github.com/tinkerpop/blueprints.git 3) cd blueprints 4) mvn clean install My configuration: - Windows 7 64bit - Java(TM) SE Runtime Environment (build 1.6.0_22-b04) Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode) - Apache Maven 3.0 (r1004208; 2010-10-04 13:50:56+0200) Thanks ! Gianluca C:\Temp\blueprintsmvn clean install [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for com.tinkerpop:blueprints:jar:0.2.1-SNAPSHOT [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-comp iler-plugin is missing. @ line 122, column 21 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-jar- plugin is missing. @ line 111, column 21 [WARNING] The expression ${artifactId} is deprecated. Please use ${project.artif actId} instead. [WARNING] The expression ${version} is deprecated. Please use ${project.version} instead. [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten t he stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support buildin g such malformed projects. [WARNING] [INFO] [INFO] [INFO] Building Blueprints: A Property Graph Model Interface 0.2.1-SNAPSHOT [INFO] Downloading: http://tinkerpop.com/maven2/com/tinkerpop/graphdb-deps-all/0.1-SNAP SHOT/maven-metadata.xml Downloading: http://tinkerpop.com/maven2/com/tinkerpop/graphdb-deps-neo4j/0.1-SN APSHOT/maven-metadata.xml Downloading: http://tinkerpop.com/maven2/com/tinkerpop/graphdb-deps-orientdb/0.1 -SNAPSHOT/maven-metadata.xml Downloading: http://tinkerpop.com/maven2/com/orientechnologies/orientdb-core/0.9 .24-SNAPSHOT/maven-metadata.xml Downloading: http://www.orientechnologies.com/listing/m2/com/orientechnologies/o rientdb-core/0.9.24-SNAPSHOT/maven-metadata.xml Downloaded: http://www.orientechnologies.com
Re: [Neo4j] Good Linux/Windows/OS X install procedure?
Don't forget CentOS, aka RedHat Enterprise ... ;-) On Thu, Oct 28, 2010 at 3:57 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Thanks for the input everyone! It seems an Ubuntu/Debian installer would be the best thing to start with, apart from a simple .zip packaging that exposes the contents for non-root users on the different systems. Has anyone ever done some Debian packaging and knows how to do that with Java-systems? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. On Thu, Oct 28, 2010 at 3:24 PM, Axel Morgner a...@morgner.de wrote: +1 for an Ubuntu personal package archive: https://launchpad.net/ubuntu/+ppas Am 28.10.2010 14:49, schrieb Richard Jones: On Ubunto I would love to see an apt-get install procedure. I am almost ready to decide on our DB and this would makie it easy to get up and running and trial the technology rather than learn how it fits together. Cheers Rich On Thu, Oct 28, 2010 at 11:27 PM, Peter Neubauer peter.neuba...@neotechnology.com wrote: Hi folks, while thinking about getting a first Neo4j server package out, is there anyone who has good experience with installers? Basically, the question is if we should just zip together the distribution, so you can run the startup scripts etc yourself, or do an installer that will let you choose where to put the files, maybe install a few daemon scripts etc. Any hints and opinions on what tools to use and how this should look like? Have you seen any other project that you think has a great installing experience? Cheers, /peter neubauer GTalk: neubauer.peter Skype peter.neubauer Phone +46 704 106975 LinkedIn http://www.linkedin.com/in/neubauer Twitter http://twitter.com/peterneubauer http://www.neo4j.org - Your high performance graph database. http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user