Re: [Neo4j] Solve a problem using neo4j

2011-02-08 Thread Jim Webber
Hi Ori, > 1. About the iterator - if I get a large amount of results (millions) it > cannot be held in memory. Does the iterator work on in-memory collection, or > there is something like JDBC fetch size? For the embedded case, iterators are lazy so you won't hurt yourself. For the REST API res

Re: [Neo4j] Solve a problem using neo4j

2011-02-08 Thread yehohan...@googlemail.com
Hello Jim, To add to the previous question about lazy loading, how does highavailable implementation of neo4j behave? John Sent from my Nokia phone -Original Message- From: Jim Webber Sent: 08/02/2011 09:16:36 Subject: Re: [Neo4j] Solve a problem using neo4j Hi Ori, > 1. About the it

Re: [Neo4j] Solve a problem using neo4j

2011-02-08 Thread Tobias Ivarsson
Hi John, The High Availability implementation of Neo4j behaves in the same way. Reads in HA are done from the local store. An interesting side effect of this is that while all instances in a HA cluster will store the same data, they can each have a different dataset in cache. This can, with some

Re: [Neo4j] Calculating shortest paths in a large graph

2011-02-08 Thread Tobias Ivarsson
I've done a thorough analysis of this issue now. It turns out that the OOME was in fact related to the duplication of relationships in the graph. The fact that the relationships are duplicated means that for each node we will have multiple relationships that reach it with the exact same cost. Whe

Re: [Neo4j] Solve a problem using neo4j

2011-02-08 Thread yehohan...@googlemail.com
Thanks Tobias, is there any architecture document giving a high level view of how various components in neo4j interact with each other and the responsibilities of each component? John -Original Message- From: Tobias Ivarsson Sent: 08/02/2011 10:39:59 Subject: Re: [Neo4j] Solve a pr

Re: [Neo4j] Solve a problem using neo4j

2011-02-08 Thread Jim Webber
Hi John, There's nothing authoritative that I can find right now, but I'm going to be blogging about this in the weeks to come, starting with HA and sharding. Jim ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread rick.bullo...@burningskysoftware.com
Neo running on app engine would be an interesting project... - Reply message - From: "Peter Neubauer" Date: Tue, Feb 8, 2011 1:35 am Subject: [Neo4j] GSoC ideas? To: "Neo4j user discussions" , "neo4jrb" , "General OPS4J" Hi all, this years Google Summer of Code is coming up, and we wou

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread Peter Neubauer
Updated on http://wiki.neo4j.org/content/Google_Summer_of_Code_Ideas#Ideas_for_Google_Summer_of_Code_projects:) /peter On Tue, Feb 8, 2011 at 12:11 PM, rick.bullo...@burningskysoftware.com < rick.bullo...@burningskysoftware.com> wrote: > Neo running on app engine would be an interesting projec

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread Craig Taverner
Three suggestions from me: - Prepared index API - where the names of the properties to index are set at the index creation, and then you just call index.add(node) from then on. This can be generalized to index things other than properties, like some characteristic of a connected sub-gr

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread Peter Neubauer
Thanks, updated! /peter On Tue, Feb 8, 2011 at 2:06 PM, Craig Taverner wrote: > Three suggestions from me: > >- Prepared index API - where the names of the properties to index are >set at the index creation, and then you just call index.add(node) from then >on. This can be general

Re: [Neo4j] neo4j with Sun Grid Engine, or " how to manage multiple server instances with a single head? "

2011-02-08 Thread Joan Marc Riera Duocastella
It makes sense. I'll check it out. Many thanks and nice job. Fundació Barcelona Media * Joan Marc Riera Duocastella * Barcelona Media - Centre d'Innovació Av. Diagonal, 177, planta 9 08018 - BARCELONA Telèfon +34 93 238 14 00 Fax +34 93 3

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread Javier de la Rosa
On Tue, Feb 8, 2011 at 01:35, Peter Neubauer wrote: > http://wiki.neo4j.org/content/Google_Summer_of_Code_Ideas > > May the source be with you! My 2 cents: a graphical web admin tool to traverse (visual Gremlin?) and browse the graph, with filters and facets, comparable to filters in Gephi [1] an

Re: [Neo4j] GSoC ideas?

2011-02-08 Thread kyle adams
I agree with the visual aspect. Gremlin + SpringGraph (Adobe Flex/Actionscript Component) + Spring Data = very cool and intuitive way to traverse a network. SpringGraph: http://mark-shepherd.com/blog/springgraph-flex-component/

Re: [Neo4j] Calculating shortest paths in a large graph

2011-02-08 Thread Saikat Kanjilal
Hi Tobias, I've actually made quite a bit of significant progress on this, I've gone back to the drawing board a bit, moved some code around that loads up how the graph is structured and am now getting the expected results without any performance issues. Also I am able to plug in train routes

Re: [Neo4j] Unrecovable transaction error

2011-02-08 Thread Gian Luca Farina Perseu
Hi Mattias, some minutes ago, I use M3 release to recover another failured DB due transactions error. My application still use M2 as previously described, I change on the fly M3 libs to recover the DB. All seems to work well. Then I replace M3 libs with originals M2 because I tried to use Backup

Re: [Neo4j] Unrecovable transaction error

2011-02-08 Thread Mattias Persson
The error you're getting is the exact same error. Recovery and incremental backup in essence uses the same functionality under the covers. You probably won't get that error with the latest builds. Great that the new builds fixed it b.t.w! 2011/2/8 Gian Luca Farina Perseu > Hi Mattias, > > some

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread John Howard
I started using the new build V1.3.M01 For some reason, I am getting this error while trying to create a new node and commit. As always, apreciate your help. 2011-02-09 00:27:17,052 INFO [STDOUT] createAndIndexNode 2011-02-09 00:27:17,132 ERROR [STDERR] java.lang.NullPointerException 2011-

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread Peter Neubauer
John, what does your code look like? It seems you are trying to create a node, and do something with the index, but the Index type is null or so. So the Lucene part of the transaction is failing. We need to look at the surrounding code snippet to answer this. /peter On Wed, Feb 9, 2011 at 7:11 AM

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread John Howard
Thanks Peter. I tried to shutdown and restart our server. And the graph was unable to recover. Here are the logs. The same code worked just few hours ago. ,280 INFO [[DATADIR=C:\JBoss\jboss-5.1.0.GA\server\all\data\ssGraph]] 2011-02-09 01:30:22,131 INFO [org.neo4j.kernel.impl.transaction.xafram

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread Mattias Persson
This is the same issue reported on the list before... The latest snapshots build will fix it (even recovery), and soon the next milestone will be out, where it also is included. Den onsdagen den 9:e februari 2011 skrev John Howard: > Thanks Peter. > > I tried to shutdown and restart our server. An

Re: [Neo4j] Unrecovable transaction error

2011-02-08 Thread Gian Luca Farina Perseu
Starting from now I'll try to use M3 but with this release I have this error related to java.lang.NoClassDefFoundError: org/neo4j/onlinebackup/Neo4jBackup I didn't check yet in documentation (I'm involved in some other topics ...) . Neo4jBackup is simply missing from build or backup man

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread John Howard
Thanks Mattias. I used the link you provided in another mail ( http://neo4j.org/get?file=neo4j-1.3-SNAPSHOT-windows.zip) That fixed the recovery problem. But after the recovery, I saw duplicate index for the same node. That is, when I searched for an index key/value, it returned 2 identical nodes.

Re: [Neo4j] web admin module in embedded graph

2011-02-08 Thread John Howard
Thanks Jacob. What we have currently is a web application which has embedded neo graph and deployed on an app server. The embedded neo approach fits nicely in our application. We are open to any development effort it may involve. It would be highly helpful, if you can point to starting steps in ge

[Neo4j] neo4j / RoR consulting opportunity

2011-02-08 Thread Rocky Mehta
Looking for "Big Data" experience to help build a new product/prototype for a prestigious firm the N.Virginia area, please get in touch with me for more details. We're seeking several consultants and due to potential sensitive data access, US Citizenship is required. Duration from 6 to 18 months

Re: [Neo4j] Stability of neo4j graph database

2011-02-08 Thread Mattias Persson
Den onsdagen den 9:e februari 2011 skrev John Howard: > Thanks Mattias. > > I used the link you provided in another mail ( > http://neo4j.org/get?file=neo4j-1.3-SNAPSHOT-windows.zip) > That fixed the recovery problem. But after the recovery, I saw duplicate > index for the same node. That is, when