Re: [Neo4j] Neo4j low-level data storage

2011-10-10 Thread danielb
First thanks to all of you for the hints and the detailed explanation of Craig. Peter I was not into any code in detail yet, but I have had a look on the (beta) wiki of Neo4j spatial. Some more questions on the storage format of Neo4j: So the nodes, properties and relationships are stored in seper

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread Michael Hunger
Lots of thoughts, I just want to add a side note on store "defragmentation". Mattias and I wrote a little tool for a customer who was in need of recreation of his store with some properties/relationships omitted but using the original node-ids. We did that by iterating through the existing sto

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread Craig Taverner
I think Daniels questions are very relevant, but not just to OSM. Any large graph (of which OSM is simply a good example) will be affected by fragmentation, and that can affect performance. I recently was hit by performance of GIS queries (not OSM) related to fragmentation of the index tree. I will

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread Peter Neubauer
Daniel, for OSM data and GIS, have you looked at https://github.com/neo4j/spatial, especially the OSM examples at https://github.com/neo4j/spatial/blob/master/src/test/java/org/neo4j/gis/spatial/pipes/GeoPipesTest.java and https://github.com/neo4j/spatial/blob/master/src/test/java/org/neo4j/gis/sp

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread danielb
Hello Chris, thanks for your postings, they are a great starting point for me to assume a good performance of this database. However I have some questions left. Lets say I have a node store and a property store. Both of them are individual files. I am going to implement a GIS application which fet

Re: [Neo4j] Neo4j low-level data storage

2011-09-14 Thread Marko Rodriguez
> There is no shame in producing good work and sharing it with others. Marko. ___ Neo4j mailing list User@lists.neo4j.org https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Neo4j low-level data storage

2011-09-14 Thread Chris Gioran
Hi, You can find a decent explanation for pre-1.4 storage layout here: http://digitalstain.blogspot.com/2010/10/neo4j-internals-file-storage.html It has not been updated however to explain extended addressing for 4B+ entities in a db (which do not change the layout, just the semantics of some b

[Neo4j] Neo4j low-level data storage

2011-09-14 Thread danielb
Hello everybody, I have some questions regarding data storage in neo4j. How does neo4j store the data on the physical level? Are elements which have a close relationship in the graph stored in an adjacent way on disk? Any special binary format? How do you treat SSDs compared to common harddisks? W