Re: [Neo4j] Feedback requested: Major "wish list" item for Neo4J

2011-12-07 Thread Craig Taverner
I definitely second this suggestion. We have recently being working on a binary store for dense data we would like to access as if they were properties of nodes. Right now we have properties that are references to files on disk, and then handle the binary ourselves, but this does not benefit from a

Re: [Neo4j] path finding using OSM ways

2011-12-07 Thread Craig Taverner
We do indeed have twice the node count (and twice the relationship count). This is a necessary side effect of the fact that an OSM node can participate in more than one way (at intersections as well as shared edges of polygons, etc.). In addition, with shared edges the direction can be reversed fro

Re: [Neo4j] Are graphs ok for lots of Event data

2011-12-07 Thread Craig Taverner
Of course the graph can be used for processing event data, and whether that works for your case or not depends. But we have used it for this, and I can discuss a few points. The event stream is obviously just a linear chain and can be modeled as such in the graph (eg. with NEXT relationships betwe

Re: [Neo4j] OSMImporter: Is there a way to do incremental imports?

2011-12-06 Thread Craig Taverner
There was only a method ending in 'WithCheck', or something like that, lying unused in the code from last year. Nothing more than that. Except for thinking about it, which is why I wrote the previous mail. On Dec 2, 2011 12:50 PM, "Peter Neubauer" wrote: > Not sure, > Craig, do you have the code

Re: [Neo4j] Contributors section in the manual

2011-11-29 Thread Craig Taverner
What is the sort order? Date of first commit, number of lines, commits, packages? On Nov 21, 2011 2:35 PM, "Peter Neubauer" wrote: > Everyone, > have started to put in some random people in, see > http://docs.neo4j.org/chunked/snapshot/contributors.html . > > Any ideas what more info to provide h

Re: [Neo4j] possibility to merge some neo4j databases?

2011-11-29 Thread Craig Taverner
There are two approaches I can think of: - use a better index for mapping ids. Lucent is too slow. Memory hashtables are memory bound.Peter has been investigating alternative dbs like bdb. I tried, but did not finish a hashmap of cached arrays, and Chris wrote his big data import project on github,

Re: [Neo4j] OSMImporter: Is there a way to do incremental imports?

2011-11-22 Thread Craig Taverner
I did some initial work on incremental imports back in 2010, but stopped due to some complications: - We needed to mix lucene reads and writes during the import (read to check if the node already exists, so we don't import twice) and this performs very badly in the batch inserter. We deci

Re: [Neo4j] osm_import.rb

2011-11-11 Thread Craig Taverner
Hi, Sorry for a late contribution to this discussion. I will try make a few comments to cover the various mails above. Firstly, the neo4j-spatial.rb GEM at version 0.0.8 on RubyGems works with Neo4j-Spatial 0.6, which does include the non-batch inserter code, so in principle should work for you.

Re: [Neo4j] Problem Installing Spatial (Beginner)

2011-10-07 Thread Craig Taverner
Sorry for such a late response, I missed this mail. I must first point out that it seems you are trying to use Neo4j-Spatial in the standalone server version of Neo4j. That is possible, but not well supported. We have only exposed a few of the functions in the server, and do not test it regularly.

Re: [Neo4j] Neo4j in GIS Applications

2011-10-07 Thread Craig Taverner
Hi all, I am certainly behind on my emails, but I did just answer a related question about OSM and fragmentation, and I think that might have answered some of Daniels questions. But I can say a little more about OSM and Neo4j here, specifically about the issue of joins in postgres. Let me start b

Re: [Neo4j] Neo4j low-level data storage

2011-10-07 Thread Craig Taverner
I think Daniels questions are very relevant, but not just to OSM. Any large graph (of which OSM is simply a good example) will be affected by fragmentation, and that can affect performance. I recently was hit by performance of GIS queries (not OSM) related to fragmentation of the index tree. I will

Re: [Neo4j] Running out of memory in creating large graph..

2011-08-31 Thread Craig Taverner
I think the 1M nodes array should not be responsible for this (nodes do not take so much memory). Also, as Rick pointed out, you have very small transactions, so that should not do it either. But the stack trace was from the finish() method, and internal memory allocation of a large byte buffer. I

Re: [Neo4j] Spatial query with property filter

2011-08-29 Thread Craig Taverner
I can elaborate a little on what Peter says. The DynamicLayer support is indeed the only way to do what you want right now, but I think it is actually quite a good fit for your use case. When defining a dynamic layer you are actually just defining a 'returnable evaluator', which will be applied to

Re: [Neo4j] neo4j spatial and postgis

2011-08-13 Thread Craig Taverner
Or if you want a command line import, try the ruby gem 'neo4j-spatial.rb'. Once installed you can type: osm_import file.shp On Aug 13, 2011 10:33 AM, "Andreas Wilhelm" wrote: > Hi, > > with the pgsql2shp tool you can dump your postgis db in a shapefile and > you should be able to import it in Neo4

Re: [Neo4j] Neo4j Spatial and gtype property

2011-07-29 Thread Craig Taverner
; > On Wed, Jul 27, 2011 at 10:50 PM, Craig Taverner wrote: > > > Actually we do allow multiple geometry types in the same layer, but some > > actions, like export to shapely, will fail. We even test for this in > > TestDynamicLayers. > > > > You can

Re: [Neo4j] Neo4j Spatial and gtype property

2011-07-27 Thread Craig Taverner
Actually we do allow multiple geometry types in the same layer, but some actions, like export to shapely, will fail. We even test for this in TestDynamicLayers. You can use the gtype if you want, but it is specific to some GeometryEncoders, and might change in future releases. It would be better t

Re: [Neo4j] How often are Spatial snapshots published?

2011-07-22 Thread Craig Taverner
Interesting that if you look at the github 'blame' for that file (see https://github.com/neo4j/neo4j-spatial/blame/master/src/main/java/org/neo4j/gis/spatial/SpatialTopologyUtils.java), you find that all the findClosestEdges methods where added in October 2010. So if Nolan has a version older than

Re: [Neo4j] How to create a graph database out of a huge dataset?

2011-07-19 Thread Craig Taverner
I'm not sure it's such a good idea to call tx.success() on every iteration of the loop. I suggest call it only in the commit, and after the loop (ie. move it two lines down). Also I think a commit size of 50k it a little large. You're probably not going to see much improvement past 10k. In fact I

Re: [Neo4j] Neo4j Spatial - Keep OSM imports - Use in GeoServer

2011-07-12 Thread Craig Taverner
us > release of Neo4j : Geoserver proposes to create a Store from a Neo4j db, but > I got the error message quoted above. > > Any idea how I could make this work ? What is the file that replace > neo4j-index in Neo4j 1.4 ? > > I join one of my database, archived, so that

Re: [Neo4j] Indexed relationships

2011-07-10 Thread Craig Taverner
Actually, I'm supporting Saikat Kanjilal, who has kindly volunteered to port the RTree. We have had some good startup discussions, and on Friday he reported some initial code changes in the RTree for generalizing it away from its spatial roots. Not sure how long before it gets moved to collections

Re: [Neo4j] Neo4j Spatial - Keep OSM imports

2011-07-08 Thread Craig Taverner
Another option is to run the main method of OSMImport class, which expects command line arguments for database location and OSM file, and will simply import a file once. This is not tested often, so there is a risk things have changed, but it is worth a try. Another, even easier, option in my opin

Re: [Neo4j] Indexed relationships

2011-07-08 Thread Craig Taverner
Not sure if this will be the same for you, but we were not able to use the RTree in batch inserter mode, since the batch inserter does not support node deletion and that is required during tree rebalancing. So our OSM importer in batch mode actually imports everything first, must like you describe,

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-06 Thread Craig Taverner
method? I can't find the code on github. > > Thanks! > > On Sat, Jul 2, 2011 at 6:00 PM, Craig Taverner wrote: > > > As I understand it, Andreas is working on the much more complex problem > of > > updating OSM geometries. That is more complex because it involves

[Neo4j] Cypher error in neo4j-spatial

2011-07-02 Thread Craig Taverner
Hi, Recent builds of Neo4j-Spatial no longer like Peters new bounding box query. Peter is on vacation, and I am not familiar with the code (nor cypher), so I thought I would just dump the error message here for now in case someone can give me a quick pointer. The line of code is: Query query = pa

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-02 Thread Craig Taverner
, it would be many > > thousands of nodes per user. > > > > Many thanks! > > > >> > >> > >> On Sat, Jul 2, 2011 at 6:48 AM, Craig Taverner > wrote: > >> > >>> Hi Boris, > >>> > >>> Ah! You are using t

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-07-02 Thread Craig Taverner
thanks! > > On Wed, Jun 8, 2011 at 4:58 PM, Craig Taverner wrote: > > > OK. I understand much better what you want now. > > > > Your person nodes are not geographic objects, they are persons that can > be > > at many positions and indeed move around. However, t

Re: [Neo4j] wkb value in node created by addGeometryWKTToLayer

2011-07-02 Thread Craig Taverner
Hi Boris, You do not need to read the property yourself from the node, rather use the GeometryEncoder for this, it converts from the internal spatial storage to the Geometry class, which you can work with. If you call geom.toString() you will get a nice printable version (in WKT). Using the Geomet

Re: [Neo4j] reify links with other neo4j databases located on different distributed servers

2011-07-02 Thread Craig Taverner
As far as I know there is no internal support for transparent traversals across shards. Generally people are doing that in the application layer. However, I think there might be a middle ground of sorts. I we modify the relationship expander, I could imagine that relationships that are between shar

Re: [Neo4j] GSoC 2011 Neo4j Geoprocessing | Weekly Report #6

2011-07-02 Thread Craig Taverner
Hi Andreas, Sounds like good progress over all. It is only a week to the mid-terms, so it would be good to do a general code overview and see if this can be integrated with trunk. Shall we plan for a review and test integration in the middle of next week? Regards, Craig On Sat, Jul 2, 2011 at 10

Re: [Neo4j] traversing densely populated nodes

2011-06-30 Thread Craig Taverner
In the amanzi-index I link all indexed nodes into the index tree, so traversals are straight up the tree. Of course this also means that there are at least as many relationships as indexed nodes. I was reviewing Michaels code for the relationship expander, and think that is a great idea, tranparen

Re: [Neo4j] Database engine using Neo4j

2011-06-30 Thread Craig Taverner
Hi Kriti, I can comment on a few things, especially neo4j-spatial: - Neo4j is certainly good for social networks, and people have used it for that, but I personally do not have experience with that so I will not comment further (others can chip in where necessary). - Neo4j-Spatial is

Re: [Neo4j] traversing densely populated nodes

2011-06-30 Thread Craig Taverner
This topics has come up before, and the domain level solutions are usually very similar, like Norbert's category/proxy nodes (to group by type/direction) and Niels' TimeLineIndex (BTree). I wonder whether we can build a generic user-level solution that can also be wrapped to appear as an internal d

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
I think moving the RTree to the generic collections would not be too hard. I saw Saikat showed interested in doing this himself. Saikat, contact me off-list for further details on what I think could be done to make this port. On Wed, Jun 29, 2011 at 9:52 PM, Niels Hoogeveen wrote: > > Peter, I t

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
It is technically possible, but it is a somewhat specialized index, not a normal BTree, so I think you would want both (mine and a classic btree). My index performs better for certain data patterns, is best with semi-ordered data and moderately even distributions (since it has no rebalancing), and

Re: [Neo4j] neo4j-graph-collections

2011-06-29 Thread Craig Taverner
I have previously used two solutions to deal with multiple types in btrees: - My first index in 2009 was a btree-like n-dim index using generics to support int[], long[], float[] and double[] (no strings). I used this for TimeLine (long[1]) and Location (double[2]). The knowledge about wh

Re: [Neo4j] neo4j-graph-collections

2011-06-28 Thread Craig Taverner
The RTree in principle should be generalizable, but the current implementation in neo4j-spatial does make a few assumptions specific to spatial data, and makes use of spatial envelopes for the tree node bounding boxes. It is also specific to 2D. We could make a few improvements first, like generali

Re: [Neo4j] cassandra + neo4j graph

2011-06-27 Thread Craig Taverner
Hi, I can comment on the spatial side. The neo4j-spatiallibrary provides some tools for doing spatial analysis on your data. I do not know exactly what you plan to do, but since you mention user and place locations, I guess you are likely to be asking the da

Re: [Neo4j] Recent slowdown in imports with lucene

2011-06-26 Thread Craig Taverner
individually. Setting the block size back to 5000 increased the node creation rate to nearly 1 (over 100 times faster). That is a serious improvement. Sorry again for wasting space on the list. I'm glad this was a user error, though, not a neo4j issue :-) Regards, Craig On Mon, Jun 27, 2

Re: [Neo4j] Recent slowdown in imports with lucene

2011-06-26 Thread Craig Taverner
cenarios a go and see if I can find some culprit for this. > > But again, a little more information would be useful, as always. > > 2011/6/26 Craig Taverner > > > Hi, > > > > Has anyone noticed a slowdown of imports into neo4j with recent > snapshots? > >

[Neo4j] Recent slowdown in imports with lucene

2011-06-25 Thread Craig Taverner
Hi, Has anyone noticed a slowdown of imports into neo4j with recent snapshots? Neo4j-spatial importing OSM data (which uses lucene to find matching nodes for ways) is suddenly running much slower than usual on non-batch imports. For most of my medium sized test cases, I normally have surprisingly

Re: [Neo4j] Neo4j -- Can it be embedded in Android?

2011-06-24 Thread Craig Taverner
probably the > > "non-traditional" file system that Android exposes. > > > > -Original Message- > > From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j.org] > > On Behalf Of Craig Taverner > > Sent: Friday, June 24, 2011 8:37 AM > > To: Neo

Re: [Neo4j] Neo4j -- Can it be embedded in Android?

2011-06-24 Thread Craig Taverner
I heard that Peter Neubauer made a port of neo4j to android a few years ago, but that nothing has been done since and no version since then would work. So my understanding is that it does not work on android, but that it is possible to make it work (with some work ;-). Peter is away, but I expect

Re: [Neo4j] neo4j-spatial roadmap/stability

2011-06-23 Thread Craig Taverner
Hi Christopher, Thanks for your interest in neo4j and neo4j-spatial. I will answer your questions and comments inline. I am working for the largest German speaking travel and holiday portal. > Currently we are using a relatively simple MySQL based spatial distance > functionality. We plan to enha

Re: [Neo4j] More spatial questions

2011-06-19 Thread Craig Taverner
Hi Nolan, I think I can answer a few of your questions. Firstly, some background. The graph model of the OSM data is based largely on the XML formated OSM documents, and there you will find 'nodes', 'ways', 'relations' and 'tags' each as their own xml-tag, and as a consequence each will also have

Re: [Neo4j] Auto Indexing for Neo4j

2011-06-18 Thread Craig Taverner
> > Twitter http://twitter.com/peterneubauer > > > > http://www.neo4j.org - Your high performance graph > database. > > http://startupbootcamp.org/- Ă–resund - Innovation happens HERE. > > http://www.thoughtmade.com - Scandinavia's coolest B

Re: [Neo4j] Slow Traversals on Nodes with too many Relationships

2011-06-15 Thread Craig Taverner
I understood that on windows the memory mapped sizes needed to be included in the heap, since they are not allocated outside the heap as they are on linux/mac. So in this case he needs a larger heap (and make sure the memory mapped files are much smaller than the heap). The relevant part of the con

Re: [Neo4j] Most Efficient way to query in my use cases

2011-06-15 Thread Craig Taverner
Another common thing to do in this case is create a node for the purchase action. This node would be related to the purchaser (user), item (pen) and shop, and would contain data appropriate to the purchase (date/time, price, etc). Then traverse from the shop or the pen to all purchase actions that

Re: [Neo4j] Slow Traversals on Nodes with too many Relationships

2011-06-15 Thread Craig Taverner
Could this also be related to the possibility that in order to determine relationship type and direction, the relationships need to be loaded from disk? If so, then having a large number of relationships on the same node would decrease performance, if the number was large enough to affect the disk

Re: [Neo4j] Auto Indexing for Neo4j

2011-06-14 Thread Craig Taverner
This is great news. Now I'm really curious about the next step, and that is allowing indexes other than lucene. For example, the RTree index in neo4j-spatial was never possible to wrap behind the normal index API, because that was designed only for properties of nodes (and relationships), but the

Re: [Neo4j] Traversals versus Indexing

2011-06-13 Thread Craig Taverner
Think of your domain model graph as a kind of index. Traversing that should generally be faster than a generic index like lucene. Of course some things do not graph well, and you should use lucene for those. But if you can find something with a graph traversal, that is likely the way to go. Also y

Re: [Neo4j] neo4j-spatial

2011-06-09 Thread Craig Taverner
Hi Saikat, Yes, your explanation was clear, but I was busy with other work and failed to repond - my bad ;-) Anyway, your idea is nice. And I can think of a few ways to model this in the graph, but at the end of the day the most important thing to decide first is what queries are you going to per

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-08 Thread Craig Taverner
and the layer. > > Many thanks for your patience as I learn this challenging material. > > On Tue, Jun 7, 2011 at 4:13 PM, Craig Taverner wrote: > > > I think you need to differentiate the bounding boxes of the data in the > > layer (stored in the database), and the boun

Re: [Neo4j] GSoC 2011 Neo4j Geoprocessing | Weekly Report #2

2011-06-07 Thread Craig Taverner
I suggest you code review them first. Especially since there are API changes. On Tue, Jun 7, 2011 at 10:11 AM, Peter Neubauer < peter.neuba...@neotechnology.com> wrote: > Very nice Andreas! > > You consider it safe to pull these changes into the main repo? > > Cheers, > > /peter neubauer > > GTal

Re: [Neo4j] Sample Linear Referencing Functions in Neo4j Spatial and GSoC

2011-06-07 Thread Craig Taverner
Twitter http://twitter.com/peterneubauer > > http://www.neo4j.org - Your high performance graph database. > http://startupbootcamp.org/- Ă–resund - Innovation happens HERE. > http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party. > &g

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-07 Thread Craig Taverner
t a bounding box made > of > a set of points, rather than individual points. So the query is, find the > nodes where the given point falls inside their bounding boxes. Can I do > this > with REST? > > Thanks! > > On Tue, Jun 7, 2011 at 11:34 AM, Craig Taverner wrote: > &g

Re: [Neo4j] neo4j spatial bounding box vs. lat/lon

2011-06-07 Thread Craig Taverner
Hi, The bounding boxes are used by the RTree index, which is a typical way to index spatial data. For Point data, the lat/long and the bounding box are the same thing, but for other shapes (streets/LineString and Polygons), the bounding box is quite different to the actual geometry (which is not j

Re: [Neo4j] [SoC] Re: GSoC 2011 Weekly report - OSM data mining and editing capabilities in uDig and Geotools

2011-06-05 Thread Craig Taverner
Hi Mirco, Sounds like progress. Some suggestions: - I do not think you need to change the code for neo4j and udig, but only for neo4j-spatial and udig-community/neo4j. It is OK to make clones of those so you have the code for review, but they are quite core, and you should not need to

Re: [Neo4j] neo4j-spatial

2011-06-05 Thread Craig Taverner
Hi Saikat, This sounds worth discussing further. I think I need to hear more about your use case. I do not know what the term 'creative map' means, and what traversals you are planning to do? When you talk about 'plotting points', do you mean you have a GPS and are moving inside a real theme park

[Neo4j] Sample Linear Referencing Functions in Neo4j Spatial and GSoC

2011-06-02 Thread Craig Taverner
Hi, Recently someone asked a question on StackOverflow, if Neo4j Spatial was capable of one of the Oracle geoprocessing funtions, SDO_LRS.LOCATE_PT specifically. Since this is related to the ongoing GSoC projects for Neo4j Spatial, I thought I would do a quick investigation. What I found was that

Re: [Neo4j] path finding using OSM ways

2011-05-31 Thread Craig Taverner
Hi Bryce, Nice to see you back. The OSM data model in Neo4j-Spatial, created by the OSMImporter, is designed to mimic the complete contents of the XML files provided for OSM. As it is, this is not ideal for routing because it traces the complete set of nodes for the ways, while for routing you re

Re: [Neo4j] Embedded with webadmin

2011-05-25 Thread Craig Taverner
While HA is one option, with two processes 'sharing' a database, one being the server and the other the embedded app, there is another option, and that is to integrate the two apps. If your app is a web-app and also needs to exist in something like jetty or winstone, perhaps you could run both the

Re: [Neo4j] finding nodes between two nodes

2011-05-18 Thread Craig Taverner
Two things, set the direction of the relationships, and define the returnable evaluator. Not sure how to do this last one in REST, but I'm sure someone else can chime in on that :-) On Wed, May 18, 2011 at 11:09 PM, noppanit wrote: > > http://neo4j-user-list.438527.n3.nabble.com/file/n2958689/Sc

Re: [Neo4j] finding nodes between two nodes

2011-05-18 Thread Craig Taverner
If you remove the "depth"=>1, and specify the direction, you can get to the excluded dishes in one traversal: "relationships" => [{"type"=> "answered", "direction" => "outgoing"}, {"type"=> "excludes", "direction" => "outgoing"}] That will simplify the code a lot. It does not get to the safe di

Re: [Neo4j] Color suggestions for the Self-Relationship bike shed

2011-05-17 Thread Craig Taverner
What about a system config enabling/disabling loops? Then we could have option 1, but for people that never loops, they can still get the extra loop check by setting the system config option. On Tue, May 17, 2011 at 2:01 AM, Stephen Roos wrote: > We are not going to use loops, but would still vot

Re: [Neo4j] Timeline index

2011-05-09 Thread Craig Taverner
I'm confident that given the history of neo4j, there will be no forcing of a schema :-) And I'm thinking of previous developments that added convenience and value, like jo4neo, neo4j.rb, even the meta-model. Useful, but no-one was ever forced or even pushed to use them. I hope the new automatic in

Re: [Neo4j] Timeline index

2011-05-09 Thread Craig Taverner
Very good points. But I must admit that there is a demand for automatic indexing. I personally am not using it, but I would like prepared indexes, indexes that can be configured up front and then just add the node. I see your point about this implying more schema (in the index preparation), but I

Re: [Neo4j] Timeline index

2011-05-09 Thread Craig Taverner
+10 for both if Neils responses. I think both external and in-graph indexes should be supported. The last time I talked to Mattias about this it sounded like the only really clean option for integrating them behind one API would be once automatic indexes are supported, because at that point indexe

Re: [Neo4j] Examples of multiple indices in use?

2011-05-05 Thread Craig Taverner
This is how we use it, for performance, since some data will be much more dense than other data, we don't want the index lookup of the sparse data to be impacted by the dense data, we make separate indexes. On Thu, May 5, 2011 at 3:47 PM, Peter Hunsberger wrote: > On Thu, May 5, 2011 at 4:16 AM,

Re: [Neo4j] First-class "type" property on relationships but not nodes; why?

2011-05-05 Thread Craig Taverner
Another view of things would be to say that ideally there should be no first class type on either relationships or nodes, since that is a domain specific concept (as Neils says he wants two types, but Rick wants one, and some object models type nodes by relating them to a separate node representing

Re: [Neo4j] GSoC 2011 Neo4j Geoprocessing

2011-05-04 Thread Craig Taverner
> > If you do so, take a look how to deal with all these energy lines, wind- > and solar parks within OSM ;) > Hi Achim, Do you have a particular analysis in mind for these data? It would be nice to have a few more use cases to test with. Regards, Craig __

Re: [Neo4j] [udig-devel] Geoprocessing with Neo4j Spatial and OSM

2011-05-04 Thread Craig Taverner
:-) That would be cool. On Wed, May 4, 2011 at 9:11 AM, Mauricio Pazos wrote: > On Monday, May 02, 2011 05:51:08 pm Craig Taverner wrote: > > > If you are interested in graph databases in GIS, OSM or geoprocessing, > > > consider voting for my talk at http://community-review.

Re: [Neo4j] Lucene/Neo Indexing Question

2011-05-02 Thread Craig Taverner
ene, but will experiment with a few approaches > to see what works best in different scenarios, and will try implementing > something along the lines of what you describe. > > > > -Original Message- > From: user-boun...@lists.neo4j.org [mailto:user-boun...@lists.neo4j

[Neo4j] Geoprocessing with Neo4j Spatial and OSM

2011-05-02 Thread Craig Taverner
Hi all, I have applied to FOSS4G to talk about "Geoprocessing with Neo4j Spatial and OSM". This talk will include the new work we've done on the open street map model. In addition, we got two GSoC students this year, on related projects "OSM Editor" and "Geoprocessing with OSM", and so they are li

Re: [Neo4j] Lucene/Neo Indexing Question

2011-05-02 Thread Craig Taverner
Thinking back you your original domain description, cars with colors, surely you have more properties than just colors to index? If you have two or more properties, then you use combinations of properties for the first level of the index tree, which provides your logical partitioning of supernodes

Re: [Neo4j] [Neo4jSpatial] Find way/region where count of things is greater/equal/less X

2011-04-27 Thread Craig Taverner
Hi, Sorry for a slow response, I've been travelling. I think I'm missing a key point here. I am not aware that the OSM model includes the concept of the number of cars at a point, or on a way. So this means, IMHO, that you need to add this information to the model. So, if, for example, you have a

Re: [Neo4j] New blog post on non-graph stores for graph-y things

2011-04-26 Thread Craig Taverner
> > On "foreign key" I think it was a subconscious choice to avoid it, since it > has very strong semantics in other data models. I wanted to try to convey > the concept of "pointers" without muddying that with the stricter semantics > of foreign keys and referential integrity. > Perhaps I'm over-

Re: [Neo4j] New blog post on non-graph stores for graph-y things

2011-04-24 Thread Craig Taverner
Hi Jim, As always, I enjoyed reading your blog. It was well written and made the point (including even a plug in the last line ;-) While Aseem's observations are valid, I think you handled it correctly, with the product recall example being only a relatively small win for graph databases, and mov

Re: [Neo4j] REST results pagination

2011-04-22 Thread Craig Taverner
> > Good catch, forgot to add the in-graph representation of the results to my > mail, thanks for adding that part. Temporary (transient) nodes and > relationships would really rock here, with the advantage that with HA you > have them distributed to all cluster nodes. > Certainly Craig has to add

Re: [Neo4j] REST results pagination

2011-04-21 Thread Craig Taverner
I think Jim makes a great point about the differences between paging and streaming, being client or server controlled. I think there is a related point to be made, and that is that paging does not, and cannot, guarantee a consistent total result set. Since the database can change between pages requ

Re: [Neo4j] REST results pagination

2011-04-21 Thread Craig Taverner
> > I can only think of a few use cases where loosing some of the expected > result is ok, for instance if you want to "peek" at the result. > IMHO, paging is, by definition, a "peek". Since the client controls when the next page will be requested, it is not possible, or reasonable, to enforce tha

Re: [Neo4j] REST results pagination

2011-04-21 Thread Craig Taverner
> > I assume this: >Traverser x = Traversal.description().traverse( someNode ); >x.nodes(); >x.nodes(); // Not necessarily in the same order as previous call. > > If that assumption is false or there is some workaround, then I agree that > this is a valid approach, and a good efficient

Re: [Neo4j] REST results pagination

2011-04-20 Thread Craig Taverner
do not need to sort (and use the database cursor approach to avoid loading the result set into memory). On Wed, Apr 20, 2011 at 2:01 PM, Jacob Hansson wrote: > On Wed, Apr 20, 2011 at 11:25 AM, Craig Taverner wrote: > > > I think sorting would need to be optional, since it is likely

Re: [Neo4j] REST results pagination

2011-04-20 Thread Craig Taverner
I think sorting would need to be optional, since it is likely to be a performance and memory hug on large traversals. I think one of the key benefits of the traversal framework in the Embedded API is being able to traverse and 'stream' a very large graph without occupying much memory. If this can b

Re: [Neo4j] How to combine both traversing and index queries?

2011-04-19 Thread Craig Taverner
Another approach to this problem is to consider that an index is actually structured as a graph (a tree), and so if you write the tree into the graph together with your data model, you can combined the index and the traversal into a pure graph traversal. Of course, it is insufficient to simply buil

Re: [Neo4j] getting neighbors of OSM waynode

2011-04-18 Thread Craig Taverner
n4, n5) > w2 consists of (n6, n7, n4, n8, n9 > w1 and w2 cross themselves on node n4 > so when I want the neighbor-nodes of n4 I expect to get n3, n5, n7 and n8 > as > result. > > Regards, > Reinhard > > 2011/4/16 Craig Taverner > > > Hi Reinhard, > > &g

Re: [Neo4j] getting neighbors of OSM waynode

2011-04-16 Thread Craig Taverner
Hi Reinhard, Can you define what you mean by 'neighbour'? The process you described below will find the closest way to a point on the map. But your original request was to find the closest 'neighbour' to an existing osm node. If, by 'neighbour' you mean a directly connected osm node, then you can

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-31 Thread Craig Taverner
Hi Robert, I took a look at this and the issue is that you are using the OSMGeometryEncoder to decode the RTree nodes. And the GeometryEncoder is designed to be specific to your data model, while the RTree internal data is hard-coded into the RTree design. So there is no guarantee that any particu

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
ply message - > From: "Craig Taverner" > Date: Wed, Mar 30, 2011 7:43 am > Subject: [Neo4j] question > To: "Neo4j user discussions" > > > > > > I think for that the TimelineIndex interface would have to be extended > to > > be able to hold a

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
> > That sounds nice. My scenario is something like: I have a centralized > database. On the Desktop side I have a workstation on which I do GIS > analysis. People want to get a chunk of data of interest, so they can > "pollute" them with their analyses until they are happy. So it is a > bit the co

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
> > Ok, in fact it shouldn't be a performance downgrade even with large > blobs, right? It just depends on whether the queried part refers to an > id or similar and that node then is simply connected to the blob. I.e. > I extract the blob only when I am sure it is the wanted. Is that what > you mea

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
> > > I think for that the TimelineIndex interface would have to be extended to > be able to hold additional data so that you can do compound > queries< > http://docs.neo4j.org/chunked/milestone/indexing-lucene-extras.html#indexing-lucene-compound > >to > it and get exactly the functionality you're

Re: [Neo4j] question

2011-03-30 Thread Craig Taverner
Wow, Andrea, your questions have sparked such a dialog I don't know where to interject my own answers. I will try comment on a few. > > You can choose which relationship types and directions to view, but > > that's it. Try decreasing the maximum number of nodes to show in the > > preferences, if

[Neo4j] Google Summer of Code 2011

2011-03-29 Thread Craig Taverner
Hi all, Last year Neo4j was represented in the Google Summer of Code with two successful projects, in collaboration with Gephi and OSGeo. This year we are again interested in supporting GSoC projects within other open source organizations interested in integrating with Neo4j. The OSGeo

Re: [Neo4j] question

2011-03-28 Thread Craig Taverner
Hi Andrea, I am cc'ing the list with these answers, since I think there are questions here others know much more about. I will answer all with what I know, or think I know :-) 1) what can I put into the node? I see that the superclass proposes > Property types. So I was wondering if blogs are co

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-24 Thread Craig Taverner
I will need to double check this. I know there was a dispute early on with Neo4j Spatial because the JTS library orders bbox params in one way, and GeoTools does it another way, so you might be seeing the results of that. I believed we sorted that all out, but perhaps not. I have have just checked

Re: [Neo4j] Neo4J Spatial - issue with bounding box indices in OSM Layer.

2011-03-24 Thread Craig Taverner
Hi Robert, Interesting work you're doing. I just read your blogs and I think it would be great to discuss your tests in more detail. Michael Hunger has done some interesting tests on the scalability of the OSM import, and could probably give suggestions on configuring the import. Looking at your

Re: [Neo4j] [Neo4j Spatial] Need advice on modeling my spatial domain properly

2011-03-18 Thread Craig Taverner
n to do a hybrid of your > options :) this leaves the option to extend the model more easily if it's > desired. > > greetz > Chris > > On Fri, Mar 18, 2011 at 12:47 PM, Craig Taverner wrote: > > > Hi Chris, > > > > A lot depends on your final int

Re: [Neo4j] [Neo4j Spatial] Need advice on modeling my spatial domain properly

2011-03-18 Thread Craig Taverner
Hi Chris, A lot depends on your final intentions of how to use the model. There are many, many ways to model this, and each has its pros and cons. Let me try briefly describe two options I can think of that are related to the two factors you suggest below. *Option one - model time in the graph*

Re: [Neo4j] Where is the beer?

2011-03-17 Thread Craig Taverner
When I added my face, I tested to make sure it scaled the same as the others. The results: no images scale at all, no matter what zoom level. They are all fixed size images. Google said we should load images up to 64x64, so I originally loaded a 64x64 image, but since it was noticeably larger than

Re: [Neo4j] Neo4j spatial

2011-03-16 Thread Craig Taverner
Hi Saikat, There are a few places you can look for code samples. One of the best places is the set of test cases included in neo4j spatial. You can find them at https://github.com/neo4j/neo4j-spatial/tree/master/src/test/java/org/neo4j/gis/spatial. In particular, since you are interested mostly in

  1   2   3   4   >