Re: [Neo4j] Synchronization model between embedded client and Standalone server

2011-02-21 Thread Mattias Persson
2011/2/21 Brendan > Hi, > > I want to design a system where each client has a embedded db to store only > a subset of a master server db of all clients. Then, should I design a > server plug in to extend the currently stateless server services to support > transaction by simply wrap few requests

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread Mattias Persson
2011/2/22 J T > Hmm, I hadn't considered the apache approach but it still kind of goes > against the grain - perhaps i just want too much or its my innate laziness > ... hehe ;) > > Its not just about data size, its more about not wanting to have to > re-engineer/re-factor as things grow - whethe

Re: [Neo4j] Unable to parse mapped memory

2011-02-21 Thread Mattias Persson
Yup, there doesn't seem to be support for the dot notation for specifying mapped memory. I'm not sure there ever has been either. 2011/2/22 Peter Neubauer > Craig, > I guess we need to put in 1200M instead? > > /peter > > On Monday, February 21, 2011, Craig Taverner wrote: > > Hi, > > > > Recen

Re: [Neo4j] Lucene fulltext index batch inserter Lock obtain problem

2011-02-21 Thread Mattias Persson
2011/2/22 Shae Griffiths > > Hi Mattias, > > > > >Are you using multiple threads during batch insertion (not allowed b.t.w.) > ? > > > > It's only a single thread as far as I'm aware, unless the Lucene stuff is > doing something funky under the covers. > > I was hoping it was common, and you coul

Re: [Neo4j] Neo4j rest server indexing

2011-02-21 Thread francoisk6
Hi All, I am trying to build a non-exact search plug-in to Neo4J rest server, is there a document or example on how to accomplish that? I checked the get_all_nodes, I am newbie in java and my main problem is how to send the parameters like the index name and the value to be searched for. Thx for

Re: [Neo4j] Unable to parse mapped memory

2011-02-21 Thread Peter Neubauer
Craig, I guess we need to put in 1200M instead? /peter On Monday, February 21, 2011, Craig Taverner wrote: > Hi, > > Recently, since Peter moved Neo4j Spatial to 1.3M02 I think, I stopped being > able to run the Neo4j Spatial unit tests in maven. Most of them now generate > an error like: > > IN

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread J T
Hmm, I hadn't considered the apache approach but it still kind of goes against the grain - perhaps i just want too much or its my innate laziness ... hehe ;) Its not just about data size, its more about not wanting to have to re-engineer/re-factor as things grow - whether that growth is concurrent

Re: [Neo4j] Lucene fulltext index batch inserter Lock obtain problem

2011-02-21 Thread Shae Griffiths
Hi Mattias, > >Are you using multiple threads during batch insertion (not allowed b.t.w.) ? > It's only a single thread as far as I'm aware, unless the Lucene stuff is doing something funky under the covers. I was hoping it was common, and you could say "oh you've forgotten this line" but m

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread Michael Hunger
Hi J.T., of course you can have the cache sharding taken care of by the server side, e.g. use an apache proxy for client sticky routing, redirecting according to URL patterns etc. But that doesn't cover your "domain". The problem is that other than simple kv stores, where the sharding the key

Re: [Neo4j] Can't get a spatial layer

2011-02-21 Thread Craig Taverner
> > def performImport() { >database.shutdown() > val batchInserter = new MyBatchInserter >importer.importFile(batchInserter, filename) > importer.reIndex(database, 1000) >batchInserter.shutdown() > } > But now you are running the reIndex method on a database you previously sh

Re: [Neo4j] Unable to parse mapped memory

2011-02-21 Thread Anders Nawroth
Hi! Do you mean moved to 1.3.M01, because I can't find any branch using 1.3.M02 yet? /anders 2011-02-21 22:43, Craig Taverner skrev: > Hi, > > Recently, since Peter moved Neo4j Spatial to 1.3M02 I think, I stopped being > able to run the Neo4j Spatial unit tests in maven. Most of them now gene

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread J T
I realise that there are different qualities that can come in to play with the labels 'scalability' & 'performance' and I can see how your strategy would help with some of those qualities but it relies on custom logic in the client application to do the sharding and load spreading and doesn't addre

Re: [Neo4j] Can't get a spatial layer

2011-02-21 Thread Nolan Darilek
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 > I think it is the missing call to import.reindex that is causing your > problem. I think so too, especially since I didn't know I had to do it. :) So now my code looks like: def performImport() { database.shutdown() val batchInserter = ne

[Neo4j] Unable to parse mapped memory

2011-02-21 Thread Craig Taverner
Hi, Recently, since Peter moved Neo4j Spatial to 1.3M02 I think, I stopped being able to run the Neo4j Spatial unit tests in maven. Most of them now generate an error like: INFO: Unable to parse mapped memory[1.2] string for /home/craig/dev/neo4j/neo4j-spatial/target/var/neo4j-db/neostore.propert

Re: [Neo4j] Can't get a spatial layer

2011-02-21 Thread Craig Taverner
> > Uh, I would too actually. ;) I thought that all I needed to do was > create the SpatialDatabaseService and start grabbing layers. Well, you can make empty layers if you want, but in order to see layers in the database you must either import data (creates a layer) or create an empty layer (whi

Re: [Neo4j] Can't get a spatial layer

2011-02-21 Thread Nolan Darilek
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/21/2011 02:49 PM, Craig Taverner wrote: > > My Scala is too rusty to comment on any issues with the code, but I must > suspect that the code for loading the layers is probably at fault. You are > only showing the code for listing layers below, s

Re: [Neo4j] Can't get a spatial layer

2011-02-21 Thread Craig Taverner
Hi Nolan, My Scala is too rusty to comment on any issues with the code, but I must suspect that the code for loading the layers is probably at fault. You are only showing the code for listing layers below, so I would like to see the code for loading layers before making any suggestions. I know I

Re: [Neo4j] Getting started with Neo4J Spatial

2011-02-21 Thread Craig Taverner
> > I've jumped right in and am implementing a rough cut of my database > abstraction layer for Neo4J. This brought up a couple more questions. > The Neo4J Spatial readme shows the search query being done inside a > transaction. Is this necessary? My reading of the wiki suggests that a > TX is onl

[Neo4j] Can't get a spatial layer

2011-02-21 Thread Nolan Darilek
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 What conditions would cause there to be no layer names returned by spatialService.getLayerNames(), and null for all calls to spatialService.getLayer(...)? I tweaked my test script slightly such that it dumps me into a console so I can see how well I'v

Re: [Neo4j] Neovigator Weekend Project

2011-02-21 Thread Javier de la Rosa
Very nice! On Mon, Feb 21, 2011 at 09:15, Mattias Persson wrote: > Pretty cool ! > > 2011/2/21 Tobias Ivarsson > >> Nice stuff! >> >> On Mon, Feb 21, 2011 at 6:18 AM, Max De Marzi Jr. > >wrote: >> >> > Guys, >> > >> > So I ran into the Ask Ken project ( http://askken.heroku.com/ ) by >> > Michae

Re: [Neo4j] Index question (ReST API)

2011-02-21 Thread Mattias Persson
2011/2/21 Mark Nijhof > Ok perhaps I don't entirely get indexes yet: > > - Does the key value part need to map to an actual property_name and > property_value of a node? > Doesn't need to, no > - If the value changes then I should update the index manually? (i.e. > delete > the old index and c

[Neo4j] Synchronization model between embedded client and Standalone server

2011-02-21 Thread Brendan
Hi, I want to design a system where each client has a embedded db to store only a subset of a master server db of all clients. Then, should I design a server plug in to extend the currently stateless server services to support transaction by simply wrap few requests into one atomic request and

Re: [Neo4j] Index question (ReST API)

2011-02-21 Thread Mark Nijhof
Ok perhaps I don't entirely get indexes yet: - Does the key value part need to map to an actual property_name and property_value of a node? - If the value changes then I should update the index manually? (i.e. delete the old index and create a new one). - Are indexes the only way I can find a node

Re: [Neo4j] Batch Inserter - db scaling issue (not index scaling issue)

2011-02-21 Thread Mark Harwood
Thanks for taking the time to look over my example, Johan. I was hoping that the batch inserter's memory costs would not be directly linear with the volume of data inserted - sounds like it is?. My assumption was that the indexing service was the service with the comparatively hard task of random-

Re: [Neo4j] Gremlin from Java Error

2011-02-21 Thread Alfredas Chmieliauskas
Thanks a lot. Updated to 0.8-SNAPSHOT. Strangely maven did not resolve groovy dependence automatically. Had to add it by hand. ScriptEngine approach works fine, Gremlin.compile(expr) does not? I understand that it could be faster&cleaner to use groovy, but I need to be able to pass string queries

Re: [Neo4j] Getting started with Neo4J Spatial

2011-02-21 Thread Craig Taverner
> > Actually, MongoDB is just geohashes AFAIK. So it works great for use > cases like Foursquare, but only partially well for me, where I want to > know things like the closest way to x latitude and y longitude. So > perhaps I'm comparing apples and orangutans when comparing MongoDB to > Neo4J. >

Re: [Neo4j] Getting started with Neo4J Spatial

2011-02-21 Thread Nolan Darilek
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/18/2011 06:00 PM, Craig Taverner wrote: > > Internally Neo4j Spatial is working with bounding boxes too. I have to > assume MongoDb does also. Our RTree index is optimized for general spatial > objects, and while it can do distance queries, I th

Re: [Neo4j] Gremlin from Java Error

2011-02-21 Thread Marko Rodriguez
Hi, outE(String) is in Gremlin 0.8-SNASPHOT, not Gremlin 0.7. Note at the bottom of the main Wiki page: "Gremlin documentation is up to date with the current Gremlin codebase, not with the latest Gremlin release." I do this so its easier for me to maintain documentation. The documentation for

[Neo4j] Gremlin from Java Error

2011-02-21 Thread Alfredas Chmieliauskas
Dear all, I have the following code: ScriptEngine engine = new GremlinScriptEngineFactory().getScriptEngine(); List results = new ArrayList(); engine.getBindings(ScriptContext.ENGINE_SCOPE).put("g", getGraph()); engine.getBindings(ScriptContext.ENGINE_SCOPE).put("v", getVertex(startNode)); engine

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread Jim Webber
Yup, you nailed it better than I did Rick. Though your partition strategy might not be just "per user." For example in the geo domain, it makes sense to route requests for particular cities to specific nodes. It'll depend on your application how you generate your routing rules. Jim On 21 Feb 2

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread Michael Hunger
You shouldn't be confused because you got it right :) Cheers Michael Am 21.02.2011 um 15:40 schrieb Rick Otten: > Ok, I'm following this discussion, and now I'm confused. > > My understanding was that the (potentially very large) database is > replicated across all instances. > > If someone n

Re: [Neo4j] Social Networks And Graph Databases

2011-02-21 Thread Rick Otten
Ok, I'm following this discussion, and now I'm confused. My understanding was that the (potentially very large) database is replicated across all instances. If someone needed to traverse to something that wasn't cached, they'd take a performance hit, but still be able to get to it. I had underst

Re: [Neo4j] Batch Inserter - db scaling issue (not index scaling issue)

2011-02-21 Thread Johan Svensson
Mark, I had a look at this and you try to inject 130M relationships with a relationship store configured to 700M. That will not be an efficient insert. If your relationships and data are not sorted the batch inserter would have to unload and load blocks of data as soon as you get over around 22M r

Re: [Neo4j] Online backup works in full but not incremental

2011-02-21 Thread Mattias Persson
I just can't reproduce your problems. How are you doing backup? It looks like (from your wrapper.log) that it's the server which somehow requests to do the incremental backup. Aren't you doing backup of the server database? 2011/2/21 Brendan Cheng > Tobias, > > Here s the stack trace and part of

Re: [Neo4j] Neovigator Weekend Project

2011-02-21 Thread Mattias Persson
Pretty cool ! 2011/2/21 Tobias Ivarsson > Nice stuff! > > On Mon, Feb 21, 2011 at 6:18 AM, Max De Marzi Jr. >wrote: > > > Guys, > > > > So I ran into the Ask Ken project ( http://askken.heroku.com/ ) by > > Michael Aufreiter yesterdat, and though it was pretty awesome... so I > > ported it to u

Re: [Neo4j] Root Node

2011-02-21 Thread Mattias Persson
2011/2/20 Michael Hunger > Yep. Just think in graph index :) > > To clarify: in-graph index, the "natural" index that is the graph itself. > > Michael > > Am 20.02.2011 um 22:26 schrieb Mark Nijhof: > > > Ah right, so I could connect via a relationship my type nodes to this > > reference node (a

Re: [Neo4j] Lucene fulltext index batch inserter Lock obtain problem

2011-02-21 Thread Mattias Persson
2011/2/21 Shae Griffiths > > Hi guys, > > I'm trying to use a LuceneFulltextIndexBatchInserter to index all my data > as > I import it, so I can search on properties other than just an ID, but it > fairly quickly (~5 seconds) comes back with an > "org.apache.lucene.store.LockObtainFailedException

Re: [Neo4j] Spring data and Pipes

2011-02-21 Thread Alfredas Chmieliauskas
Thanks. On Sun, Feb 20, 2011 at 10:18 PM, Michael Hunger wrote: > Alfredas, > > very interesting ideas. I think that kind of repository would have to be > built in your application, _but_ we should provide the building blocks so > that you can easily put it together. Yep. I certainly feel that

Re: [Neo4j] Exception creating EmbeddedGraphDatabase from a Servlet

2011-02-21 Thread Pablo Pareja
Hi Jim, I already did it, I'm using a constant defined in the code for the DB folder which it's the same I used for testing things with a really simple jar. I also tried changing the permissions for every DB file granting every kind of permission to any kind of user (I know that's kind of crazy bu

Re: [Neo4j] Exception creating EmbeddedGraphDatabase from a Servlet

2011-02-21 Thread Jim Webber
Hi Pablo, This caught my eye in your stacktrace: Unable to create directory path[] for Neo4j Can you confirm that you have provided the right path for your database into your Jetty app? Jim ___ Neo4j mailing list User@lists.neo4j.org https://lists.

[Neo4j] Exception creating EmbeddedGraphDatabase from a Servlet

2011-02-21 Thread Pablo Pareja
Hi! I'm having some trouble getting Neo4j DB to work from servlets in my Jetty server. There's no problem when I open the DB from a simple jar program file, however when I put the same code inside a servlet I get this exception: org.neo4j.graphdb.TransactionFailureException: Could not create data

Re: [Neo4j] Slow down on insertion as db grow

2011-02-21 Thread Massimo Lusetti
On Fri, Feb 18, 2011 at 2:31 PM, Tobias Ivarsson wrote: > I recently (yesterday) committed a new feature for Neo4j that will store > these kinds of short strings, making Neo4j store them without having to > involve the DynamicStringStore at all. You should see a substantial speedup > from using t