Re: [Neo4j] Subgraphs

2010-07-23 Thread Symeon (Akis) Papadopoulos
Hi Paul > My questions for the group are: > > 1) Are there any suggestions for how subgraphs might be algorithmically > determined? Are there "clustering" algorithms that might be leveraged? > What you describe brings to my mind the field of "community detection" techniques, i.e. method

Re: [Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-29 Thread Symeon (Akis) Papadopoulos
te just the neo-index. If we face more problems we'll proceed with the kernel update as well. Thanks again for the prompt response! > 2010/1/29 Mattias Persson : > >> 2010/1/29 Symeon (Akis) Papadopoulos : >> >>> Mattias Persson wrote: >>> >

Re: [Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-29 Thread Symeon (Akis) Papadopoulos
Mattias Persson wrote: > Another problem I see is that you're having too granular transactions > which will slow down the insertion process quite a bit. Try grouping a > couple of thousands operations in one transaction and you'll see a > performance boost! > > FYI: I can trigger the problem you we

Re: [Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-28 Thread Symeon (Akis) Papadopoulos
ds, Symeon 2010/1/26 Symeon (Akis) Papadopoulos : Hi all While populating a Neo graph, I got the attached exception (org.apache.lucene.index.MergePolicy$MergeException. See file for details: I replaced a local path with [some-local-path]). My setup is like this:

Re: [Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-27 Thread Symeon (Akis) Papadopoulos
ar (still running the test). What I understand is that there are many open files from lucene due to the fact that no optimize() is called on time. Since optimize() is not exposed from the LuceneIndexService, should I expect that it is handled internally? The project I'm running is ra

Re: [Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-26 Thread Symeon (Akis) Papadopoulos
es in both the graph and the index and we don't commit and that we read in between the transaction commits? > 2010/1/26 Symeon (Akis) Papadopoulos : > >> Hi all >> >> While populating a Neo graph, I got the attached exception >> (org.apache.lucene.index.Merge

[Neo] Possible causes for: org.apache.lucene.index.MergePolicy$MergeException

2010-01-26 Thread Symeon (Akis) Papadopoulos
Hi all While populating a Neo graph, I got the attached exception (org.apache.lucene.index.MergePolicy$MergeException. See file for details: I replaced a local path with [some-local-path]). My setup is like this: I want to benchmark Neo4j for some operations, amongst which is graph loading. So

Re: [Neo] out of swap space

2009-07-21 Thread Symeon (Akis) Papadopoulos
* > > On Tue, Jul 21, 2009 at 2:06 PM, Symeon (Akis) Papadopoulos > wrote: > > >> Hi all >> >> While processing a large Neo graph (in the order of 300k nodes - 2M >> edges), the Java Virtual Machine crashed with the following message: >> >> #

Re: [Neo] out of swap space

2009-07-21 Thread Symeon (Akis) Papadopoulos
date your JDK to the latest one (update 14) and > hopefully the problem will go away. If it does not try send in the > -Xms and set initial heap to max heap (such as java -Xms1024M > -Xmx1024M). Also if you are running in client mode try the -server > switch. > > Regards, > -Joha

[Neo] out of swap space

2009-07-21 Thread Symeon (Akis) Papadopoulos
Hi all While processing a large Neo graph (in the order of 300k nodes - 2M edges), the Java Virtual Machine crashed with the following message: # # An unexpected error has been detected by Java Runtime Environment: # # java.lang.OutOfMemoryError: requested 1024000 bytes for GrET in C:\BUILD_ARE

[Neo] exception with closing neo storage appears only on large graphs

2009-07-20 Thread Symeon (Akis) Papadopoulos
Hi all I get the following exception when I attempt to "shutdown" a neo service (under windows). Exception in thread "main" org.neo4j.impl.nioneo.store.StoreFailureException: Unable to close store [local-path-on-my-pc]\neostore.relationshipstore.db at org.neo4j.impl.nioneo.store.CommonAbs

Re: [Neo] indexing relationships

2009-07-10 Thread Symeon (Akis) Papadopoulos
>> My problem is the following: >> I have a bi-partite graph consisting of two kinds of entities (say Users >> and Images). A User object can be related to Images by means of >> USER_IMAGE relationships. >> Following the design guidelines, I have mapped this scheme to Neo4j in >> the following way

Re: [Neo] indexing relationships

2009-07-07 Thread Symeon (Akis) Papadopoulos
ut I feel that there is much room for improvement... Best regards, Symeon (Akis) > Regards, > Johan > > On Tue, Jul 7, 2009 at 10:48 AM, Tobias > Ivarsson wrote: > >> On Tue, Jul 7, 2009 at 10:12 AM, Symeon (Akis) Papadopoulos >> wrote: >> >> >

Re: [Neo] indexing relationships

2009-07-07 Thread Symeon (Akis) Papadopoulos
://twitter.com/peterneubauer >> >> http://www.neo4j.org - New Energy for Data - The Graph Database. >> http://www.ops4j.org - New Energy for OSS Communities - Open >> Participation Software. >> http://www.oredev.org - Where Good Geeks Grok. >> >> >&g

[Neo] indexing relationships

2009-07-06 Thread Symeon (Akis) Papadopoulos
Hi, I have been experimenting with incremental building of large graphs and I realized that the graph update process would be much faster if there was a possibility to index relationships between pairs of nodes in order to have the possibility for quick lookups. Currently, each time I want to

Re: [Neo] how to decouple transaction management from access to underlying nodes

2009-06-25 Thread Symeon (Akis) Papadopoulos
[My apologies for insisting on this issue.] > There's (at least) two solutions to this problem. One is that, as you > suggest, to have the iterator wrap its methods in transactions in > addition to the code that returns the iterator (look at > org.neo4j.util.TxIterator in neo-utils component). This

Re: [Neo] how to decouple transaction management from access to underlying nodes

2009-06-25 Thread Symeon (Akis) Papadopoulos
eed to change both the Controller and the Model implementation. Is this the recommended practice? Thank you in advance. Regards, Symeon (Akis) > 2009/6/24 Symeon (Akis) Papadopoulos : > >> Hi all >> >> I am a newbie to Neo4j, but as it seems very pertinent to

[Neo] how to decouple transaction management from access to underlying nodes

2009-06-24 Thread Symeon (Akis) Papadopoulos
Hi all I am a newbie to Neo4j, but as it seems very pertinent to my research interests (web 2.0 mining), therefore I am planning to test it as an infrastructure layer for massive graph analysis. One very basic (even naive) question I have regards the separation between transaction management a