Re: Graph library recommendations for large graphs

2009-08-25 Thread Neal Becker
VanL wrote: > I am working on a project that will require building and querying large > graph objects (initially 8M nodes, 30-40M edges; eventually 40M nodes, > 100M edges). NetworkX seems to be the most popular, but I am concerned > that a dict representation for nodes would use too much memory -

Re: Graph library recommendations for large graphs

2009-08-24 Thread Istvan Albert
On Aug 24, 5:37 pm, VanL wrote: > > Can anybody who has worked with large graphs before give a recommendation? > when using large graphs another limitation may come from the various graph algorithm run times. Most likely you will need to squeeze out as much as possible and a python implementation

Re: Graph library recommendations for large graphs

2009-08-24 Thread Bearophile
You may try the Python bindings for the Boost Graph Library, the graph you talk about may fit in 2GB of a 32 bit OS too (this is the first link I have found, it's a lot of time I don't use those graph bindings): http://banyan.usc.edu/log/c_cpp/boost-graph-library-python-bindings Bye, bearophile --

Re: Graph library recommendations for large graphs

2009-08-24 Thread Diez B. Roggisch
VanL schrieb: I am working on a project that will require building and querying large graph objects (initially 8M nodes, 30-40M edges; eventually 40M nodes, 100M edges). NetworkX seems to be the most popular, but I am concerned that a dict representation for nodes would use too much memory -- m

Graph library recommendations for large graphs

2009-08-24 Thread VanL
I am working on a project that will require building and querying large graph objects (initially 8M nodes, 30-40M edges; eventually 40M nodes, 100M edges). NetworkX seems to be the most popular, but I am concerned that a dict representation for nodes would use too much memory -- my initial test