Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-07 Thread Rob Atkinson
I'd agree that we need to find an evolution path. I think there are two clues in your Use Case scenario: 1) you want to be able to easily get all the data for a particular part of the world, with minimum effort and maximum understanding 2) when you get there you'll probably have new related data a

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-07 Thread Adrian Custer
Aha! As I thought, your rant is a mixture of a good vision of the issue, an interesting intent to improve things, and an unrealistic dream that we could replace the existing by the improved. You apparently have encountered the issue of reams of duplicated data much more deeply than I ever have

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-07 Thread Rob Atkinson
I have a plan to put some papers together over the next few months, but in a nutshell, GIS systems mess things up by attaching identity to geometries (the surrogates for real world features) then forcing (or not stopping) you having many copies of these geometries as derived datasets, e.g. to provi

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-07 Thread Adrian Custer
Hey Rob, This sounds like an interesting observation. What do you mean by "normalized data management"? I would be interested to have a bit more of your vision to see where it meshes into my (GIS) world view. --adrian On Fri, 2008-07-04 at 11:53 +1000, Rob Atkinson wrote: > Performance is impor

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-03 Thread Rob Atkinson
Performance is important, but as IT history shows, its not the fastest software or hardware that wins the race, it the one that best meets people's needs and capacity to use it, and usually this is perception based - will I get sacked or promoted for using it? GIS paradigms are fundamentally flawe

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-03 Thread Jody Garnett
Andrea Aime wrote: > Jody Garnett ha scritto: >> Thanks Andrea; that email is actually worth a blog post :-) For two >> reasons; it is very informative; and it can start to get people >> excited about 2.5 :-) > Is trying hard to get back to an already established performance level > worth a blog

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-02 Thread Andrea Aime
Jody Garnett ha scritto: > Thanks Andrea; that email is actually worth a blog post :-) For two > reasons; it is very informative; and it can start to get people excited > about 2.5 :-) Is trying hard to get back to an already established performance level worth a blog post? I'd blog about new ac

Re: [Geotools-devel] Some explanations on the current feature performance work

2008-07-02 Thread Jody Garnett
Thanks Andrea; that email is actually worth a blog post :-) For two reasons; it is very informative; and it can start to get people excited about 2.5 :-) Jody > Hi, > since this work of mine is triggering quite a few mails, > I guess I should spend some words so that all of you > can see what we'

[Geotools-devel] Some explanations on the current feature performance work

2008-07-02 Thread aaime
Hi, since this work of mine is triggering quite a few mails, I guess I should spend some words so that all of you can see what we're against. To start with this work, I created a couple of very simple shapefile reading benchmarks, one reads 500.000 line features out of 3 million ones stores in a