Re: [OSM-talk] Delay before the data is visible?
On Fri, 24 Apr 2009, Brett Henderson wrote: > I've just checked now and unless I'm confused by timezones it seems to be > running 5 minutes behind as per normal. Oops, You're right - it looks fine, I was being an idiot with respect to daylight savings. :) - Steve xmpp:st...@nexusuk.org sip:st...@nexusuk.org http://www.nexusuk.org/ Servatis a periculum, servatis a maleficum - Whisper, Evanescence ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
Hi Steve, some responses from an osmosis point of view below. Steve Hill wrote: > On Tue, 21 Apr 2009, Shaun McDonald wrote: > > >> The renderers are delayed until the minutely diff are working again. >> There are some bugs there that need to be resolved first. Then there >> will be a delay of a few hours/days once the diffs come back up. >> No idea :-) > 2. I noticed the minutely deltas are now delayed by an hour (used to be > about 5 minutes). Is this down to server load? If so, why are the > servers suddenly so much busier than before the API change (there don't > seem to be that many uploads happenning and I wouldn't have thought there > would be a big increase in downloads since the API change). > They shouldn't be delayed. The dev server clock was around 30 minutes slow for a while but this has been fixed. I've now updated osmosis to read the database clock to avoid this happening again. A heavily loaded database server that is still allowing new connections shouldn't slow down minute changesets, it takes just over 2 seconds for a typical changeset to be generated and that includes jvm startup time. If the database server stops accepting new connections (has happened once due to connection limit being exceeded) then changesets will stop completely but will rapidly catch up again when the problem is rectified at the rate of approximately 25 changesets per minute. I've just checked now and unless I'm confused by timezones it seems to be running 5 minutes behind as per normal. With the current database performing quite well and never causing random query delays with locked tables I may be able to reduce the 5 minute delay down to 1 or 2 but I'm holding off on that one until I'm more sure. > 3. The deltas are much smaller than they used to be and there are long > periods where they are completely empty. A look at the "recent changes" > page seems to show that there really are long periods when no one is > committing any data. Is this down to people actually not trying to upload > anything or is the API undergoing periods of breakage so that people can't > upload anything? > The empty periods correspond to API downtime. I believe there has been issues with API daemons locking up which result in no changes for osmosis to process. As for the size, looking at daily diffs doesn't show any drastic difference in change sizes that can't be explained by the outage periods. Brett ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
2009/4/22 Ed Loach > > How large is the current delay before uploaded data became > > visible? > > My question is slightly different. I uploaded two changesets > successfully earlier from JOSM (the third took over an hour so I > clicked Abort and ended up losing my edits, so lucky there weren't > too many. I'll try again when things calm down a bit). > http://www.openstreetmap.org/user/EdLoach/edits > > FYI, I had a problem uploading earlier due to the API not responding to the create changeset request, I also hit cancel, though the subsequent abort didn't complete, so closed the upload window, subsequent upload attempts seeming didn't result in JOSM actually trying again, at this point I was able to save the changes and have since reopened and uploaded them when the API has become available again... No edits lost... Using josm 1529... d ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
On Tue, 21 Apr 2009, Shaun McDonald wrote: > The renderers are delayed until the minutely diff are working again. > There are some bugs there that need to be resolved first. Then there > will be a delay of a few hours/days once the diffs come back up. Some curiosities/observations: 1. Is OSM now using the tile expiry code I implemented in osm2pgsql to work out what to re-render, or is it using something different? 2. I noticed the minutely deltas are now delayed by an hour (used to be about 5 minutes). Is this down to server load? If so, why are the servers suddenly so much busier than before the API change (there don't seem to be that many uploads happenning and I wouldn't have thought there would be a big increase in downloads since the API change). 3. The deltas are much smaller than they used to be and there are long periods where they are completely empty. A look at the "recent changes" page seems to show that there really are long periods when no one is committing any data. Is this down to people actually not trying to upload anything or is the API undergoing periods of breakage so that people can't upload anything? - Steve xmpp:st...@nexusuk.org sip:st...@nexusuk.org http://www.nexusuk.org/ Servatis a periculum, servatis a maleficum - Whisper, Evanescence ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
On Tue, 21 Apr 2009, Jonathan Bennett wrote: > It could be that you get no warning when the upload fails under certain > circumstances. Hasn't happened to me on the latest SVN build, though. I noticed the exact opposite to this on Tuesday - JOSM thought the upload had failed, the OSM servers thought it succeeded. The result was that the next attempt the upload successfully re-uploaded the same data. - Steve xmpp:st...@nexusuk.org sip:st...@nexusuk.org http://www.nexusuk.org/ Servatis a periculum, servatis a maleficum - Whisper, Evanescence ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
On 21 Apr 2009, at 17:32, Ed Loach wrote: >> How large is the current delay before uploaded data became >> visible? > > My question is slightly different. I uploaded two changesets > successfully earlier from JOSM (the third took over an hour so I > clicked Abort and ended up losing my edits, so lucky there weren't > too many. I'll try again when things calm down a bit). > http://www.openstreetmap.org/user/EdLoach/edits > However, neither are showing on Mapnik yet and some hours later I've > just manually requested a rerender of the two relevant z12 tiles via > t...@h/Osmarender. > I don't know what triggers Mapnik and/or Osmarender to render given > tiles, but I've cleared all cached information here viewed the areas > at various zoom levels, cleared again, waited, and still I see no > differences. > > I mention it in case there is an issue. Has anyone successfully > viewed any changes they’ve made today on any particular rendering > (without manual intervention to get Osmarender to show changes)? > The renderers are delayed until the minutely diff are working again. There are some bugs there that need to be resolved first. Then there will be a delay of a few hours/days once the diffs come back up. Shaun ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
On Tue, Apr 21, 2009 at 4:32 PM, Ed Loach wrote: >> How large is the current delay before uploaded data became >> visible? > > My question is slightly different. I uploaded two changesets > successfully earlier from JOSM (the third took over an hour so I > clicked Abort and ended up losing my edits. Did your experience match this bug I reported against JOSM perhaps: http://josm.openstreetmap.de/ticket/2429 ? ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
> How large is the current delay before uploaded data became > visible? My question is slightly different. I uploaded two changesets successfully earlier from JOSM (the third took over an hour so I clicked Abort and ended up losing my edits, so lucky there weren't too many. I'll try again when things calm down a bit). http://www.openstreetmap.org/user/EdLoach/edits However, neither are showing on Mapnik yet and some hours later I've just manually requested a rerender of the two relevant z12 tiles via t...@h/Osmarender. I don't know what triggers Mapnik and/or Osmarender to render given tiles, but I've cleared all cached information here viewed the areas at various zoom levels, cleared again, waited, and still I see no differences. I mention it in case there is an issue. Has anyone successfully viewed any changes they’ve made today on any particular rendering (without manual intervention to get Osmarender to show changes)? Ed ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
Ben Laenen wrote: > Are the servers really so insanely busy? I can see only a few people > uploading something every minute > http://www.openstreetmap.org/browse/changesets and that doesn't really > strike me as something this new server shouldn't be able to handle > smoothly... Downloads are generally the problem, not uploads. Tom -- Tom Hughes (t...@compton.nu) http://www.compton.nu/ ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
On Tuesday 21 April 2009, Jonathan Bennett wrote: > MP wrote: > > How large is the current delay before uploaded data became visible? > > I've uploaded some changes in JOSM, provided a comment ... and when > > I re-downloaded the area again, my changes were not there. > > The servers are *very, very* busy right now, and it's possible that > your changes didn't get committed to the DB. The best advice right > now is to go outside, do something fun (like collecting tracks) and > come back when everything's calmed down a little. Are the servers really so insanely busy? I can see only a few people uploading something every minute http://www.openstreetmap.org/browse/changesets and that doesn't really strike me as something this new server shouldn't be able to handle smoothly... Except when every edit includes an entire city of changes of course... Ben ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
Frederik Ramm wrote: > That would be a bug in JOSM then. The API has no delay. It could be that you get no warning when the upload fails under certain circumstances. Hasn't happened to me on the latest SVN build, though. -- Jonathan (Jonobennett) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
MP wrote: > How large is the current delay before uploaded data became visible? > I've uploaded some changes in JOSM, provided a comment ... and when I > re-downloaded the area again, my changes were not there. The servers are *very, very* busy right now, and it's possible that your changes didn't get committed to the DB. The best advice right now is to go outside, do something fun (like collecting tracks) and come back when everything's calmed down a little. -- Jonathan (Jonobennett) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Delay before the data is visible?
Hi, > How large is the current delay before uploaded data became visible? > I've uploaded some changes in JOSM, provided a comment ... and when I > re-downloaded the area again, my changes were not there. That would be a bug in JOSM then. The API has no delay. Bye Frederik ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Delay before the data is visible?
How large is the current delay before uploaded data became visible? I've uploaded some changes in JOSM, provided a comment ... and when I re-downloaded the area again, my changes were not there. Martin ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
