Re: [OSM-talk] Mapnik render queue stuck
On 19-8-2010 20:10, John Smith wrote: It's not a case of tiles not being regenerated in a few minutes, it a case of them not updating in a few days even. If they are dropped from the rendering queue, they are only readded when you actively look at them again. When the server load at that time is again high, they might get dropped again. So if you look at the same busy time every day, and nobody is looking at that area during quieter times, that could cause this symptom. -- Lennard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 18:34, Kai Krueger wrote: > But what is imo most likely happening is that the rendering server is at > capacity and thus can't deal with rerenders fast enough, so you won't see > the updates as quickly as you would hope. Also, when it reaches capacity, it It's not a case of tiles not being regenerated in a few minutes, it a case of them not updating in a few days even. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
JohnSmitty wrote: > > make the changes and see if the tiles are > refreshed in a reasonable time period. > The way updates and rerenders work can be a bit complex its full detail. A better explanation can be found at http://help.openstreetmap.org/questions/178/how-often-does-the-main-mapnik-map-get-updated If it works, it works fine, but when not, then it often behaves a bit "unpredictable" unless you do know that detail. But what is imo most likely happening is that the rendering server is at capacity and thus can't deal with rerenders fast enough, so you won't see the updates as quickly as you would hope. Also, when it reaches capacity, it starts becoming a bit unpredictable what and when it renders things, as when the queue is full it starts dropping render requests. Since about one - two month the situation of queue overload has become reasonably common ( http://munin.openstreetmap.org/openstreetmap/yevaud.openstreetmap/renderd_queue.html ) as the number of edits and thus amount of tiles needing to be regenerated continues to grow. So at the moment, a bit of lag is "expected" and doesn't necessarily mean anything is "broken" other than not having enough resources. Kai -- View this message in context: http://gis.638310.n2.nabble.com/Mapnik-render-queue-stuck-tp5436914p5439379.html Sent from the General Discussion mailing list archive at Nabble.com. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Yeah, it definitely doesn't happen all the time. I would say most of my edits work fine and cause a render as anticipated. But there is some set of circumstances that causes something to hiccup. If I see it again I will not touch it and file a bug instead of posting to the mailing list where people can /dirty it. I don't have to worry much about others randomly touching my area here in the middle of Kansas :) Would this go under mapnik or website or something else? Toby On Wed, Aug 18, 2010 at 7:40 PM, John Smith wrote: > On 19 August 2010 09:40, Jon Burgess wrote: >> The automated expiry mechanism is working. There would be many more >> complaints if it was completely broken. >> >> If you believe this is not the case then we need links to some specific >> nodes or ways which you believe should have been rendered. Then we >> someone can investigate further if there is a reason why this data is >> not appearing. > > As Jonas pointed out, view the tiles in the are you want to make some > changes, preferably an area that is unlikely to be touched or messed > with by anyone else, make the changes and see if the tiles are > refreshed in a reasonable time period. > > I've noticed this on and off for a month or so, but I usually end up > forcing a refresh if I care enough to see things updated. > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk > ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 09:40, Jon Burgess wrote: > The automated expiry mechanism is working. There would be many more > complaints if it was completely broken. > > If you believe this is not the case then we need links to some specific > nodes or ways which you believe should have been rendered. Then we > someone can investigate further if there is a reason why this data is > not appearing. As Jonas pointed out, view the tiles in the are you want to make some changes, preferably an area that is unlikely to be touched or messed with by anyone else, make the changes and see if the tiles are refreshed in a reasonable time period. I've noticed this on and off for a month or so, but I usually end up forcing a refresh if I care enough to see things updated. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On Thu, 2010-08-19 at 08:51 +1000, John Smith wrote: > 2010/8/19 Jonas Häggqvist : > > I've had the same suspicion. I've asked around on IRC without response and > > had come to the conclusion that I must be going mad, because surely such a > > thing would be noticed instantly. Maybe not? > > Which is why I didn't file a bug after no one else said anything, I > thought it must have been only me having/noticing the issue. > > Forcing tiles to regenerate via /dirty works, but using render_expired > to tell renderd to expire tiles doesn't seem to have an effect any > more. The automated expiry mechanism is working. There would be many more complaints if it was completely broken. If you believe this is not the case then we need links to some specific nodes or ways which you believe should have been rendered. Then we someone can investigate further if there is a reason why this data is not appearing. Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
2010/8/19 Jonas Häggqvist : > I've had the same suspicion. I've asked around on IRC without response and > had come to the conclusion that I must be going mad, because surely such a > thing would be noticed instantly. Maybe not? Which is why I didn't file a bug after no one else said anything, I thought it must have been only me having/noticing the issue. Forcing tiles to regenerate via /dirty works, but using render_expired to tell renderd to expire tiles doesn't seem to have an effect any more. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 18-08-2010 19:22, John Smith wrote: On 19 August 2010 02:45, Toby Murray wrote: Nope. Someone must have done /dirty on it after I sent the email. Caching issues wouldn't explain why the /status for the tiles claimed they were "due to be rendered" - plus this was on two different computers, 6 hours apart. I mentioned an issue with mod_tile no longer expiring tiles a few weeks ago, but no one else confirmed there was a problem so I didn't bother to file a bug about it. I've had the same suspicion. I've asked around on IRC without response and had come to the conclusion that I must be going mad, because surely such a thing would be noticed instantly. Maybe not? I've several times uploaded changes and not seen them online until many hours later (with vigorous reloading, different browsers etc). -- Jonas Häggqvist rasher(at)rasher(dot)dk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 02:45, Toby Murray wrote: > Nope. Someone must have done /dirty on it after I sent the email. > Caching issues wouldn't explain why the /status for the tiles claimed > they were "due to be rendered" - plus this was on two different > computers, 6 hours apart. I mentioned an issue with mod_tile no longer expiring tiles a few weeks ago, but no one else confirmed there was a problem so I didn't bother to file a bug about it. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Nope. Someone must have done /dirty on it after I sent the email. Caching issues wouldn't explain why the /status for the tiles claimed they were "due to be rendered" - plus this was on two different computers, 6 hours apart. Toby On Wed, Aug 18, 2010 at 11:33 AM, Claudius wrote: > Am 18.08.2010 18:04, Toby Murray: >> >> I uploaded a new stretch of river bank last night (over 3k objects). >> This morning I checked the map and they had not been rendered. (...) >> >> Here is a link to >> the area where you can still see just the river itself with no river >> banks rendered and all the tiles supposedly in the queue. If you zoom >> out one level you will see what I have already re-rendered. >> http://www.openstreetmap.org/?lat=39.18751&lon=-96.25883&zoom=16&layers=M >> >> Toby > > Shows a nicely contoured riverbank to me. Browser caching issue? > Right-click -> Open image address... -> Hit "F5" to reload the image file > > Claudius > > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk > ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Am 18.08.2010 18:04, Toby Murray: I uploaded a new stretch of river bank last night (over 3k objects). This morning I checked the map and they had not been rendered. (...) Here is a link to the area where you can still see just the river itself with no river banks rendered and all the tiles supposedly in the queue. If you zoom out one level you will see what I have already re-rendered. http://www.openstreetmap.org/?lat=39.18751&lon=-96.25883&zoom=16&layers=M Toby Shows a nicely contoured riverbank to me. Browser caching issue? Right-click -> Open image address... -> Hit "F5" to reload the image file Claudius ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Mapnik render queue stuck
I uploaded a new stretch of river bank last night (over 3k objects). This morning I checked the map and they had not been rendered. When I check /status on the tiles they claim that they are "due to be rendered" but they are obviously not actually in the render queue because the queue has hit 0 on the munin graphs several times since I uploaded. Also when I /dirty the tile it re-renders quickly. Is this a bug in renderd? I think I uploaded right around the time of the spike in the data import lag graph at 11:30 or so on the graph so that might be a factor: http://munin.openstreetmap.org/openstreetmap/yevaud.openstreetmap/replication_delay2.html I have already re-rendered some zoom levels but I'll leave it alone for now in case someone wants to take a look at it. Here is a link to the area where you can still see just the river itself with no river banks rendered and all the tiles supposedly in the queue. If you zoom out one level you will see what I have already re-rendered. http://www.openstreetmap.org/?lat=39.18751&lon=-96.25883&zoom=16&layers=M Toby ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render
Peteris Krisjanis schrieb: > HI there! > > I am new to this list, so if this question is already answered, please > don't be harsh :) > I browsed archive, and I didn't saw anything for answer, but maybe I > didn't look hard enough. > > As far as I understand mapnik render rules have been subject of change > recently. I did a string of changes of my home town Ogre, Latvia > yesterday. Today, there is still no indication of anything new in > mapnik slip map render (osmarender has bugs, but have rendered all of > it). Tried to apply /dirty to permalink - still nothing. > > So question is what are rules of mapnik rendering now? > > Permalink in question is: > http://www.openstreetmap.org/?lat=56.81532&lon=24.59946&zoom=16&layers=B000FTF > > Thanks everyone for great work on OSM, > cheers, > Peter. > The /dirty-flag is applied to the tile-paths, e.g. http://a.tile.openstreetmap.org/16/37245/20138.png/dirty and marks this single tile on this single zoomlevel as dirty. This can only be done a number of times each week (afaik). Peter ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render
On Sat, 2009-08-15 at 19:47 +0300, Peteris Krisjanis wrote: > HI there! > > I am new to this list, so if this question is already answered, please > don't be harsh :) > I browsed archive, and I didn't saw anything for answer, but maybe I > didn't look hard enough. > > As far as I understand mapnik render rules have been subject of change > recently. I did a string of changes of my home town Ogre, Latvia > yesterday. Today, there is still no indication of anything new in > mapnik slip map render (osmarender has bugs, but have rendered all of > it). Tried to apply /dirty to permalink - still nothing. > > So question is what are rules of mapnik rendering now? Every few weeks the Mapnik rendering database gets reloaded with the complete OSM planet dump. This takes around 24 hours to complete and is running at the moment. This full import fixes up some data consistency issues which occur with the minutely diff imports. The rendering should start again late tonight or early tomorrow. Your edits should show up within the next few days. Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Mapnik render
HI there! I am new to this list, so if this question is already answered, please don't be harsh :) I browsed archive, and I didn't saw anything for answer, but maybe I didn't look hard enough. As far as I understand mapnik render rules have been subject of change recently. I did a string of changes of my home town Ogre, Latvia yesterday. Today, there is still no indication of anything new in mapnik slip map render (osmarender has bugs, but have rendered all of it). Tried to apply /dirty to permalink - still nothing. So question is what are rules of mapnik rendering now? Permalink in question is: http://www.openstreetmap.org/?lat=56.81532&lon=24.59946&zoom=16&layers=B000FTF Thanks everyone for great work on OSM, cheers, Peter. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik Render Glitch
Hi, Mapnik will render all names even if the feature itself is not rendered. On 6/3/08, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > It appears that Mapnik renders the name of a 'surface=rocks' area, but not > the edge of the area. > > http://www.openstreetmap.org/?lat=49.58993&lon=-114.374895&zoom=18&layers=B00FF > > Simon > > > ___ > talk mailing list > talk@openstreetmap.org > http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk > -- Regards, Thomas Wood (Edgemaster) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
[OSM-talk] Mapnik Render Glitch
It appears that Mapnik renders the name of a 'surface=rocks' area, but not the edge of the area. http://www.openstreetmap.org/?lat=49.58993&lon=-114.374895&zoom=18&layers=B00FF Simon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/talk
