Re: [OSM-talk] Mapnik render queue stuck
JohnSmitty wrote: make the changes and see if the tiles are refreshed in a reasonable time period. The way updates and rerenders work can be a bit complex its full detail. A better explanation can be found at http://help.openstreetmap.org/questions/178/how-often-does-the-main-mapnik-map-get-updated If it works, it works fine, but when not, then it often behaves a bit unpredictable unless you do know that detail. But what is imo most likely happening is that the rendering server is at capacity and thus can't deal with rerenders fast enough, so you won't see the updates as quickly as you would hope. Also, when it reaches capacity, it starts becoming a bit unpredictable what and when it renders things, as when the queue is full it starts dropping render requests. Since about one - two month the situation of queue overload has become reasonably common ( http://munin.openstreetmap.org/openstreetmap/yevaud.openstreetmap/renderd_queue.html ) as the number of edits and thus amount of tiles needing to be regenerated continues to grow. So at the moment, a bit of lag is expected and doesn't necessarily mean anything is broken other than not having enough resources. Kai -- View this message in context: http://gis.638310.n2.nabble.com/Mapnik-render-queue-stuck-tp5436914p5439379.html Sent from the General Discussion mailing list archive at Nabble.com. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 18:34, Kai Krueger kakrue...@gmail.com wrote: But what is imo most likely happening is that the rendering server is at capacity and thus can't deal with rerenders fast enough, so you won't see the updates as quickly as you would hope. Also, when it reaches capacity, it It's not a case of tiles not being regenerated in a few minutes, it a case of them not updating in a few days even. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19-8-2010 20:10, John Smith wrote: It's not a case of tiles not being regenerated in a few minutes, it a case of them not updating in a few days even. If they are dropped from the rendering queue, they are only readded when you actively look at them again. When the server load at that time is again high, they might get dropped again. So if you look at the same busy time every day, and nobody is looking at that area during quieter times, that could cause this symptom. -- Lennard ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Mapnik render queue stuck
I uploaded a new stretch of river bank last night (over 3k objects). This morning I checked the map and they had not been rendered. When I check /status on the tiles they claim that they are due to be rendered but they are obviously not actually in the render queue because the queue has hit 0 on the munin graphs several times since I uploaded. Also when I /dirty the tile it re-renders quickly. Is this a bug in renderd? I think I uploaded right around the time of the spike in the data import lag graph at 11:30 or so on the graph so that might be a factor: http://munin.openstreetmap.org/openstreetmap/yevaud.openstreetmap/replication_delay2.html I have already re-rendered some zoom levels but I'll leave it alone for now in case someone wants to take a look at it. Here is a link to the area where you can still see just the river itself with no river banks rendered and all the tiles supposedly in the queue. If you zoom out one level you will see what I have already re-rendered. http://www.openstreetmap.org/?lat=39.18751lon=-96.25883zoom=16layers=M Toby ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Am 18.08.2010 18:04, Toby Murray: I uploaded a new stretch of river bank last night (over 3k objects). This morning I checked the map and they had not been rendered. (...) Here is a link to the area where you can still see just the river itself with no river banks rendered and all the tiles supposedly in the queue. If you zoom out one level you will see what I have already re-rendered. http://www.openstreetmap.org/?lat=39.18751lon=-96.25883zoom=16layers=M Toby Shows a nicely contoured riverbank to me. Browser caching issue? Right-click - Open image address... - Hit F5 to reload the image file Claudius ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Nope. Someone must have done /dirty on it after I sent the email. Caching issues wouldn't explain why the /status for the tiles claimed they were due to be rendered - plus this was on two different computers, 6 hours apart. Toby On Wed, Aug 18, 2010 at 11:33 AM, Claudius claudiu...@gmx.de wrote: Am 18.08.2010 18:04, Toby Murray: I uploaded a new stretch of river bank last night (over 3k objects). This morning I checked the map and they had not been rendered. (...) Here is a link to the area where you can still see just the river itself with no river banks rendered and all the tiles supposedly in the queue. If you zoom out one level you will see what I have already re-rendered. http://www.openstreetmap.org/?lat=39.18751lon=-96.25883zoom=16layers=M Toby Shows a nicely contoured riverbank to me. Browser caching issue? Right-click - Open image address... - Hit F5 to reload the image file Claudius ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 02:45, Toby Murray toby.mur...@gmail.com wrote: Nope. Someone must have done /dirty on it after I sent the email. Caching issues wouldn't explain why the /status for the tiles claimed they were due to be rendered - plus this was on two different computers, 6 hours apart. I mentioned an issue with mod_tile no longer expiring tiles a few weeks ago, but no one else confirmed there was a problem so I didn't bother to file a bug about it. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 18-08-2010 19:22, John Smith wrote: On 19 August 2010 02:45, Toby Murraytoby.mur...@gmail.com wrote: Nope. Someone must have done /dirty on it after I sent the email. Caching issues wouldn't explain why the /status for the tiles claimed they were due to be rendered - plus this was on two different computers, 6 hours apart. I mentioned an issue with mod_tile no longer expiring tiles a few weeks ago, but no one else confirmed there was a problem so I didn't bother to file a bug about it. I've had the same suspicion. I've asked around on IRC without response and had come to the conclusion that I must be going mad, because surely such a thing would be noticed instantly. Maybe not? I've several times uploaded changes and not seen them online until many hours later (with vigorous reloading, different browsers etc). -- Jonas Häggqvist rasher(at)rasher(dot)dk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
2010/8/19 Jonas Häggqvist ras...@rasher.dk: I've had the same suspicion. I've asked around on IRC without response and had come to the conclusion that I must be going mad, because surely such a thing would be noticed instantly. Maybe not? Which is why I didn't file a bug after no one else said anything, I thought it must have been only me having/noticing the issue. Forcing tiles to regenerate via /dirty works, but using render_expired to tell renderd to expire tiles doesn't seem to have an effect any more. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On Thu, 2010-08-19 at 08:51 +1000, John Smith wrote: 2010/8/19 Jonas Häggqvist ras...@rasher.dk: I've had the same suspicion. I've asked around on IRC without response and had come to the conclusion that I must be going mad, because surely such a thing would be noticed instantly. Maybe not? Which is why I didn't file a bug after no one else said anything, I thought it must have been only me having/noticing the issue. Forcing tiles to regenerate via /dirty works, but using render_expired to tell renderd to expire tiles doesn't seem to have an effect any more. The automated expiry mechanism is working. There would be many more complaints if it was completely broken. If you believe this is not the case then we need links to some specific nodes or ways which you believe should have been rendered. Then we someone can investigate further if there is a reason why this data is not appearing. Jon ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
On 19 August 2010 09:40, Jon Burgess jburgess...@gmail.com wrote: The automated expiry mechanism is working. There would be many more complaints if it was completely broken. If you believe this is not the case then we need links to some specific nodes or ways which you believe should have been rendered. Then we someone can investigate further if there is a reason why this data is not appearing. As Jonas pointed out, view the tiles in the are you want to make some changes, preferably an area that is unlikely to be touched or messed with by anyone else, make the changes and see if the tiles are refreshed in a reasonable time period. I've noticed this on and off for a month or so, but I usually end up forcing a refresh if I care enough to see things updated. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Mapnik render queue stuck
Yeah, it definitely doesn't happen all the time. I would say most of my edits work fine and cause a render as anticipated. But there is some set of circumstances that causes something to hiccup. If I see it again I will not touch it and file a bug instead of posting to the mailing list where people can /dirty it. I don't have to worry much about others randomly touching my area here in the middle of Kansas :) Would this go under mapnik or website or something else? Toby On Wed, Aug 18, 2010 at 7:40 PM, John Smith deltafoxtrot...@gmail.com wrote: On 19 August 2010 09:40, Jon Burgess jburgess...@gmail.com wrote: The automated expiry mechanism is working. There would be many more complaints if it was completely broken. If you believe this is not the case then we need links to some specific nodes or ways which you believe should have been rendered. Then we someone can investigate further if there is a reason why this data is not appearing. As Jonas pointed out, view the tiles in the are you want to make some changes, preferably an area that is unlikely to be touched or messed with by anyone else, make the changes and see if the tiles are refreshed in a reasonable time period. I've noticed this on and off for a month or so, but I usually end up forcing a refresh if I care enough to see things updated. ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
