[OSM-talk] 500 Internal Server Error during upload

[Jacek Konieczny]

Hello,

I am having problems batch-uploading some changes. I have split my
change files into small pieces (~160kB, 250 nodes each, as I had
problems with big uploads previously), but it doesn't help much this
time. I get "500 Internal Server Error" for most attempts. Only
sometimes the upload will succeed.

Is that a know problem? Is there a known workaround? 
Should I try to modify my upload script to split changesets into even
smaller chunks (a few nodes, maybe) and make it try each chunk until it
succeeds? Though, I would prefer to keep things simple as they are now
(one osmChange file uploaded in one changeset)…

Is there any other existing tool to upload osmChange files?

Greets,
Jacek

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Ian Dees]

On Tue, Apr 28, 2009 at 2:19 AM, Jacek Konieczny  wrote:

> Hello,
>
> I am having problems batch-uploading some changes. I have split my
> change files into small pieces (~160kB, 250 nodes each, as I had
> problems with big uploads previously), but it doesn't help much this
> time. I get "500 Internal Server Error" for most attempts. Only
> sometimes the upload will succeed.
>
> Is that a know problem? Is there a known workaround?
> Should I try to modify my upload script to split changesets into even
> smaller chunks (a few nodes, maybe) and make it try each chunk until it
> succeeds? Though, I would prefer to keep things simple as they are now
> (one osmChange file uploaded in one changeset)…
>
> Is there any other existing tool to upload osmChange files?
>

It would appear that the database server is under extremely heavy load at
the moment:

http://munin.openstreetmap.org/openstreetmap/smaug.openstreetmap-pg_openstreetmap_locks.html

(I'm not entirely sure that that is the correct measure to look at, but it
certainly seems very high.)
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Ian Dees]

On Tue, Apr 28, 2009 at 2:19 AM, Jacek Konieczny  wrote:

> Hello,
>
> I am having problems batch-uploading some changes. I have split my
> change files into small pieces (~160kB, 250 nodes each, as I had
> problems with big uploads previously), but it doesn't help much this
> time. I get "500 Internal Server Error" for most attempts. Only
> sometimes the upload will succeed.


Or! It could be all the Germans racing to get to the 100th changeset:

http://openstreetmap.org/browse
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Jacek Konieczny]

On Tue, Apr 28, 2009 at 02:29:12AM -0500, Ian Dees wrote:
> Or! It could be all the Germans racing to get to the 100th changeset:

100th reached, then the load should drop now :) 
And it should be quite sane, until near 1234567th, I guess ;)

Greets,
Jacek

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Ed Loach]

Torsten wrote:

> can anybody give me a hint on a GPS logger?  I'd just like to
> track the
> position on SD card.
> It would be great if the battery would last for a week or even
> longer.
> 
> That should also be much cheaper than e.g. Garmin GPS devices.

I'm quite happy with my NaviGPS GT-31 as listed under Scytex/Locosys
on this page:
http://wiki.openstreetmap.org/wiki/GPS_Reviews
specifically here:
http://wiki.openstreetmap.org/wiki/GPS_Reviews#Scytex_NaviGPS_.2F_Lo
cosys_.28B.29GT-31

I save the tracks and/or waypoints to the SD card and use their
software to convert the BIN file to GPX/KML/NMEA/PLT/WPT and
whatever else it does. I've got a 128MB card in it at the moment and
all the mapping I've done since I had it in August amounts to about
14MB of BIN files (although I copy them off each time I get home). A
6 to 7 hour walk was about a 700MB BIN file (though I split it into
4 sections) with points taken every second.

I don't know how long the battery lasts; it recharges from USB which
I do when I get home and I've not been away for a week yet. And if I
did I have USB chargers from the mains/car that I can use overnight.

I also got the bicycle mount for it.

UK users can get it from Storage Depot who then make a donation to
OSM:
http://wiki.openstreetmap.org/wiki/Merchandise#Storage_Depot
But I don't know about availability in Germany.

Ed

PS: I'd love a unit which displayed what had already been mapped. I
suspect I'll get something later this year, but will probably still
use the GT-31 as well for a second opinion when checking accuracy...



___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Etienne Chové]

Jacek Konieczny a écrit :
> On Tue, Apr 28, 2009 at 02:29:12AM -0500, Ian Dees wrote:
>> Or! It could be all the Germans racing to get to the 100th changeset:
> 
> 100th reached, then the load should drop now :) 
> And it should be quite sane, until near 1234567th, I guess ;)

Congratulation to french contributor nin2jardin who reached the 
100th changeset, and to all osm contributors who have made 99 
previous changesets so he could reached this one.

-- 
Etienne


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[OJ W]

The NaviGPS isn't ideal if you're away from a source of power, since
its internal battery lasts about 1 day, and you can't just put spare
batteries into it.

It might be possible to get somewhere with a USB power-pack to
recharge it overnight (that's what I used for a 1-week trek, which
meant constantly feeding batteries into the usb-recharging-gadget to
try and keep the NaviGPS' internal battery charged - not very
efficient)

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Jacek Konieczny]

On Tue, Apr 28, 2009 at 02:26:50AM -0500, Ian Dees wrote:
> It would appear that the database server is under extremely heavy load at
> the moment:
>
> [2]http://munin.openstreetmap.org/openstreetmap/smaug.openstreetmap-pg_openstreetmap_locks.html
> (I'm not entirely sure that that is the correct measure to look at, but it
>  certainly seems very high.)

Load on these graphs is significantly lower now, but I still get "500"
errors during uploads. Not that often as before (one in two fails
instead of one in ten succeeding), but still it is no good.

Greets,
Jacek 

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Jonas Svensson]

On Tue, 28 Apr 2009, OJ W wrote:

> The NaviGPS isn't ideal if you're away from a source of power, since
> its internal battery lasts about 1 day, and you can't just put spare
> batteries into it.
>
> It might be possible to get somewhere with a USB power-pack to
> recharge it overnight (that's what I used for a 1-week trek, which
> meant constantly feeding batteries into the usb-recharging-gadget to
> try and keep the NaviGPS' internal battery charged - not very
> efficient)

Or solar powered, like . I
have not tried one but would like to know if they are usable?

/Jonas


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Celso González]

On Tue, Apr 28, 2009 at 12:25:29AM +0200, Torsten Mohr wrote:
> Hi,
> 
> can anybody give me a hint on a GPS logger?  I'd just like to track the 
> position on SD card.
> It would be great if the battery would last for a week or even longer.
> 
> That should also be much cheaper than e.g. Garmin GPS devices.

Royaltek RBT-2300
http://www.semsons.com/rorbgpsdalos.html
Logger with 64Mb internal memory, no SD card, all the operational is done
through Bluetooth.

Pros:
-Very light
-Nokia standard batteries, duration good
-Good chipset 

Cons:
-Plastic like
-No way to mark POIs


-- 
Celso González (PerroVerd)
http://mitago.net

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Maarten Deen]

On Tue, Apr 28, 2009 at 12:25:29AM +0200, Torsten Mohr wrote:

> can anybody give me a hint on a GPS logger?  I'd just like to track the
> position on SD card.
> It would be great if the battery would last for a week or even longer.
>
> That should also be much cheaper than e.g. Garmin GPS devices.

BTW: there is a list of GPS devices (loggers, handhelds and others) at
, which also includes
information on storage types. Some even have small reviews at the bottom of
the page.

Regards,
Maarten




___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Tom Hughes]

Jacek Konieczny wrote:
> On Tue, Apr 28, 2009 at 02:26:50AM -0500, Ian Dees wrote:
>> It would appear that the database server is under extremely heavy load at
>> the moment:
>>
>> [2]http://munin.openstreetmap.org/openstreetmap/smaug.openstreetmap-pg_openstreetmap_locks.html
>> (I'm not entirely sure that that is the correct measure to look at, but it
>>  certainly seems very high.)
> 
> Load on these graphs is significantly lower now, but I still get "500"
> errors during uploads. Not that often as before (one in two fails
> instead of one in ten succeeding), but still it is no good.

Well I'm very sorry about that. I shall drop what I'm doing and rush 
over and establish a priority upload channel for you.

Look people, we have new servers and software and we are working to tune 
them and resolve various issues. Please be patient and stop all this 
moaning in the mean time...

Tom

-- 
Tom Hughes (t...@compton.nu)
http://www.compton.nu/

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Matt Amos]

On Tue, Apr 28, 2009 at 12:16 PM, Tom Hughes  wrote:
> Look people, we have new servers and software and we are working to tune
> them and resolve various issues. Please be patient and stop all this
> moaning in the mean time...

406 ;-)

cheers,

matt

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Jacek Konieczny]

On Tue, Apr 28, 2009 at 12:16:41PM +0100, Tom Hughes wrote:
> Well I'm very sorry about that. I shall drop what I'm doing and rush 
> over and establish a priority upload channel for you.

There is some kind of problem and I am just reporting it. Is that wrong?
Should I just put the upload in a loop and wait until the problem
"resolves itself"?

> Look people, we have new servers and software and we are working to tune 
> them and resolve various issues. 

I was hoping I can help you somehow, providing some information… it
seems I was wrong :-(  You may delete the Trac ticket I have created
before a moment too, if that makes you happy.

Greets,
Jacek

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Tom Hughes]

Jacek Konieczny wrote:
> On Tue, Apr 28, 2009 at 12:16:41PM +0100, Tom Hughes wrote:
>> Well I'm very sorry about that. I shall drop what I'm doing and rush 
>> over and establish a priority upload channel for you.
> 
> There is some kind of problem and I am just reporting it. Is that wrong?
> Should I just put the upload in a loop and wait until the problem
> "resolves itself"?

Well I wouldn't recommend scripting a loop, but at the moment I'm only 
really interested in 500 errors that are persistent - ie a changeset 
that always produces a 500 when uploaded. That will generally indicate a 
coding error on the server.

Intermittent 500s are generally the results of timeouts, memory leaks, 
stuck daemons, etc (which are all inter-related anyway) and as such are 
not very interesting in and of themselves.

Tom

-- 
Tom Hughes (t...@compton.nu)
http://www.compton.nu/

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Maarten Deen]

OJ W wrote:
> The NaviGPS isn't ideal if you're away from a source of power, since
> its internal battery lasts about 1 day, and you can't just put spare
> batteries into it.
>
> It might be possible to get somewhere with a USB power-pack to
> recharge it overnight (that's what I used for a 1-week trek, which
> meant constantly feeding batteries into the usb-recharging-gadget to
> try and keep the NaviGPS' internal battery charged - not very
> efficient)

There are power-plug type chargers with USB connection. Just look for "USB
charger" on the internet.

Maarten


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 500 Internal Server Error during upload

[Jacek Konieczny]

On Tue, Apr 28, 2009 at 01:41:26PM +0100, Tom Hughes wrote:
> Well I wouldn't recommend scripting a loop,

I wouldn't to that anyway. I know the servers do not need extra
unnecessary load. I will just manually retry from time to time.

> but at the moment I'm only 
> really interested in 500 errors that are persistent - ie a changeset 
> that always produces a 500 when uploaded. That will generally indicate a 
> coding error on the server.
> 
> Intermittent 500s are generally the results of timeouts, memory leaks, 
> stuck daemons, etc (which are all inter-related anyway) and as such are 
> not very interesting in and of themselves.

Thanks. No I know it is not a problem on my side or unexpected problem
at the servers. I'll wait for the end of these hard times. 

Good luck with the serious troubleshooting! :)

Greets,
Jacek

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

[OSM-talk] 403 error getting data

[William Gresham]

I am trying to edit data in the eastern United States, but Potlatch will not 
load any of the ways (the farthest it will get are green landmarks), and 
attempts to load the data into JOSM return a 403 error. Is it just me here?___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPX track upload failure

[Ed Avis]

Ed Avis  waniasset.com> writes:

>I tried to upload a .gpx file with about 4500 trackpoints, but when I press
>Upload the page waits for about a minute and then my web browser says 'The
>connection to the server was reset while the page was loading.'.

I'm pleased to report this now works.  Thanks to everyone who worked on the
server upgrade!

-- 
Ed Avis 


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] GPS logger

[Russ Nelson]

On Apr 27, 2009, at 3:25 PM, Torsten Mohr wrote:
> can anybody give me a hint on a GPS logger?  I'd just like to track  
> the
> position on SD card.
> It would be great if the battery would last for a week or even longer.


http://community.cloudmade.com/blog/2009/03/16/columbus-v-900-review/

Records to an SD card.  Records audio notes.  Battery is good for 30  
hours.  On the downside, the file is funky, but I have a Python  
program to convert it to GPX.  US$100.  Has a waypoint button.   
Streams to bluetooth.

http://community.cloudmade.com/blog/2009/03/03/the-amod-agl3080-data-logger/

Records to an internal 128MB flash, which gets exposed as a flash  
drive via USB.  File format is NMEA sentences.  GPSBabel will convert  
them.  Has a waypoint button.  Uses three AAA batteries.  $70.

I also have a Wintec BT-104.  Don't remember how much memory it has.   
Newer versions of GPSBabel can download from it.  Streams to bluetooth  
and serial.  Has a compass.  Was $100 when I bought it; dunno what it  
goes for now.

I recommend them all, but audio mapping with the Columbus is the most  
fun.

--
Russ Nelson - http://community.cloudmade.com/blog - 
http://wiki.openstreetmap.org/wiki/User:RussNelson
r...@cloudmade.com - Twitter: Russ_OSM - 
http://openstreetmap.org/user/RussNelson


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 403 error getting data

[Dirk-Lüder Kreie]

William Gresham schrieb:
> I am trying to edit data in the eastern United States, but Potlatch will not 
> load any of the ways (the farthest it will get are green landmarks), and 
> attempts to load the data into JOSM return a 403 error. Is it just me here?


Can you give a bbox or permalink URL where this is happening? Maybe you
just ask too much at once from the server.

-- 

Dirk-Lüder "Deelkar" Kreie
Bremen - 53.0952°N 8.8652°E



signature.asc
Description: OpenPGP digital signature
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] 403 error getting data

[Shaun McDonald]

On 28 Apr 2009, at 17:40, Dirk-Lüder Kreie wrote:

> William Gresham schrieb:
>> I am trying to edit data in the eastern United States, but Potlatch  
>> will not load any of the ways (the farthest it will get are green  
>> landmarks), and attempts to load the data into JOSM return a 403  
>> error. Is it just me here?
>
>
> Can you give a bbox or permalink URL where this is happening? Maybe  
> you
> just ask too much at once from the server.
>

This problem was resolved on IRC. The original poster was caught while  
the application servers were being restarted.

Shaun


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] [Talk-us] Mysterious 403s on TIGER place bulk uploads

[Ian Dees]

On Tue, Apr 28, 2009 at 3:21 PM, Chris Lawrence  wrote:

> Is there a good reason why my TIGER place bulk uploads keep getting
> blocked with 403s?  I'll gladly add further backoffs and more reuse of
> existing changesets (currently I've set the uploader to chunks of 250
> elements and changesets of 20 uploads, essentially limiting each
> changeset to 5000 elements, with a 15 second delay before retrying a
> 500 error and bailing after 3 consecutive 500s or any other error), or
> even add a delay between each chunk if the server needs to
> breathe/reduce contention, but it'd be nice if someone *told* me what
> the problem was so I could fix it.


I'm having problems with my NHD uploads, too. I started with 50k elements in
each changeset (like the capabilities API says) and have backed all the way
down to 2. The problem is that the server accepted one of the
20k-element changesets, so I have to keep using those so the IDs don't get
screwed up.

Perhaps it's the clients fault, but I don't see any description of why the
upload failed returned back (using JOSM in this case). It just keeps
retrying.
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

[OSM-talk] OSM maps of Denmark for download to Garmin devices

[Carsten Nielsen]

Why is there nolonger any OSM based Garmin maps (img), available for
download ?

I am just wondering why all the usual places for download of maps
nolonger are providing
files for Denmark ?

http://www.osm4you.com/Europe/Denmark/denmark_gmapsupp_img.zip   Only
330 bytes and useless file
http://garmin.na1400.info/routable.php  As the only place in
europa no files area vailable for Denmark
http://emexes.powweb.com/osm/ Is totally gone

This is not a big problem for me because I can create my own maps with
mkgmap, but it made wonder
about som problems I have had.

I have made my own garmin map files for some time (I want a bit more
than just denmark) without problems,
but after someone made a major import of public address information I
was unable to create maps
with mkgmap (even when using the splitter). I have made a little program
that remove all the address nodes
from my downloaded osm files, and now I can create garmin maps again.

Is it the same problem that hit me which tis causing problems at themap
sites aswell ?

Are there anybody else out there that can make garmin maps of denmark
with mkgmap ?

ablansinger  / Carsten Nielsen

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] OSM maps of Denmark for download to Garmin devices

[Ed Avis]

Carsten Nielsen  toensberg.dk> writes:

>Why is there nolonger any OSM based Garmin maps (img), available for
>download ?

Have you tried ?

-- 
Ed Avis 


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] OSM maps of Denmark for download to Garmin devices

[Lambertus]

I plan to have those missing tiles for Denmark on 
 fixed with the next update 
which is within a week.

Carsten Nielsen wrote:
> Why is there nolonger any OSM based Garmin maps (img), available for
> download ?
> 
> I am just wondering why all the usual places for download of maps
> nolonger are providing
> files for Denmark ?
> 
> http://www.osm4you.com/Europe/Denmark/denmark_gmapsupp_img.zip   Only
> 330 bytes and useless file
> http://garmin.na1400.info/routable.php  As the only place in
> europa no files area vailable for Denmark
> http://emexes.powweb.com/osm/ Is totally gone
> 
> This is not a big problem for me because I can create my own maps with
> mkgmap, but it made wonder
> about som problems I have had.
> 
> I have made my own garmin map files for some time (I want a bit more
> than just denmark) without problems,
> but after someone made a major import of public address information I
> was unable to create maps
> with mkgmap (even when using the splitter). I have made a little program
> that remove all the address nodes
> from my downloaded osm files, and now I can create garmin maps again.
> 
> Is it the same problem that hit me which tis causing problems at themap
> sites aswell ?
> 
> Are there anybody else out there that can make garmin maps of denmark
> with mkgmap ?
> 
> ablansinger  / Carsten Nielsen
> 
> ___
> talk mailing list
> talk@openstreetmap.org
> http://lists.openstreetmap.org/listinfo/talk


___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

[OSM-talk] authorization to import Lombardy data in OSM

[Simone Cortesi]

Hi,

I've just received authorization to import all or the Regional
Administration of Lombardy data in OpenStreetMap. Lombardy, the place
where I live, now joins three other italian regions which explicitly
gave authorization to OSMappers to import data in to the DB.

We can either use WMS or download shapefiles, then to be automatically
imported in the main DB.

It would be very useful IMHO to have such a nice Plugin like the one
for the French Cadastre
, so it
would be easy to add source key/value as asked by the Regional
Government. Anyone up to the task of making a general purpose "source
adder" JOSM plugin?

Thanks,
Simone.

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

[OSM-talk] Mapnik Update Latency?

[Ian Dees]

How quickly are the Mapnik tiles getting updated? What would it take to add
a Munin graph showing the number of tiles in the render queue? I'd be happy
to implement it, but I'm not sure where to start.

I feel like this has been asked before, but I couldn't find a response in
the quick Google search.
___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

Re: [OSM-talk] authorization to import Lombardy data in OSM

[Frederik Ramm]

Hi,

Simone Cortesi wrote:
> It would be very useful IMHO to have such a nice Plugin like the one
> for the French Cadastre
> , so it
> would be easy to add source key/value as asked by the Regional
> Government. Anyone up to the task of making a general purpose "source
> adder" JOSM plugin?

Unless there is a very good reason to tag every single object, consider 
whether it might be sufficient to have that kind of information in the 
changeset. Changesets can have any number of tags, so you could, for 
example, write the WMS URL and other metadata into the changeset. Let's 
try and move metadata away from the individual objects and into the 
changeset.

Information about the real world goes directly into OSM tags: What is 
this, how high is it, what colour does it have, when was it built, etc.

Information about that information goes into the changeset: Why do we 
known, how did we measure, who gave us permission, and what music did we 
hear during out editing session.

Bye
Frederik

-- 
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk

[OSM-talk] OSM POIs searchable in KDE Marble

[maning sambale]

I've just discovered this last night.  Nice!

There is also an opencyclemap in Marble.

-- 
cheers,
maning
--
"Freedom is still the most radical idea of all" -N.Branden
wiki: http://esambale.wikispaces.com/
blog: http://epsg4253.wordpress.com/
--

___
talk mailing list
talk@openstreetmap.org
http://lists.openstreetmap.org/listinfo/talk