Re: [Talk-ca] GeoTiff in JOSM
On Fri, Sep 9, 2011 at 12:07 AM, Paul Norman penor...@mac.com wrote: xjjk has put up his scripts at http://caligula.rhombic.net/~xjjk/OpenStreetMap/scripts/ gdal2tiles-mp.py is the multi-threaded version Rename-TMS-layout-to-Google-Layout.py creates a script that renames tiles. Excellent; I'll take a look at those and give this another shot. For your 6 hour run, what resampling did you use, how big was the source GeoTIFF (with or without overviews) and what was the highest zoom range done? I was working from a 1.9GB MrSid file; I had initially generated a tiled GeoTiff (without overviews) and it comes in at 28GB. However I ran gdal2tiles on the MrSid file. I used all the default options so I ended up with zoom levels 9-17 for this particular MrSid as well as the default rendering options. I'll give it another shot with one of the higher quality ones. Tyler ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
-Original Message- Subject: Re: [Talk-ca] GeoTiff in JOSM On Fri, Sep 2, 2011 at 12:55 PM, penorman penor...@mac.com wrote: I'm at work and going on vacation so I can't give a detailed answer for a few days, but this might help No problem, any help is appreciated. Once the tiles are made you can serve the directories with apache or another web server. Ah, okay I didn't realize it was that simple. I believe you can also have JOSM get files directly from your hard drive, but I'm not sure the syntax to do so on the Mac. xjjk from the OSM IRC channel has a parallized version of gdal2tiles which can significantly help processing times if you have a multi-core CPU. Would that be maptiler? Maptiler is essentially a graphical front-end to gdal2tiles. Xjjk's version is the command line version modified. My iMac broke awhile back so I'm not sure how easy/hard GDAL is to set up with python bindings on OS X. I've got a dual quad-core Xeon Mac Pro with 14 gb of ram so a parallelized version would be a must. :) You'll still be limited by your CPU :P I'll have to give it a shot and see how long it takes to process some portion of my GeoTiff. The tiled GeoTiff is about 16 GB, where the original MrSid is 1.9GB. Might be doable. :) What I did for testing was work on a small section downloaded separately and benchmarked with different image scaling methods. The three worth considering are nearest, antialias, and lanczos. Nearest is fastest, preserves sharp edges but has the worst quality. Antialias is decently fast, decent quality. Lanczos is the best quality, preserves edges but is extremely slow. ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
I believe you can also have JOSM get files directly from your hard drive, but I'm not sure the syntax to do so on the Mac. I did a render with gdal2tiles and was able to get it working fine in Merkaator. Something about the tile number origin being opposite in JOSM. Maptiler is essentially a graphical front-end to gdal2tiles. Xjjk's version is the command line version modified. My iMac broke awhile back so I'm not sure how easy/hard GDAL is to set up with python bindings on OS X. Ah, okay. I'll have to drop Xjik a line and see if I can get a copy of the modified command line file. It seems there WAS a version of gdal2tiles tat was optimized for multi-core, but the author seems to be charging for it. There is a pre-made gdal install package for OSX, so it was extremely easy to get up. Click and install. You'll still be limited by your CPU :P On a single core my 1.9GB image took around 6 hours. So not too bad but faster would be nice. What I did for testing was work on a small section downloaded separately and benchmarked with different image scaling methods. The three worth considering are nearest, antialias, and lanczos. Nearest is fastest, preserves sharp edges but has the worst quality. Antialias is decently fast, decent quality. Lanczos is the best quality, preserves edges but is extremely slow. I'll have to try modifying the render settings and see how it goes. I'll probably want to get the parallelized version first though. THanks! Tyler ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
On Fri, Sep 2, 2011 at 12:55 PM, penorman penor...@mac.com wrote: I'm at work and going on vacation so I can't give a detailed answer for a few days, but this might help No problem, any help is appreciated. Once the tiles are made you can serve the directories with apache or another web server. Ah, okay I didn't realize it was that simple. xjjk from the OSM IRC channel has a parallized version of gdal2tiles which can significantly help processing times if you have a multi-core CPU. Would that be maptiler? I've got a dual quad-core Xeon Mac Pro with 14 gb of ram so a parallelized version would be a must. :) You first need to set up gdal and gdal python bindings. You also need PIL for the antialias mode which offers the best tradeoffs between quality and speed for resizing methods. gdal2tiles is reportedly significantly slower then it could be when compaired to some non-public tools that do the same work. Just for reference, I had gdal2tiles running for 1-2 weeks on my 6 core CPU when doing the low quality surrey images and estimated it would take 1 year on my 3 core athelon II for the 200 GB+ high quality version I'll have to give it a shot and see how long it takes to process some portion of my GeoTiff. The tiled GeoTiff is about 16 GB, where the original MrSid is 1.9GB. Might be doable. :) Thanks! Tyler ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
Two options 1. Covert to tiles with gdal2tiles or another program. How would I then serve these to JOSM? 2. Set up MapServer and server it with WMS 1 is faster at serving tiles but takes more disk space and pre-processing. 2 is slower but better for large files since you don't have to pre-process. As your GeoTiff isn't very large, the first is a viable option. I'd guess it might take me a week to process. Okay, I'll take a look at gdal2tiles; disk space, ram and CPU power are commodities I have available in ample quantity. :) MapServer is a pain to set up, as you've discovered. If you're running Ubuntu I could show you my .map file if it'd help. I'm running a broken Debian unstable distro at the moment. :) I plan to reformat to use UBUNTU in the future so I'll have to look at Mapserver then. Thanks, Tyler ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
I'm at work and going on vacation so I can't give a detailed answer for a few days, but this might help Once the tiles are made you can serve the directories with apache or another web server. xjjk from the OSM IRC channel has a parallized version of gdal2tiles which can significantly help processing times if you have a multi-core CPU. You first need to set up gdal and gdal python bindings. You also need PIL for the antialias mode which offers the best tradeoffs between quality and speed for resizing methods. gdal2tiles is reportedly significantly slower then it could be when compaired to some non-public tools that do the same work. Just for reference, I had gdal2tiles running for 1-2 weeks on my 6 core CPU when doing the low quality surrey images and estimated it would take 1 year on my 3 core athelon II for the 200 GB+ high quality version On Sep 02, 2011, at 06:51 AM, Tyler Gunn ty...@egunn.com wrote: Two options 1. Covert to tiles with gdal2tiles or another program. How would I then serve these to JOSM? 2. Set up MapServer and server it with WMS 1 is faster at serving tiles but takes more disk space and pre-processing. 2 is slower but better for large files since you don't have to pre-process ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
Re: [Talk-ca] GeoTiff in JOSM
Two options 1. Covert to tiles with gdal2tiles or another program. 2. Set up MapServer and server it with WMS 1 is faster at serving tiles but takes more disk space and pre-processing. 2 is slower but better for large files since you don't have to pre-process. As your GeoTiff isn't very large, the first is a viable option. I'd guess it might take me a week to process. MapServer is a pain to set up, as you've discovered. If you're running Ubuntu I could show you my .map file if it'd help. -Original Message- From: Tyler Gunn [mailto:ty...@egunn.com] Sent: Tuesday, August 30, 2011 6:46 PM To: Talk-CA OpenStreetMap Subject: [Talk-ca] GeoTiff in JOSM Anyone have a hint of how to view a GeoTiff in JOSM? Manitoba Lands Initiative updated the aerial imagery of Winnipeg and has a 50cm res MrSid file of the Winnipeg capital region; much more up to date than Bing aerial and also including high res pics of areas that Bing doesn't have. I've converted the MrSid file to a tiled GeoTiff, but at 19GB in size I am thinking I'll need to serve it up some how. I'm thinking I may need to use MapServer to serve this as a WMS layer for JOSM, but I'm not finding decent how-tos on that. Any hints? Thanks! ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca ___ Talk-ca mailing list Talk-ca@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-ca
