Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
Apollinaris Schoell wrote: > On 18 Feb 2010, at 5:36 , Lars Ahlzen wrote: > >> Apollinaris Schoell wrote: >>> Anyone knows where to get NED data for large areas? The seamless >>> server is such a pain and it will take forever just for a single >>> state. or we could start a crowd source effort to download and >>> share them. >> They don't exactly advertise it, but USGS will actually take an >> external hard drive that you provide, fill it with NED data and >> ship it back to you. >> >> We're trying to find a place to host this massive data set, though, >> so hopefully downloading will get a lot easier soon. >> > > thats cool do you have the data already? What about providing it as a > set of torrent files? Torrent is the perfect protocol to distribute > such a huge set of data. btw how big is it? Yes, I do have it. Bittorrent would be nice, but it's over 600 GB, so just seeding it once would probably put me over my ISP's bw quota (and/or clog my intertubes for weeks!). :( The lower resolution (1 arc-second) version isn't _as_ huge, so that could possibly work. Then again, that isn't much improvement over SRTM. -- Lars Ahlzen l...@ahlzen.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On 18 Feb 2010, at 9:10 , Tyler wrote: > Isn't it 1.5 Tb or something? I agree torrenting would work, but that would > take quite a while to get to any reasonable amount of seeds. What about > Geocommons? Isn't that their thing? > can't imagine it's that big. srtm data for US is in 30m resolution is ~ 15G in compressed form. maybe the full USGS dataset is in multiple formats or in an uncompressed format. For some regions they have higher accuracy available but that should still be in the 100G range > Also, what about using an S3 bucket with a CoralCDN redirect, so the only > bandwidth costs would be the initial seeding to the Coral network? > www.coralcdn.org no experience with it but sounds like an interesting option > > On Thu, Feb 18, 2010 at 8:49 AM, Apollinaris Schoell > wrote: > > On 18 Feb 2010, at 5:36 , Lars Ahlzen wrote: > > > Apollinaris Schoell wrote: > >> Anyone knows where to get NED data for large areas? The seamless > >> server is such a pain and it will take forever just for a single > >> state. or we could start a crowd source effort to download and share > >> them. > > > > They don't exactly advertise it, but USGS will actually take an external > > hard drive that you provide, fill it with NED data and ship it back to you. > > > > We're trying to find a place to host this massive data set, though, so > > hopefully downloading will get a lot easier soon. > > > > thats cool do you have the data already? What about providing it as a set of > torrent files? Torrent is the perfect protocol to distribute such a huge set > of data. btw how big is it? > > > > > - Lars > > > > -- > > Lars Ahlzen > > l...@ahlzen.com > > > ___ > Talk-us mailing list > Talk-us@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-us > ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On Thu, Feb 18, 2010 at 8:49 AM, Apollinaris Schoell wrote: > > On 18 Feb 2010, at 5:36 , Lars Ahlzen wrote: > > > Apollinaris Schoell wrote: > >> Anyone knows where to get NED data for large areas? The seamless > >> server is such a pain and it will take forever just for a single > >> state. or we could start a crowd source effort to download and share > >> them. > > > > They don't exactly advertise it, but USGS will actually take an external > hard drive that you provide, fill it with NED data and ship it back to you. > > > > We're trying to find a place to host this massive data set, though, so > hopefully downloading will get a lot easier soon. > > > > thats cool do you have the data already? What about providing it as a set > of torrent files? Torrent is the perfect protocol to distribute such a huge > set of data. btw how big is it? > > > Actually, perhaps the best idea is to create a wiki page ... extention of the US wiki page. and list the download locations of each of the topo map IMG files. Over time, these files will get shared across the torrent network. Just call it an obvious name... like 'SRTM USA Garmin 25m Contours - MyState'. :) (... i would prefer a sharing (everyone who is working on it, shares the page) Google Docs chart, as it can handle a larger volume of data in a single chart better than the wiki can. but thats just me :) Mediafire.com is fine, but it only allows for the max .zip file size of 200megs. I dont know how many 1degX1deg tiles can fit. .. Canada is already chopped up into nice NTS tile sizes, so it makes it easier for sorting out what tiles are available. .. I dont know if the US has a similar system? ... and this same system can be extended to convert north America... just change the numbers http://maps.nrcan.gc.ca/topo_metadata/topo_click_e.php And ya.. i found that in areas that had buildings, the SRTM data choked and it shows empty space. Im going to (hopefully) get a hard copy (of the GeoBase data shp files), as maybe i can build from that since it's slightly better. ...although in areas that have been minded the data might (obviously) be in correct. Once i get a master install file done.. then i'll make a DVD of it, and share it with people to rip more DVDs to pass on to others. :) ... that's how the ibycus topo is done. (apologies if im repeating myself, it's getting late) :) cheers, Sam > > - Lars > > > > -- > > Lars Ahlzen > > l...@ahlzen.com > > > ___ > Talk-us mailing list > Talk-us@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-us > ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On 18 Feb 2010, at 2:27 , Sam Vekemans wrote: > > I use mainly Roadtrip and all is scripted without install. If I absolutely > need Mapsource then Mapset toolkit is sufficient and not much more > complicated than starting an installer. I think mkgmap has also an option to > create a a control file for a Mapsource installer with some 3rd party package > tool. But once you mess up Mapsource Mapset Toolkit is a must have to clean > broken registry. > > Thats what happens to me. thanks for explaining it :) > The srtm groundtruth contours can easily be installed using mapsettoolkit, > so i make the img files available. > and I should have said that contours as overlay are not very useful in Roadtrip/Mapsource only gps units show them as overlay. I have used it only to debug. and I use mkgmap to compile the gmapsup.img. this is much faster than the export from Roadtrip/Mapsource > > > Im manually making 10m contours for all of Canada (it will be a 2 gig > > install when done) maybe someone wants to make on for all of USA? > > have used this combination for a compromise of speed/size/precision. as said > srtm data isn't that good and 10m seemed overkill. with NED data it's a > different story > 25m minor > 100m medium > 200m major > > In canada we have access to Natural resources canada contour data that is > available as 20m contours. > Its the same contours that ibycus topo made. > http://www.ibycus.com/ibycustopo/ > > So its really relative... if you hiking then 10m contours is great... and > same if mountain biking. .. but if your road biking, then it might be a > little much. > > So i can make a separate map for the 25 meter contours > yes this is really user dependent and many in US will even prefer it in feet. that's why I have everything scripted and can easily rebuild with different parameters. groundtruth didn't work at all for me and have used gdal_translate, gdal_contour, shape-to-osmm, mkgmap with some perl wrapper code. didn't add the download from ftp feature because have all SRTM on disc. > > what did you use for medium and major contours? > > I just used the default that groundtruth gives. > 1000 major > 20 interm > 10 minor. > > Also, since the file is so big (3 gigs) it should be torrented, as well as > distributed the same way Ubuntu is, by manually giving a DVD of it. or > snailmail a an empty sd card, and i can but it on the card and mail it back. > Thats how the Ibycus topo is descributed in Canada. > yes torrent is a perfect protocol for such data > Also, > http://touren.mospace.de/kachel.html > looks like a handy service. > I dont know who the author is it is, but it would be great to have the planet > pre-done of 1 degree x 1 Degree contours. ... maybe 25m would be sufficient > for most users. That way anyone can just create a mapsource map of whatever > size they want. > > Im fine with the quality of the SRTM contours (since there isnt anything else > (that i know how to work with) that is better. :) srtm is really bad in mountain areas where you care most. US has NED data and I plan to switch to that, for selected mountain regions worldwide best data is available at http://www.viewfinderpanoramas.org/dem3.html Aster is supposed to be better than SRTM but license is not as open as SRTM. also http://srtm.csi.cgiar.org/ is SRTM based with refined data. > > Cheers, > Sam > > > > > > Sam > > > > On 2/17/10, Apollinaris Schoell wrote: > >> have built contour line maps lately based on srtm data. If anyone is > >> interested in a specifc area let me know. I am not such a web guru like > >> Lambertus and have no host to provide them for convenient download. If > >> someone can host them let me know. most tiles are 1x1 degree except where > >> it didn't fit in one .img > >> But srtm data has many errors and gaps in mountain areas. Anyone knows > >> where > >> to get NED data for large areas? The seamless server is such a pain and it > >> will take forever just for a single state. > >> or we could start a crowd source effort to download and share them. > >> > >> > >> > >> > >> On 17 Feb 2010, at 15:00 , Dave Hansen wrote: > >> > >>> On Wed, 2010-02-17 at 16:05 -0500, Mike N. wrote: > Many thanks for this update - it has come in handy many times since the > last > update. I was about to check with you to see if there was any way to > update it, but you beat me to it! > >>> > >>> It's just about at the point where I can automate it to rebuild them > >>> whenever Lambertus kicks off an update himself. I'll let everyone know > >>> when I get this set up. > >>> > >>> -- Dave > >>> > >>> > >>> ___ > >>> Talk-us mailing list > >>> Talk-us@openstreetmap.org > >>> http://lists.openstreetmap.org/listinfo/talk-us > >> > >> > >> ___ > >> Talk-us mailing list > >> Talk-us@openstreetmap.org > >> http://lists.openstreetmap.org/listinfo
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
Isn't it 1.5 Tb or something? I agree torrenting would work, but that would take quite a while to get to any reasonable amount of seeds. What about Geocommons? Isn't that their thing? Also, what about using an S3 bucket with a CoralCDN redirect, so the only bandwidth costs would be the initial seeding to the Coral network? www.coralcdn.org On Thu, Feb 18, 2010 at 8:49 AM, Apollinaris Schoell wrote: > > On 18 Feb 2010, at 5:36 , Lars Ahlzen wrote: > > > Apollinaris Schoell wrote: > >> Anyone knows where to get NED data for large areas? The seamless > >> server is such a pain and it will take forever just for a single > >> state. or we could start a crowd source effort to download and share > >> them. > > > > They don't exactly advertise it, but USGS will actually take an external > hard drive that you provide, fill it with NED data and ship it back to you. > > > > We're trying to find a place to host this massive data set, though, so > hopefully downloading will get a lot easier soon. > > > > thats cool do you have the data already? What about providing it as a set > of torrent files? Torrent is the perfect protocol to distribute such a huge > set of data. btw how big is it? > > > > > - Lars > > > > -- > > Lars Ahlzen > > l...@ahlzen.com > > > ___ > Talk-us mailing list > Talk-us@openstreetmap.org > http://lists.openstreetmap.org/listinfo/talk-us > ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On 18 Feb 2010, at 5:36 , Lars Ahlzen wrote: > Apollinaris Schoell wrote: >> Anyone knows where to get NED data for large areas? The seamless >> server is such a pain and it will take forever just for a single >> state. or we could start a crowd source effort to download and share >> them. > > They don't exactly advertise it, but USGS will actually take an external hard > drive that you provide, fill it with NED data and ship it back to you. > > We're trying to find a place to host this massive data set, though, so > hopefully downloading will get a lot easier soon. > thats cool do you have the data already? What about providing it as a set of torrent files? Torrent is the perfect protocol to distribute such a huge set of data. btw how big is it? > - Lars > > -- > Lars Ahlzen > l...@ahlzen.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
Apollinaris Schoell wrote: > Anyone knows where to get NED data for large areas? The seamless > server is such a pain and it will take forever just for a single > state. or we could start a crowd source effort to download and share > them. They don't exactly advertise it, but USGS will actually take an external hard drive that you provide, fill it with NED data and ship it back to you. We're trying to find a place to host this massive data set, though, so hopefully downloading will get a lot easier soon. - Lars -- Lars Ahlzen l...@ahlzen.com ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On Thu, Feb 18, 2010 at 12:25 AM, Apollinaris Schoell wrote: > > On 17 Feb 2010, at 23:34 , Sam Vekemans wrote: > > > For contour Garmin maps. I would use mapcenter2.cgpsmapper.com its the > > worldwide collection of Garmin Maps of all types. > > Many have uploaded contour maps. Just make sure their transparent. > > > > not sure if they will like to host such a big amount of data. And upload > through a webinterface isn't an options for so many tiles > The interface is able to host smaller areas.. so its fine for most people. > > > Ideally, i want to find a way to generate a mapsource install routeen > > that will load the latest OSM data & download the contour data IMG > > files at the same time. > > > > I use mainly Roadtrip and all is scripted without install. If I absolutely > need Mapsource then Mapset toolkit is sufficient and not much more > complicated than starting an installer. I think mkgmap has also an option to > create a a control file for a Mapsource installer with some 3rd party > package tool. But once you mess up Mapsource Mapset Toolkit is a must have > to clean broken registry. > Thats what happens to me. thanks for explaining it :) The srtm groundtruth contours can easily be installed using mapsettoolkit, so i make the img files available. > > Im manually making 10m contours for all of Canada (it will be a 2 gig > > install when done) maybe someone wants to make on for all of USA? > > have used this combination for a compromise of speed/size/precision. as > said srtm data isn't that good and 10m seemed overkill. with NED data it's a > different story > 25m minor > 100m medium > 200m major > In canada we have access to Natural resources canada contour data that is available as 20m contours. Its the same contours that ibycus topo made. http://www.ibycus.com/ibycustopo/ So its really relative... if you hiking then 10m contours is great... and same if mountain biking. .. but if your road biking, then it might be a little much. So i can make a separate map for the 25 meter contours > > what did you use for medium and major contours? > > I just used the default that groundtruth gives. 1000 major 20 interm 10 minor. Also, since the file is so big (3 gigs) it should be torrented, as well as distributed the same way Ubuntu is, by manually giving a DVD of it. or snailmail a an empty sd card, and i can but it on the card and mail it back. Thats how the Ibycus topo is descributed in Canada. Also, http://touren.mospace.de/kachel.html looks like a handy service. I dont know who the author is it is, but it would be great to have the planet pre-done of 1 degree x 1 Degree contours. ... maybe 25m would be sufficient for most users. That way anyone can just create a mapsource map of whatever size they want. Im fine with the quality of the SRTM contours (since there isnt anything else (that i know how to work with) that is better. :) Cheers, Sam > > > > Sam > > > > On 2/17/10, Apollinaris Schoell wrote: > >> have built contour line maps lately based on srtm data. If anyone is > >> interested in a specifc area let me know. I am not such a web guru like > >> Lambertus and have no host to provide them for convenient download. If > >> someone can host them let me know. most tiles are 1x1 degree except > where > >> it didn't fit in one .img > >> But srtm data has many errors and gaps in mountain areas. Anyone knows > where > >> to get NED data for large areas? The seamless server is such a pain and > it > >> will take forever just for a single state. > >> or we could start a crowd source effort to download and share them. > >> > >> > >> > >> > >> On 17 Feb 2010, at 15:00 , Dave Hansen wrote: > >> > >>> On Wed, 2010-02-17 at 16:05 -0500, Mike N. wrote: > Many thanks for this update - it has come in handy many times since > the > last > update. I was about to check with you to see if there was any way to > update it, but you beat me to it! > >>> > >>> It's just about at the point where I can automate it to rebuild them > >>> whenever Lambertus kicks off an update himself. I'll let everyone know > >>> when I get this set up. > >>> > >>> -- Dave > >>> > >>> > >>> ___ > >>> Talk-us mailing list > >>> Talk-us@openstreetmap.org > >>> http://lists.openstreetmap.org/listinfo/talk-us > >> > >> > >> ___ > >> Talk-us mailing list > >> Talk-us@openstreetmap.org > >> http://lists.openstreetmap.org/listinfo/talk-us > >> > > > > > > -- > > Twitter: @Acrosscanada > > Blog: http://Acrosscanadatrails.blogspot.com > > Facebook: http://www.facebook.com/sam.vekemans > > Skype: samvekemans > > OpenStreetMap IRC: http://irc.openstreetmap.org > > @Acrosscanadatrails > > ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
Re: [Talk-us] Whole-US Garmin Map (02-10-2010) update
On 17 Feb 2010, at 23:34 , Sam Vekemans wrote: > For contour Garmin maps. I would use mapcenter2.cgpsmapper.com its the > worldwide collection of Garmin Maps of all types. > Many have uploaded contour maps. Just make sure their transparent. > not sure if they will like to host such a big amount of data. And upload through a webinterface isn't an options for so many tiles > Ideally, i want to find a way to generate a mapsource install routeen > that will load the latest OSM data & download the contour data IMG > files at the same time. > I use mainly Roadtrip and all is scripted without install. If I absolutely need Mapsource then Mapset toolkit is sufficient and not much more complicated than starting an installer. I think mkgmap has also an option to create a a control file for a Mapsource installer with some 3rd party package tool. But once you mess up Mapsource Mapset Toolkit is a must have to clean broken registry. > Im manually making 10m contours for all of Canada (it will be a 2 gig > install when done) maybe someone wants to make on for all of USA? have used this combination for a compromise of speed/size/precision. as said srtm data isn't that good and 10m seemed overkill. with NED data it's a different story 25m minor 100m medium 200m major what did you use for medium and major contours? > > Sam > > On 2/17/10, Apollinaris Schoell wrote: >> have built contour line maps lately based on srtm data. If anyone is >> interested in a specifc area let me know. I am not such a web guru like >> Lambertus and have no host to provide them for convenient download. If >> someone can host them let me know. most tiles are 1x1 degree except where >> it didn't fit in one .img >> But srtm data has many errors and gaps in mountain areas. Anyone knows where >> to get NED data for large areas? The seamless server is such a pain and it >> will take forever just for a single state. >> or we could start a crowd source effort to download and share them. >> >> >> >> >> On 17 Feb 2010, at 15:00 , Dave Hansen wrote: >> >>> On Wed, 2010-02-17 at 16:05 -0500, Mike N. wrote: Many thanks for this update - it has come in handy many times since the last update. I was about to check with you to see if there was any way to update it, but you beat me to it! >>> >>> It's just about at the point where I can automate it to rebuild them >>> whenever Lambertus kicks off an update himself. I'll let everyone know >>> when I get this set up. >>> >>> -- Dave >>> >>> >>> ___ >>> Talk-us mailing list >>> Talk-us@openstreetmap.org >>> http://lists.openstreetmap.org/listinfo/talk-us >> >> >> ___ >> Talk-us mailing list >> Talk-us@openstreetmap.org >> http://lists.openstreetmap.org/listinfo/talk-us >> > > > -- > Twitter: @Acrosscanada > Blog: http://Acrosscanadatrails.blogspot.com > Facebook: http://www.facebook.com/sam.vekemans > Skype: samvekemans > OpenStreetMap IRC: http://irc.openstreetmap.org > @Acrosscanadatrails ___ Talk-us mailing list Talk-us@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk-us
