Re: [OSM-talk] Who's using the torrents?
Hi Phil! 2011/9/19 Phil! Gold phi...@pobox.com: Here's my FlexGet config.yaml: feeds: osm-planets: rss: http://osm-torrent.torres.voyager.hr/files/rss.xml accept_all: yes transmission: host: localhost port: 9091 username: username password: password The flexget (and transmissions) are not not so well documented tools as one could imagine, therefore I got stuck here. Especially: what is here meant by transmission username and password, and what is port number 9091? Only port number I thought I need is incoming BT connection where I planned to use 6881 as I hoped it would work fine for most users. I don't know BT port system really, but I know that opening extra ports in my firewall would be a bit pain for me. I use transmission as my BitTorrent client. If you use a different program, you'll have to change that a little, but FlexGet has plugins for most of the major ones. I prefer the ones which are easiest to work. Now I got to point where I got for flexget --test as: Cannot connect to transmission. Is it running?. I know it is not running, but I don't know how to run it properly (in command line(. Like what to give as URL/dir to fetch in this case, and what other options would be needed? And how to run it - for rotorrent I just use screen to keep it running, maybe there is better way. The script used to make the current torrents[0] is probably the best place to start, though that doesn't help if you're not familiar with shell scripting. I'll see if I can tweak it and then write some general instructions about using it. [0] http://osm-torrent.torres.voyager.hr/files/create_new_planet_torrent.sh Shell scripting is ok for me in principle. I'd like to get basic sharing to work first, then will take a look to that. -- Jaak ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Who's using the torrents?
I also used the torrents when setting up my jxapi server. Now that it's setup, I no longer use them. Because the torrents are setup to pull from planet.osm.org as well as peers, they should always be faster than downloading only. I had to turn off some of my torrent blocklists for maximum speed. From: Toby Murray [mailto:toby.mur...@gmail.com] I used the torrent a few times last year and seeded until the next file came out each time. I haven't needed a planet file in a while now so I haven't used it recently. Each time I used it, it was blazingly fast and maxed out my 2 MB/sec downstream limit for most of the download. Toby On Thu, Sep 8, 2011 at 2:13 PM, ant antof...@gmail.com wrote: Hi, torrents for planet files are available here: http://osm-torrent.torres.voyager.hr/ I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I've picked the most recent torrents, counting: planet-110907: 1 seeder planet-110831: 5 seeders planet-110824: 3 seeders planet-110817: 0 seeders cheers ant ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Who's using the torrents?
Hi! 2011/9/8 Phil! Gold phi...@pobox.com: * ant antof...@gmail.com [2011-09-08 21:13 +0200]: I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I use them regularly. I use the RSS feed to auto-download the torrent files and then seed them until the next week's files are out. It's kind of convenient to always have a recent planet file on hand, even though my main use of the data is via a minutely-updated PostGIS database. How exactly do you do it - can you share the scripts? I forwarded 6881 port NAT via firewall, and started following: rtorrent -O port_range=6881-6881 http://osm-torrent.torres.voyager.hr/files/planet-latest.osm.bz2.torrent But I'm afraid it downloads and seeds only current file, not the next ones. I have dedicated OSM server over here for openstreetmap.ee which is so far quite idle and should be behind quite decent network connection (100Mbps, but not so sure about foreign links). So it could do seeding job pretty well. I could also create regular copy of pbf (from http://download.bbbike.org/osm/planet/ for example, or with osmosis) there to share it via bittorrent, if someone gives specific bittorrent instructions for Ubuntu. Jaak I'd be really happy if there were torrents for the PBF files, too; they're a lot faster for me to process. -- ...computer contrarian of the first order... / http://aperiodic.net/phil/ PGP: 026A27F2 print: D200 5BDB FC4B B24A 9248 9F7A 4322 2D22 026A 27F2 --- -- echo '[q]sa[ln0=aln256%Pln256/snlbx]sb3135071790101768542287578439snlbxq'|dc --- -- ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk -- Jaak Laineste ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Who's using the torrents?
* Jaak Laineste jaak.laine...@gmail.com [2011-09-19 14:14 +0300]: 2011/9/8 Phil! Gold phi...@pobox.com: * ant antof...@gmail.com [2011-09-08 21:13 +0200]: I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I use them regularly. I use the RSS feed to auto-download the torrent files and then seed them until the next week's files are out. It's kind of convenient to always have a recent planet file on hand, even though my main use of the data is via a minutely-updated PostGIS database. How exactly do you do it - can you share the scripts? I use FlexGet[0] to monitor the RSS feed[1] and automatically download new torrent files. [0] http://flexget.com/ [1] http://osm-torrent.torres.voyager.hr/files/rss.xml Here's my FlexGet config.yaml: feeds: osm-planets: rss: http://osm-torrent.torres.voyager.hr/files/rss.xml accept_all: yes transmission: host: localhost port: 9091 username: username password: password I use transmission as my BitTorrent client. If you use a different program, you'll have to change that a little, but FlexGet has plugins for most of the major ones. I could also create regular copy of pbf (from http://download.bbbike.org/osm/planet/ for example, or with osmosis) there to share it via bittorrent, if someone gives specific bittorrent instructions for Ubuntu. The script used to make the current torrents[0] is probably the best place to start, though that doesn't help if you're not familiar with shell scripting. I'll see if I can tweak it and then write some general instructions about using it. [0] http://osm-torrent.torres.voyager.hr/files/create_new_planet_torrent.sh -- ...computer contrarian of the first order... / http://aperiodic.net/phil/ PGP: 026A27F2 print: D200 5BDB FC4B B24A 9248 9F7A 4322 2D22 026A 27F2 --- -- The Very Big Stupid is a thing which breeds by eating The Future. Have you seen it? It sometimes disguises itself as a good-looking quarterly bottom line, derived by closing the RD department. -- Frank Zappa --- -- ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Who's using the torrents?
I used the torrent a few times last year and seeded until the next file came out each time. I haven't needed a planet file in a while now so I haven't used it recently. Each time I used it, it was blazingly fast and maxed out my 2 MB/sec downstream limit for most of the download. Toby On Thu, Sep 8, 2011 at 2:13 PM, ant antof...@gmail.com wrote: Hi, torrents for planet files are available here: http://osm-torrent.torres.voyager.hr/ I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I've picked the most recent torrents, counting: planet-110907: 1 seeder planet-110831: 5 seeders planet-110824: 3 seeders planet-110817: 0 seeders cheers ant ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] Who's using the torrents?
Hi, torrents for planet files are available here: http://osm-torrent.torres.voyager.hr/ I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I've picked the most recent torrents, counting: planet-110907: 1 seeder planet-110831: 5 seeders planet-110824: 3 seeders planet-110817: 0 seeders cheers ant ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] Who's using the torrents?
* ant antof...@gmail.com [2011-09-08 21:13 +0200]: I'm curious about how this is utilized. Have you ever used the torrents? Do you use them regularly? Do you seed? I use them regularly. I use the RSS feed to auto-download the torrent files and then seed them until the next week's files are out. It's kind of convenient to always have a recent planet file on hand, even though my main use of the data is via a minutely-updated PostGIS database. I'd be really happy if there were torrents for the PBF files, too; they're a lot faster for me to process. -- ...computer contrarian of the first order... / http://aperiodic.net/phil/ PGP: 026A27F2 print: D200 5BDB FC4B B24A 9248 9F7A 4322 2D22 026A 27F2 --- -- echo '[q]sa[ln0=aln256%Pln256/snlbx]sb3135071790101768542287578439snlbxq'|dc --- -- ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
