Re: [OSM-talk] Planet torrents...

2020-03-13 Thread Maarten Deen

On 2020-03-10 08:07, Maarten Deen wrote:

On 2020-03-07 09:36, Christian Quest wrote:


This week was the first one I had nothing to do (or fix) :)


Do you have scripts for this? (have to ask before I go make one myself)


I made my own script, this is very basic and works for me in Ubuntu with 
transmission. Replace user:pass with the username and password you 
connect to transmission.


$ transmission-remote --auth user:pass -t `transmission-remote --auth 
user:pass -l|grep planet |awk '{print $1}'` -l
$ transmission-remote --auth user:pass -t `transmission-remote --auth 
user:pass -l|grep planet |awk '{print $1}'` --remove-and-delete
$ transmission-remote --auth user:pass -a 
https://osm.cquest.org/torrents/planet-latest.osm.pbf.torrent
$ transmission-remote --auth user:pass -t `transmission-remote --auth 
user:pass -l|grep planet |awk '{print $1}'` -ph all



Explanation:
transmission-remote --auth user:pass -l|grep planet |awk '{print $1}' 
will output the ID of the torrent. I'm only grepping on planet because 
that's the only planet torrent I've got, it would be better to know the 
whole filename or at least grep on .osm.pbf too.


The first command will display the planet file you're now downloading
The second command will delete it from transmission and remove all files 
with it
The third command will add a new tracker from the website. Because you 
want to seed the latest planet, this is easy.
The forth command will set the priority of the tracker on high. This is 
optional of course.


Regards,
Maarten

___
talk mailing list
talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Planet torrents...

2020-03-10 Thread Maarten Deen

On 2020-03-07 09:36, Christian Quest wrote:


This week was the first one I had nothing to do (or fix) :)


Do you have scripts for this? (have to ask before I go make one myself)


Do not hesitate to share your own findings if you have tested the
planet torrents !


I've been seeding now for 2 days, 21 hours and have a ratio of 0.43.

Regards,
Maarten

___
talk mailing list
talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk


Re: [OSM-talk] Planet torrents...

2020-03-07 Thread stevea
When I saw these (planet file sharing, torrent generation, scripting-sharing 
tweaking) efforts began (and were mentioned here) about a month ago, these are 
precisely the data I was looking for as they evolved:  seed dl/ul ratio, dump 
performance / timings... .  Thank you, Christian, nice reporting and I'm sure 
widely appreciated (not only me).

SteveA
California
___
talk mailing list
talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk


[OSM-talk] Planet torrents...

2020-03-07 Thread Christian Quest
After a few weeks experimenting planet dump sharing thru bittorrent, 
here is a short report.


I've fully automated the process on my side:

- new planet pbf availability detection

- planet pbf download

- torrent generation

- torrent publishing and initial seeding

This week was the first one I had nothing to do (or fix) :)


In a couple of hours, we have around 4 to 5 seeds, 24 hours laters, 
that's around 10.


Once seeded, it takes 30 to 40 minutes to download the planet dump (if 
you have fast internet connection like optic fiber).


My own seeds (3) have a download/upload ratio around 3 (I've send 3 
times the planet file on each seed).



Do not hesitate to share your own findings if you have tested the planet 
torrents !


--
Christian Quest - OpenStreetMap France


___
talk mailing list
talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/talk