Kieran Caplice
Gesendet: Mittwoch, 2. März 2016 18:23
An: osrm-talk@openstreetmap.org
Betreff: Re: [OSRM-talk] osrm-extract taking hours to complete
Hi Patrick,
That makes sense then. It's obvious the process is just going to take
upwards of 8-10 hours for us in that case.
Thanks for the help.
4.9.0 of osrm-backend.
BR
Björn
Von: Kieran Caplice
Gesendet: Mittwoch, 2. März 2016 18:23
An: osrm-talk@openstreetmap.org
Betreff: Re: [OSRM-talk] osrm-extract taking hours to complete
Hi Patrick,
That makes sense then. It's obvious the process is
Hi Frederik,
Yes. STXXL has a "memory" backend that avoids disk altogether.
echo "disk=none,20,memory" > .stxxl
If you've got lots of RAM, this is the best way to make use of it.
daniel
> On Mar 2, 2016, at 1:19 PM, Frederik Ramm wrote:
>
> Hi,
>
> On 03/02/2016 09:03 PM, Bjorn
Hi,
On 03/02/2016 09:03 PM, Bjorn Madsen wrote:
> I added a high speed SSD and pointed the .stxxl towards that to deal
> with the swap slowdown. That bought me a drop in processing time from 12
> hrs -> 3-4 hrs.
>
> osrm@mat4:~/osrm-backend$ cat .stxxl
> *disk=/mnt/tmp/stxxl,40,sysca
Hi Kieran,
I added a high speed SSD and pointed the .stxxl towards that to deal with
the swap slowdown. That bought me a drop in processing time from 12 hrs ->
3-4 hrs.
osrm@mat4:~/osrm-backend$ cat .stxxl
*disk=/mnt/tmp/stxxl,40,syscall*
osrm@mat4:~/osrm-backend$ lsblk
NAMEMAJ:MIN RM S
Hi Patrick,
Just wanted to ping you off-list. I just had a question about your
update processhow often if at all do you update your PBF data, and
how do you manage the process? We're thinking of just setting a cron job
to download and extract the new PBF every weekend to a temporary folder
Hi Patrick,
That makes sense then. It's obvious the process is just going to take
upwards of 8-10 hours for us in that case.
Thanks for the help.
Kind regards,
Kieran Caplice
On 02/03/16 17:01, Patrick Niklaus wrote:
Hey Kieran,
there have been a lot of structural changes (e.g. moving cod
Hey Kieran,
there have been a lot of structural changes (e.g. moving code from
osrm-prepare into osrm-extract) that probably invalidate that numbers.
Also we support 64bit OSM ids now, which sadly uses a lot more disk
space. I think stxxl need like 200GB. I think on our setup we have a
turn-aroun
Hello,
I'm currently extracting the planet PBF (~31 GB), and it's been running
for hours. I notice in the "Running OSRM" wiki page, it says " On a Core
i7 with 8GB RAM and (slow) 5400 RPM Samsung SATA hard disks it took
about 65 minutes to do so from a PBF formatted planet", which is making
m