Re: [OSRM-talk] running on windows

[Wilhelm Berg]

I was under the impression that you were running stock VS2015.
C++ runtimes should be backwards compatible, but not forward.
So VS2015 Update 2 should be fine.
My machines are on that too.

Running out of ideas how to solve your problem.


What's the size of your swap (virtual memory)?

Advanced System Settings -> Advanced -> Performance -> Settings ... ->
Advanced -> Virtual Memory

If it's small you might want to increase that too.




On Fri, Apr 29, 2016 at 8:22 AM, John Aherne  wrote:

> When I installed update1 , I get the same result.
>
> The vs2015 I am compiling on is update2. The redist package is .23980
>
> The update 1 package is .23506.
>
> So is this problem caused by a mismatch between different update levels?
>
> Mind you I would have expected it to crash sooner if it was just a
> mismatch between redist packages.
>
> At the moment whichever machine I run on it all stops at the same place -
> after creating the timestamp.
>
> What might it be doing at this point that might cause the problem?
>
> Is it trying to write to the stxxl file?
>
>
> Thanks for any insights.
>
> --
> *John Aherne*
>
>
>
>
> *www.rocs.co.uk *
> 020 7223 7567
>
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
>
>
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

[OSRM-talk] running on windows

[John Aherne]

When I installed update1 , I get the same result.

The vs2015 I am compiling on is update2. The redist package is .23980

The update 1 package is .23506.

So is this problem caused by a mismatch between different update levels?

Mind you I would have expected it to crash sooner if it was just a mismatch
between redist packages.

At the moment whichever machine I run on it all stops at the same place -
after creating the timestamp.

What might it be doing at this point that might cause the problem?

Is it trying to write to the stxxl file?


Thanks for any insights.

-- 
*John Aherne*




*www.rocs.co.uk *
020 7223 7567
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] running on windows

[Wilhelm Berg]

Very strange.
The crashes seem to happen at different stages of processing.
25GB stxxl should be more than enough for a small (Dublin) extract.

Only thing I can think of at the moment is to install the VS2015 *Update 1*
C++ Redistributable, as the release files are being built on AppVeyor and
that's being used there:

https://www.microsoft.com/en-us/download/details.aspx?id=49984

Any success?



On Thu, Apr 28, 2016 at 5:56 PM, John Aherne  wrote:

> Thanks for the pointers.
>
> The reason I was using vs2013 was the wiki page says you must do that for
> windows compilation. I have not found one that says to use vs2015.
>
> I did not realise the .stxxl has a .txt extension.
>
> The docs just refer to .stxll
>
> I downloaded the master and compiled. Lots of warnings etc but at the end
> I had my compiled programs.
>
> But even though I doubled my VM and moved it from the c: to d: and
> increased the stxxl space to 250GB the extract still crashed soon after
> starting.
>
> I then used a small town .pbf dublin and get the same problem.
>
> Here is the log:--
>
>
> D:\osrm-rel2015>osrm-extract dublin_ireland.osm.pbf
> [info] Using script profile.lua?[0m
> [info] Input file: dublin_ireland.osm.pbf?[0m
> [info] Profile: profile.lua?[0m
> [info] Threads: 8?[0m
> [STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
> 1babe452214b4613a2a488d80073
> f4185c05a0b3) + gnu parallel(__GLIBCXX__)
> [STXXL-MSG] Disk 'd:\jahtemp\stxxl' is allocated, space: 25000 MiB, I/O
> implementation: wincall queue=0 devid=0
> [info] Parsing in progress..?[0m
> [info] input file generated by osmconvert 0.7T?[0m
> [info] timestamp: 2015-10-24T00:30:02Z?[0m
>
> D:\osrm-rel2015>
>
>
> So not sure where to go from here.
>
> Thanks for any help.
>
> --
> *John Aherne*
>
>
>
>
> *www.rocs.co.uk *
> 020 7223 7567
>
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
>
>
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

[OSRM-talk] running on windows

[John Aherne]

Thanks for the pointers.

The reason I was using vs2013 was the wiki page says you must do that for
windows compilation. I have not found one that says to use vs2015.

I did not realise the .stxxl has a .txt extension.

The docs just refer to .stxll

I downloaded the master and compiled. Lots of warnings etc but at the end I
had my compiled programs.

But even though I doubled my VM and moved it from the c: to d: and
increased the stxxl space to 250GB the extract still crashed soon after
starting.

I then used a small town .pbf dublin and get the same problem.

Here is the log:--


D:\osrm-rel2015>osrm-extract dublin_ireland.osm.pbf
[info] Using script profile.lua?[0m
[info] Input file: dublin_ireland.osm.pbf?[0m
[info] Profile: profile.lua?[0m
[info] Threads: 8?[0m
[STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
1babe452214b4613a2a488d80073
f4185c05a0b3) + gnu parallel(__GLIBCXX__)
[STXXL-MSG] Disk 'd:\jahtemp\stxxl' is allocated, space: 25000 MiB, I/O
implementation: wincall queue=0 devid=0
[info] Parsing in progress..?[0m
[info] input file generated by osmconvert 0.7T?[0m
[info] timestamp: 2015-10-24T00:30:02Z?[0m

D:\osrm-rel2015>


So not sure where to go from here.

Thanks for any help.

-- 
*John Aherne*




*www.rocs.co.uk *
020 7223 7567
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] running on windows

[Wilhelm Berg]

Thanks for your detailed answer.

Building OSRM yourself:
It won't work with VS2013 as OSRM makes heavy use of C++11 features - these
are not supported by VS2013.
You need VS2015 to compile successfully.

Building should be easy:

Open a default Command Prompt, NOT a VS one.

* git clone https://github.com/Project-OSRM/osrm-backend.git
* cd osrm-backend

Change
https://github.com/Project-OSRM/osrm-backend/blob/master/appveyor-build.bat#L29
if VS2015 is not installed at the default location
Change
https://github.com/Project-OSRM/osrm-backend/blob/master/build-local.bat#L16
if 7zip is not installed at the default location

* build-local.bat

---

I tested
http://download.geofabrik.de/europe/british-isles-latest.osm.pbf
http://download.geofabrik.de/europe/ireland-and-northern-ireland-latest.osm.pbf

on W8.1 and 2008R2 with
http://build.project-osrm.org/latest/osrm_Release.zip

and it worked without problems.


As OSRM needs quite some resources to process data I suggest next thing you
try is to increase swap space (virtual memory) and stxxl to the highest
values possible on your system (aka free disk space).

1GB stxxl is certainly not enough.
The stxxl config file is called ".stxxl.txt" and comes along with
everything else.
Maybe you renamed it to something else? Mind the "." at the beginning of
the file name.

Let me know if increasing virtual memory/stxxl did help.



On Thu, Apr 28, 2016 at 12:51 PM, John Aherne  wrote:

> Thanks for the reply.
>
> Nice to know it should work without problem.
>
> I can compile and build successfully on Ubuntu and have done so many times
> so I think I am following the instructions properly.
>
> There are 2 scenarios:
>
> 1. I download just the binaries for release and try to use them.
>
> All release files are in a single folder.
>
> I copy the pbf file into the same folder
>
> I copy car.lua into profile.lua in the same folder
>
> They require vs2015 dll.
>
> On the W10 Pc I have vs2015 installed
>
> I have an osm.pbf file downloaded from  geofabrik.de for
> british-isles-latest.osm.pbf. and a smaller one for
> ireland-northern-ireland.osm.pbf
>
> The W10 PC is slow but has 4 cores and has 4GB ram. But I'm not fussed
> since I can leave it running.
>
> The stxxl file that gets allocated is 1GB the default since it cannot find
> my ,stxxl config file which is in the same folder as everything else.
>
> The log output from w10 is as follows:
>
> D:\osrm_Release>osrm-extract ireland-and-northern-ireland.osm.pbf
> [info] Input file: ireland-and-northern-ireland.osm.pbf
> [info] Profile: profile.lua
> [info] Threads: 4
> [info] Using script profile.lua
> [STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
> 1babe452214b4613a2a488d80073f4185c05a0b3) + gnu parallel(__GLIBCXX__)
> [STXXL-ERRMSG] Warning: no config file found.
> [STXXL-ERRMSG] Using default disk configuration.
> [STXXL-MSG] Disk 'C:\Users\johna\AppData\Local\Temp\stxxl.tmp' is
> allocated, space: 1000 MiB, I/O implementation: wincall delete_on_exit
> queue=0 devid=0
> [info] Parsing in progress..
> [info] input file generated by Osmium (
> http://wiki.openstreetmap.org/wiki/Osmium)
> [info] timestamp: 2013-01-12T19:52:00Z
> [info] Using turn restrictions
> [info] Found 3 exceptions to turn restrictions:
> [info]   motorcar
> [info]   motor_vehicle
> [info]   vehicle
>
> D:\osrm_Release>
>
>
> ---
> The W2008 server R2 system is on hyper-v and has 8gb ram and dual xeon 4
> core
>
> I had to install the 2105 C++ runtime to run the extract program since
> there is no vs2015 on this machine.
>
> The stxxl file that gets allocated is 10GB
>
> The log output for W2008 is as follows:
>
> I have no idea where the funny characters come from in the log
>
> D:\osrm_release>osrm-extract british-isles-latest.osm.pbf
> [info] Input file: british-isles-latest.osm.pbf?[0m
> [info] Profile: profile.lua?[0m
> [info] Threads: 8?[0m
> [info] Using script profile.lua?[0m
> [STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
> 1babe452214b4613a2a488d80073
> f4185c05a0b3) + gnu parallel(__GLIBCXX__)
> [STXXL-MSG] Disk 'c:\temp\stxxl' is allocated, space: 1 MiB, I/O
> implementation: wincall queue=0 devid=0
> [info] Parsing in progress..?[0m
> [info] input file generated by Osmium (
> http://wiki.openstreetmap.org/wiki/Osmium
> )?[0m
> [info] timestamp: 2015-10-28T22:22:02Z?[0m
> [info] Using turn restrictions?[0m
> [info] Found 3 exceptions to turn restrictions:?[0m
> [info]   motorcar?[0m
> [info]   motor_vehicle?[0m
> [info]   vehicle?[0m
>
> D:\osrm_release>
>
> -
>
> 2. Compile from sources
>
> This requires vs2013 which is installed on the W10 machine
>
> I am using the batch files that come with the instructions
>
> I download osrm4.9.1 and download all the other libraries needed for the
> compile.
>
> The only file that does not compile is s

[OSRM-talk] running on windows

[John Aherne]

Thanks for the reply.

Nice to know it should work without problem.

I can compile and build successfully on Ubuntu and have done so many times
so I think I am following the instructions properly.

There are 2 scenarios:

1. I download just the binaries for release and try to use them.

All release files are in a single folder.

I copy the pbf file into the same folder

I copy car.lua into profile.lua in the same folder

They require vs2015 dll.

On the W10 Pc I have vs2015 installed

I have an osm.pbf file downloaded from  geofabrik.de for
british-isles-latest.osm.pbf. and a smaller one for
ireland-northern-ireland.osm.pbf

The W10 PC is slow but has 4 cores and has 4GB ram. But I'm not fussed
since I can leave it running.

The stxxl file that gets allocated is 1GB the default since it cannot find
my ,stxxl config file which is in the same folder as everything else.

The log output from w10 is as follows:

D:\osrm_Release>osrm-extract ireland-and-northern-ireland.osm.pbf
[info] Input file: ireland-and-northern-ireland.osm.pbf
[info] Profile: profile.lua
[info] Threads: 4
[info] Using script profile.lua
[STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
1babe452214b4613a2a488d80073f4185c05a0b3) + gnu parallel(__GLIBCXX__)
[STXXL-ERRMSG] Warning: no config file found.
[STXXL-ERRMSG] Using default disk configuration.
[STXXL-MSG] Disk 'C:\Users\johna\AppData\Local\Temp\stxxl.tmp' is
allocated, space: 1000 MiB, I/O implementation: wincall delete_on_exit
queue=0 devid=0
[info] Parsing in progress..
[info] input file generated by Osmium (
http://wiki.openstreetmap.org/wiki/Osmium)
[info] timestamp: 2013-01-12T19:52:00Z
[info] Using turn restrictions
[info] Found 3 exceptions to turn restrictions:
[info]   motorcar
[info]   motor_vehicle
[info]   vehicle

D:\osrm_Release>

---
The W2008 server R2 system is on hyper-v and has 8gb ram and dual xeon 4
core

I had to install the 2105 C++ runtime to run the extract program since
there is no vs2015 on this machine.

The stxxl file that gets allocated is 10GB

The log output for W2008 is as follows:

I have no idea where the funny characters come from in the log

D:\osrm_release>osrm-extract british-isles-latest.osm.pbf
[info] Input file: british-isles-latest.osm.pbf?[0m
[info] Profile: profile.lua?[0m
[info] Threads: 8?[0m
[info] Using script profile.lua?[0m
[STXXL-MSG] STXXL v1.4.99 (prerelease/Release) (git
1babe452214b4613a2a488d80073
f4185c05a0b3) + gnu parallel(__GLIBCXX__)
[STXXL-MSG] Disk 'c:\temp\stxxl' is allocated, space: 1 MiB, I/O
implementation: wincall queue=0 devid=0
[info] Parsing in progress..?[0m
[info] input file generated by Osmium (
http://wiki.openstreetmap.org/wiki/Osmium
)?[0m
[info] timestamp: 2015-10-28T22:22:02Z?[0m
[info] Using turn restrictions?[0m
[info] Found 3 exceptions to turn restrictions:?[0m
[info]   motorcar?[0m
[info]   motor_vehicle?[0m
[info]   vehicle?[0m

D:\osrm_release>
-

2. Compile from sources

This requires vs2013 which is installed on the W10 machine

I am using the batch files that come with the instructions

I download osrm4.9.1 and download all the other libraries needed for the
compile.

The only file that does not compile is stxxl.

The compiler output is as follows:-

D:\osrm_utils>build_stxxl.bat

D:\osrm_utils>SET PREFIX="d:/libs18d"

D:\osrm_utils>SET VARIANT=Release

D:\osrm_utils>rem for older MSVC than VS 2013

D:\osrm_utils>rem SET BOOST_ROOT="d:/libs18/boost"

D:\osrm_utils>rem git clone https://github.com/DennisOSRM/stxxl.git

D:\osrm_utils>git clone https://github.com/stxxl/stxxl.git
fatal: destination path 'stxxl' already exists and is not an empty
directory.

D:\osrm_utils>cd stxxl

D:\osrm_utils\stxxl>mkdir build
A subdirectory or file build already exists.

D:\osrm_utils\stxxl>cd build

D:\osrm_utils\stxxl\build>cmake .. -G "NMake Makefiles"
-DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX="d:/libs18d"
-- Detected git refspec 1.4.1-360-g5b9663e sha
5b9663e6b769748f3b3d3a9a779b4b89e24d7a27
-- OpenMP found, enabling built-in parallel algorithms.
-- Using std::thread and other C++11 library functions.
-- Configuring done
-- Generating done
-- Build files have been written to: D:/osrm_utils/stxxl/build

D:\osrm_utils\stxxl\build>rem for older MSVC than VS 2013

D:\osrm_utils\stxxl\build>rem cmake .. -G "NMake Makefiles"
-DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX="d:/libs18d"
-DBOOST_ROOT= -DBoost_USE_STATIC_LIBS=ON

D:\osrm_utils\stxxl\build>nmake install

Microsoft (R) Program Maintenance Utility Version 12.00.21005.1
Copyright (C) Microsoft Corporation.  All rights reserved.

[  2%] Building CXX object lib/CMakeFiles/stxxl.dir/common/log.cpp.obj
log.cpp
D:\osrm_utils\stxxl\include\stxxl/bits/common/mutex.h(187) : error C2797:
'stxxl::spin_lock::lck': list initialization inside member initializer list
or non-stati

Re: [OSRM-talk] running on Windows

[Wilhelm Berg]

Answer to
https://lists.openstreetmap.org/pipermail/osrm-talk/2016-April/001198.html

Sorry for opening a new thread, but I just subscribed and couldn't find a
way to answer directly to the other thread.



John,

I've run OSRM successfully on both 2008R2 and W10.

Could you outline more details about the data and your workflow that I can
narrow down the problem?

Where did you download what data?
Did you follow all the steps outlined in
https://github.com/Project-OSRM/osrm-backend/wiki/Running-OSRM
Were there any error messages during data preparation?
What's the size of your stxxl file?
What are the specs of your machine: CPUs, RAM, size of swap, free HD space?

Willy
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

[OSRM-talk] running on windows

[John Aherne]

Thanks for the info.

I'm happy to stay with 4.9.1 for now.

So now I used the release binaries to run extract on my pbf file.

I tried on windows10 and windows2008 server R2.

On windows I have VS2015 installed.

But on 2008 Server R2 I had to install the 2015 C++ runtime.

Both crash within seconds and as far as I can see the faulting module is
ucrtbase.dll.

It outputs ' found 3 exceptions to turn restrictions'
motor car
motor vehicle
vehicle

Then crashes


It looks like a lot of people have a problem with ucrtbase.dll but I found
nothing conclusive.

So I'm not sure where to go from here.

Any ideas as to what to try next?

Do I need to have lua installed for any reason?

Thanks for any info.



-- 
*John Aherne*




*www.rocs.co.uk *
020 7223 7567
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk