Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Great, thanks again for your help. Have a good week-end, Patrick 2018-05-11 14:46 GMT-04:00 Sasha Khapyorsky : > Technically it is possible (for example > https://stackoverflow.com/questions/145270/calling-c-c-from-python), > but I'm pretty sure that you will need to create sort of c++ envelop, >

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Daniel Patterson
Some folks have written Python wrappers around libosrm, like here: https://github.com/ustroetz/python-osrm but I've never tried them, so I don't know how up-to-date they are, or how easy they will be to get working. If you're comfortable in NodeJS, then OSRM supports Node bindings as a first-c

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Sasha Khapyorsky
Technically it is possible (for example https://stackoverflow.com/questions/145270/calling-c-c-from-python), but I'm pretty sure that you will need to create sort of c++ envelop, shared lib, etc.. It would be easier just to do what you need in c++ instead of python. Sasha On Fri, May 11, 2018 at

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
thanks Sasha. And do you know if it's possible to do calls to libosrm functions directly from Python? 2018-05-11 14:33 GMT-04:00 Sasha Khapyorsky : > Hi again, Patrick, > > On Fri, May 11, 2018 at 9:22 PM, Patrick Agin > wrote: > > > > And are you aware of some python code that would do the call

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Sasha Khapyorsky
Hi again, Patrick, On Fri, May 11, 2018 at 9:22 PM, Patrick Agin wrote: > > And are you aware of some python code that would do the calls to osrm-routed > in parallel threads? There are lot of examples of how to make python things in parallel threads. For example: https://stackoverflow.com/quest

Re: [OSRM-talk] Any existing tool to digest OSRM navi data?

2018-05-11 Thread Jose Florido
Maybe this will help you: http://www.liedman.net/leaflet-routing-machine/ On Fri, May 11, 2018 at 8:23 PM, Xavier Prudent wrote: > Dear all, > > Under the option steps=true, osrm returns the detailed list of turn by > turn steps along the itinerary. > > Does any tool already exist that can under

[OSRM-talk] Any existing tool to digest OSRM navi data?

2018-05-11 Thread Xavier Prudent
Dear all, Under the option steps=true, osrm returns the detailed list of turn by turn steps along the itinerary. Does any tool already exist that can understand and display such information? Regards, Xavier -- *Xavier Prudent * *Data Scientist - Data Mining - Machine Learning* Web:* w

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Thanks Daniel. My first idea was to break my list into sets and running the job on different machines as you said in 4). But out of curiosity, can I make calls to libosrm.a functions directly from Python? And are you aware of some python code that would do the calls to osrm-routed in parallel threa

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Daniel Patterson
Patrick, There are about a million possible paths you could take here, a lot of it will depend on what skills you have available. Off the top of my head: 1) Speed things up by avoiding HTTP overhead and calling the libosrm.a functions directly instead of hitting `osrm-routed` over HTTP

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Sasha Khapyorsky
Hi again, On Fri, May 11, 2018 at 9:01 PM, Patrick Agin wrote: > Ok I found some explanations about libosrm here: > https://github.com/Project-OSRM/osrm-backend/blob/master/docs/libosrm.md > My second questions remains though: is libosrm mandatory for parallel use? It is not mandatory. Just fast

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Ok I found some explanations about libosrm here: https://github.com/Project-OSRM/osrm-backend/blob/master/docs/libosrm.md My second questions remains though: is libosrm mandatory for parallel use? or could I use osrm-routed too (even if it is slower)? All my code is written is Python so it could be

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Sorry for the newbie question but what's the difference between osrm-routed and libosrm? Is it mandatory to use the latter for a parallel usage? And do you have an example of code that does the calls in parallel threads? Thanks Sasha for your help. Patrick 2018-05-11 13:50 GMT-04:00 Sasha Khapyors

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Sasha Khapyorsky
Hi Patrick, If you are using libosrm (which reported to be thread safe: https://github.com/Project-OSRM/osrm-backend/issues/4966) you can just split your list and run its parts in different parallel threads. Sasha On Fri, May 11, 2018 at 8:14 PM, Patrick Agin wrote: > Hi, > I want to call the m

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Very interesting, thanks Bryan. Unfortunately, the requirement about Stata is probably a downer for us. 2018-05-11 13:30 GMT-04:00 Sayer, Bryan : > We use the Stata implementation OSRMTIME from Stephan Huber at Regensburg > University which can split the data across threads (we have 2 CPUS with

Re: [OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Sayer, Bryan
We use the Stata implementation OSRMTIME from Stephan Huber at Regensburg University which can split the data across threads (we have 2 CPUS with four cores each, and two threads per core). So 16 threads on a 3.5 Ghz Xeon and 64 GB of RAM, and if the network traffic is low (like on holidays) I

[OSRM-talk] map matching service for a huge number of requests

2018-05-11 Thread Patrick Agin
Hi, I want to call the map matching service for nearly a million of routes. I calculated that the task could take 10 hours on my laptop to complete. I was wondering if there's someone who faced the same problem and who addressed it in parallel, maybe with Spark? Another tool or way? Any hint is gre