Re: [Viking-devel] skip-same patch
Hello,
For me, viking is still slow
if i view large gpx track files (1000 up to 20.000 track points)
I do not feel any improvment with the skip-same patch
I am still using this script to simplify the track to %25
and I apply it so many times until viking can handle the track fast:
#!/bin/bash -x
points=$(grep -c trkpt $1 )
basename=$(basename $1 .gpx )
n=$(( $points/4 ))
t=/tmp/${basename}.${n}.gpx
mv $1 $t
gpsbabel -t -i gpx -f $t -x simplify,count=$n -o gpx -F $1
--
Jodok Ole Müllers
Coerdestraße 41
48147 Münster
MOB : +49 151 50 57 83 86
FON : +49 251 57 995 78
FAX : +49 251 2007 93 34
MAIL: jo...@muellers.ms
--
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
___
Viking-devel mailing list
Viking-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/viking-devel
Viking home page: http://viking.sf.net/
Re: [Viking-devel] skip-same patch
Rob, Sorry if I've wasted anyones time looking into what appeared initially to be a viking problem. Having experimented a little more I now know that viking is not responsible for my laptop crashing - it has now crashed several times using other programmes only, and it's problems don't seem to be related to the 'load'. The screen does not dim when it crashes. The screen remains showing whatever I was working on, the keyboard mouse become unresponsive - it does not recover from this no matter how long it is left. Not a viking problem. In terms of the screen dimming when loading a number of tracks at once, this is only a minor problem for me as the laptop always recovers (except sometimes in my case when using the defective laptop!). Regards Nick On 13/01/12 02:39, Robert Norris wrote: All my tracks, hiking, car cycle, are 1 second interval, I frequently deal with multiple tracks created during the course of a days cycling or walking. The majority of my tracks are created by a Garmin Oregon 300. When I load the tracks (generally using file / append) my laptop screen dims everything freezes for several seconds, but always recovers. If there After loading each individual gpx file, Viking generates a redraw at the view to see all of that gpx. This means if there's a map layer present it will load/download tiles for that view too (reading lots map tiles from disk times a little time) At present it's not clever enough to only do the redraw when the last gpx is opened. This should be simple to generate the code improvement. are several tracks with many waypoints the programme may become slower ^^ Using many waypoints* will slow Viking down as it's written using the traditional (i.e. slow Gdk API graphics functions)**. But there is a workaround by adjusting the TrackWaypoint Layer Properties, Waypoints tab: 1. Turn off 'Draw Labels' - This seems to make the biggest difference as drawing text to the viewport is slow (especially when panning the screen around) 2. Turn off 'Draw Waypoint Symbols'*** * Interestingly only just discovered this - helped by using some 1000 Waypoint gpxs. I use Viking with massive tracklogs, so I don't really notice this issue. Behaviour is worse on my laptop then the desktop, presumably since the laptop is of a lower spec. ** Rewriting Viking to use cairo / champlain for the main view is a possibility but don't hold your breath for this little volunteer project. *** There might be a way for this to scale up better, however the main slow down is in point 1, so IMHO there's not much incentive to attempt to address this. but still functions. However, I need to save the file at an early stage, and then keep saving at regular intervals as I edit the tracks, combining them, removing duplicates, and uploading them to OSM etc. If I don't regularly save the whole laptop will freeze and not recover, necessitating holding the power button for a few seconds to switch it off, and then starting again. I don't have evidence of this, but creating a track/route seems to use even more resources, so my laptop may crash more often - again frequent saving stops this. The whole laptop freezing seems a symptom of allocation vast amounts of memory and the system locks up. Eventually the OOM Killer may kick in a removes a lucky program. I don't think there are any severe memory leaks or memory allocations in Viking (other then DEMs) The only cause I know of in Viking is opening *lots* of DEMs (i.e. over 50 or more). Redrawing with DEMs is also very slow as they recalculate every point on display. For using DEMs (this is how I do it:), is to load them in for your area - my machine copes with coverage of the UK for example *but keep the layer invisible*. Since you probably have OSM tiles for map view anyway, the DEMs don't need to be visible but they'll still be used the other DEM functionality: the cursor height readout, track creation and track property elevation display. It may be that a feature that regularly saves to disk at 2 minute intervals would alleviate this? This maybe something to add. I hasten to add, this is not a complaint - you asked, so I'm answering. I'm a long term fan of viking recommend it to friends. I also think that Ubuntu may be partially to blame here, as the performance of the laptops seems to have reduced over the last 2 versions of Ubuntu. It's difficult for me to say if other programmes can cause similar effects, but I do know that 'Evolution' the PIM programme is resource heavy and can slow my system causing similar problems. I think the problems partially depend on the other programmes running - Thunderbird causes less problems than Evolution, Chromium causes less problems than Firefox. I'm glad you're a fan. My computer is a laptop, Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz with
Re: [Viking-devel] skip-same patch
Greg Troxel wrote: viking gpx.viking track.gpx waypoint.gpx ... gpx.viking is a viking file that has the map layers I want. When I start up this way, I get my tracks/wpts overlaid on my standard map layers. Ah, handy to know, thanks. Is [having a huge viking file] a bad thing to do?... Well, I'm not sure. I don't want to use viking to store my data - I keep the original files instead. My Garmin Colorado 400t gives me just one huge Current.gpx file that I need to split up anyway (and label the individual tracks with something more useful than Current Track: 12 JAN 2012 12:49). no. It's not about xml, but about viking having huge numbers of trackpoints in memory and drawing them. I think it's mostly about the drawing. I thought that, too, but the problem seems to be the same regardless whether the trackpoints are visible or not. Surely it could ignore tracks, or TrackWaypoint layers, that are turned off? I have been thinking about that, and in particular using postgresql/postgis, so that viking can query for all tracks that are in the viewport. Thanks for making me aware of postgis! Have you updated to recent git that has the skip_same patch? ...No, I'm way behind: My details: Kubuntu 11.04 Natty Narwhal on a Lenovo T41 Thinkpad, Intel Pentium M 1.86GHz, 2GB memory. Viking 0.9.94. that's really old viking! Yup; it seemed to me that each Ubuntu release had a needlessly older version of Viking than was available at the time. I'm encouraged by your description of the skip_same patch. I really need to get around to upgrading, starting with the OS. I think it's a combination of viking asking for a lot of drawing and the X server not coping all that well. I'm persuaded you're probably right--certainly a good place to start. Thanks for your comments and advice. Ted -- RSA(R) Conference 2012 Mar 27 - Feb 2 Save $400 by Jan. 27 Register now! http://p.sf.net/sfu/rsa-sfdev2dev2 ___ Viking-devel mailing list Viking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/viking-devel Viking home page: http://viking.sf.net/
Re: [Viking-devel] skip-same patch
Greg, All my tracks, hiking, car cycle, are 1 second interval, I frequently deal with multiple tracks created during the course of a days cycling or walking. The majority of my tracks are created by a Garmin Oregon 300. When I load the tracks (generally using file / append) my laptop screen dims everything freezes for several seconds, but always recovers. If there are several tracks with many waypoints the programme may become slower but still functions. However, I need to save the file at an early stage, and then keep saving at regular intervals as I edit the tracks, combining them, removing duplicates, and uploading them to OSM etc. If I don't regularly save the whole laptop will freeze and not recover, necessitating holding the power button for a few seconds to switch it off, and then starting again. I don't have evidence of this, but creating a track/route seems to use even more resources, so my laptop may crash more often - again frequent saving stops this. It may be that a feature that regularly saves to disk at 2 minute intervals would alleviate this? I hasten to add, this is not a complaint - you asked, so I'm answering. I'm a long term fan of viking recommend it to friends. I also think that Ubuntu may be partially to blame here, as the performance of the laptops seems to have reduced over the last 2 versions of Ubuntu. It's difficult for me to say if other programmes can cause similar effects, but I do know that 'Evolution' the PIM programme is resource heavy and can slow my system causing similar problems. I think the problems partially depend on the other programmes running - Thunderbird causes less problems than Evolution, Chromium causes less problems than Firefox. My computer is a laptop, Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz with 4GB of ram, running Ubuntu 11.10 (can also boot into windows 7, where there is a version of Viking as well, but I rarely do this don't know if a similar problem exists). My laptop currently uses Viking 1.2.1 from the ubuntu repository, but I have used other versions loaded from git with the same results. I also make use of other laptops of various specs. other versions of viking with similar results. I'm quite happy to try different versions, but you may have to keep the instructions simple as I'm definitely a user as opposed to a programmer! Thanks for your work on Viking. Regards Nick (OSM = Tallguy)On 09/01/12 00:47, Greg Troxel wrote: It looks like someone (Rob?) has integrated my skip_same patch to only draw points if they are different from the previous - thanks! I am curious what people think of the drawing speed, especially those who routinely take 1s tracklogs when hiking. -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Viking-devel mailing list Viking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/viking-devel Viking home page: http://viking.sf.net/ -- Regards Nick -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___ Viking-devel mailing list Viking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/viking-devel Viking home page: http://viking.sf.net/
Re: [Viking-devel] skip-same patch
Nick Allen nick.allen...@gmail.com writes: All my tracks, hiking, car cycle, are 1 second interval, I frequently deal with multiple tracks created during the course of a days cycling or walking. The majority of my tracks are created by a Garmin Oregon 300. When I That's basically what I do, with Oregon 450 or Etrex Vista HCx. Load the tracks (generally using file / append) my laptop screen dims But, what I do is viking gpx.viking track.gpx waypoint.gpx and start each time. I don't try to have a huge viking file with all of my tracks. Are you loading many tracks, and then trying to figure out which ones are ok to form a track to upload? If you could quantify what causes trouble that would help. I also map in osm (user gdt), but I just draw in josm with a track in the background. (Most of the ways I draw for which there isn't good imagery are in the woods, and being off 5m is totally unimportant compared to having the geometry/connectivity and rough position right.) I then look at later trips with viking, and if I see something that needs mapping/fixing, I load that trace in josm. (I don't upload gpx tracks at all.) everything freezes for several seconds, but always recovers. If there are several tracks with many waypoints the programme may become I am not sure what's going on here. But I think that the issue is that viking makes lots of requests to X, and the X server spends lots of CPU time fulfilling them. And viking may be triggering memory leaks in X (but I have no evidence for that). When it is slow, does top/etc. show that viking or X is using all the cpu time, or something else, or ? slower but still functions. However, I need to save the file at an early stage, and then keep saving at regular intervals as I edit the tracks, combining them, removing duplicates, and uploading them to OSM etc. If I don't regularly save the whole laptop will freeze and not recover, necessitating holding the power button for a few seconds to switch it off, and then starting again. I don't have evidence of this, In theory viking cannot cause this. In practice I bet there is a kernel or X bug that is being triggered by viking. Does your computer have problems with anything else? It almost sounds like it could be a weak power supply. I use NetBSD, with an old graphics card (Intel 845 motherboard from 2006). I find that redrawing the viking window seems to be very slow, but I have not had any real computer/X instability issues. Tons of people use viking on ubuntu, it seems, so your issue is likely more localized. but creating a track/route seems to use even more resources, so my laptop may crash more often - again frequent saving stops this. It may be that a feature that regularly saves to disk at 2 minute intervals would alleviate this? Sure, but only if saving only happens if the user asks for this somehow. I don't want to edit in viking - just examine mostly - but that's me. I hasten to add, this is not a complaint - you asked, so I'm answering. I'm a long term fan of viking recommend it to friends. I also think that Ubuntu may be partially to blame here, as the performance of the laptops seems to have reduced over the last 2 versions of Ubuntu. It's difficult for me to say if other programmes can cause similar effects, but I do know that 'Evolution' the PIM programme is resource heavy and can slow my system causing similar problems. I think the problems partially depend on the other programmes running - Thunderbird causes less problems than Evolution, Chromium causes less problems than Firefox. Thanks for speaking up - I would say that while there's a non-viking bug, it seems pretty clear that viking uses more resources than people would like. My computer is a laptop, Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz with 4GB of ram, running Ubuntu 11.10 (can also boot into windows 7, where there is a version of Viking as well, but I rarely do this don't know if a similar problem exists). My laptop currently uses Viking 1.2.1 from the ubuntu repository, but I have used other versions loaded from git with the same results. I also make use of other laptops of various specs. other versions of viking with similar results. That's a resaonably beefy machine. Mine is a single-core 3.4 GHz (desktop mobo) with 2G of ram. I'm quite happy to try different versions, but you may have to keep the instructions simple as I'm definitely a user as opposed to a programmer! I have been struggling to find spare time to hack on things - but perhaps I will get to adding logging about start/stop redraw times in the track/waypoint layer. pgp85Qigw3xpX.pgp Description: PGP signature -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy
Re: [Viking-devel] skip-same patch
Nick Allen described a problem where loading tracks into Viking slows his computer down to the point of unusability, usually temporarily. I experience similar problems. Greg Troxel responded. My comments follow. Greg: But, what I do is viking gpx.viking track.gpx waypoint.gpx It's not clear to me from the documentation what's going on here. You're loading three files, yes? I assume one of them (track.gpx?) is from the GPSr; where are you getting the others? Greg: and start each time. I don't try to have a huge viking file with all of my tracks. Is this a bad thing to do? I have a Viking file for exactly that purpose! And even my files for specific areas get pretty large after years of hiking and geocaching. I don't know a lot about XML; are you saying XML doesn't scale well? I would love to find a utility, perhaps a simple set of shell scripts, that would: 1. Parse a Viking XML file and generate SQL to insert all the tracks and waypoints into a relational database like PostgreSQL or mysql, preferably using simple-enough SQL that I get to choose which DBMS to use. 2. Convert the results of a database query into Viking-readable XML so that I can load it and display and manipulate its contents. Then I could use the full power of a relational DBMS to find tracks and waypoints by name, by date, by location, etc, and load only those into Viking so it's not burdened by a huge file of data I'm not using at the moment. Does anything like that exist, somewhere? Nick: everything freezes for several seconds, but always recovers. If there are several tracks with many waypoints the programme may become Greg: When it is slow, does top/etc. show that viking or X is using all the cpu time, or something else, or ? Viking is usually high in the list, but X is the one with huge CPU. Sometimes, oddly, kmail (I use Kubuntu) has a high CPU hit as well. Killing kmail doesn't give me back the machine. I still have to wait it out or, like Nick, power-cycle. My workaround is to have a small file just for loading the tracks from the GPSr, selecting the ones I want, renaming them, and only then loading the big file of all my tracks and copying them over. That mostly avoids the slowups, except when I zoom several increments at a time. That can bring my machine to its knees. I'm also noticing that Viking crashes often, but that could be a problem limited to the version I'm running (not the latest). Like Nick, I've learned to save my files very frequently. Greg: In theory viking cannot cause this. Why not, in theory? In practice I bet there is a kernel or X bug that is being triggered by viking. Does your computer have problems with anything else? It almost sounds like it could be a weak power supply. I'm adding my comments just to establish that Nick isn't the only one seeing these problems. My details: Kubuntu 11.04 Natty Narwhal on a Lenovo T41 Thinkpad, Intel Pentium M 1.86GHz, 2GB memory. Viking 0.9.94. Yeah, I need to get around to upgrading to the newer Ubuntu which finally has a Viking version that begins with 1! But I've noticed these slowdown problems over many Ubuntu and Viking versions, and it sounds like they're still there, even if limited to a few lucky users like me and Nick! Greg: Thanks for speaking up - I would say that while there's a non-viking bug, it seems pretty clear that viking uses more resources than people would like. It's of course possible that Nick and I have the same non-Viking bug which only appears when we run Viking, but perhaps it may be a Viking bug after all. It's not clear from Nick's post but perhaps he, too, has a big file of tracks. BTW it doesn't need to be that big for these problems to manifest. Thanks to all the Viking developers for this great tool that I'd hate to live without. Ted -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox ___ Viking-devel mailing list Viking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/viking-devel Viking home page: http://viking.sf.net/
[Viking-devel] skip-same patch
It looks like someone (Rob?) has integrated my skip_same patch to only draw points if they are different from the previous - thanks! I am curious what people think of the drawing speed, especially those who routinely take 1s tracklogs when hiking. pgpphulTRnZmt.pgp Description: PGP signature -- Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox___ Viking-devel mailing list Viking-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/viking-devel Viking home page: http://viking.sf.net/
