[wsjt-devel] wsprd_exp improvements
Joe and wspr in wsjtx testers: I’ve significantly improved the efficiency of the sync-search in the current version (r5668) of wsprd_exp.c. On a large (1953 files) batch of files representing all bands and the entire diurnal cycle the r5668 wsprd and wsprd_exp compare as follows: wsprd: 5083 decodes in 1294s (29% in sync0 and 17% in Fano) wsprd_exp: 5132 decodes in 970s (9% sync0 and 24% in Fano) Approximately 25% decrease in average execution time with no decrease (maybe a slight increase) in performance. If you get a chance and can confirm that you also see a significant time savings, then I propose that we make this version of wsprd_exp the new default wsprd. At some point we should be able to cash in some of the time saved for more decodes. Steve k9an -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wsprd_exp improvements
Hi Joe, On Jul 3, 2015, at 10:18 AM, Joe Taylor j...@princeton.edu wrote: Hi Steve, On 7/3/2015 9:29 AM, Steven Franke wrote: Joe and wspr in wsjtx testers: I’ve significantly improved the efficiency of the sync-search in the current version (r5668) of wsprd_exp.c. On a large (1953 files) batch of files representing all bands and the entire diurnal cycle the r5668 wsprd and wsprd_exp compare as follows: wsprd: 5083 decodes in 1294s (29% in sync0 and 17% in Fano) wsprd_exp: 5132 decodes in 970s (9% sync0 and 24% in Fano) Approximately 25% decrease in average execution time with no decrease (maybe a slight increase) in performance. If you get a chance and can confirm that you also see a significant time savings, then I propose that we make this version of wsprd_exp the new default wsprd. At some point we should be able to cash in some of the time saved for more decodes. I ran the same test as previously, this time using wsprd_exe built from your code in r5668. Here's my table from before, with the new results added as line 7: Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates 7. 2570428 1.1 1.774.93 r5668 On this batch of files (all 20 meters, many decodable signals per file) the results are nearly the same as those of my Run#5 (subtraction with full coherence and test for local maxima). Slightly faster, slightly more decodes. Hmmm. That’s interesting and surprising. I tested it separately on 40m and 20m files and saw 35% and 17% reduction in execution time, respectively. So when I got 25% reduction for the large batch containing files from all bands, I was convinced that I had a robust result. I wonder if this uncovers a difference between compiler optimizations on the Mac and Windows. Steve -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wsprd_exp improvements
Joe, On Jul 3, 2015, at 10:43 AM, Joe Taylor j...@princeton.edu wrote: Hi Steve, Hmmm. That’s interesting and surprising. I tested it separately on 40m and 20m files and saw 35% and 17% reduction in execution time, respectively. So when I got 25% reduction for the large batch containing files from all bands, I was convinced that I had a robust result. I wonder if this uncovers a difference between compiler optimizations on the Mac and Windows. Not likely, I think. Maybe it's a difference between our sets of example files? Or maybe I've made a mistake with my test. I’m collecting a new batch of files. In the meantime, I wonder if you happened to save the wspr_timer files. It should be instructive to compare them. I have a hunch that the fact that I am running on a laptop with a solid-state disk drive can explain part of the difference. If you are running with a spinning disk, maybe the readwavfile times are vastly different and are swamping the other improvements? I’ll include my times, below. Note that wsprd_exp spends 1/4 as much time in sync_and_demod(0)! I deliberately used some of this savings to increase the time spent in the decoder (by removing quickmode on the second pass). Note that these results are for 214 20m files, so the average time per file is almost exactly 1 second for wsprd_exp. wsprd: Code segmentSeconds Frac --- readwavfile 36.440.14 Coarse DT f0 f1 24.950.09 sync_and_demod(0)74.420.28 sync_and_demod(1)30.100.11 sync_and_demod(2) 9.390.04 Fano decoder 66.380.25 --- Total 267.171.00 wsprd_exp: Code segmentSeconds Frac --- readwavfile 34.420.16 Coarse DT f0 f1 24.160.11 sync_and_demod(0)18.670.09 sync_and_demod(1)18.780.09 sync_and_demod(2) 8.980.04 Fano decoder 83.690.39 --- Total 212.351.00 Steve k9an -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
