Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Bill, On Jul 2, 2015, at 1:46 PM, Bill Somerville g4...@classdesign.com wrote: On 29/06/2015 15:00, Bill Somerville wrote: Hi Steve others who build gnuradio and WSJT-X on Mac, ... OK, the problem wasn't quite what I thought. It is an include directive ordering issue but it stems from the use of FFTW3 from MacPorts, this in itself is not an issue but it has the side effect of picking up the Qt4 headers as well. Unfortunately I can't find an easy way of ensuring the -I/opt/local/include is after the includes for Qt5. That would solve the issue but the way that the Qt includes are detected by CMake doesn't seem to have a way to change the ordering. I have posted a question to the CMake ML but for now you should be able to build by deactivating qt4-mac before building WSJT-X. It would be wise to add a '--clean-first' to the CMake build for the first time to ensure any incorrectly built object files are discarded. Something like: $ sudo port deactivate qt4-mac $ cmake --build ~/Builds/wsjtx --clean-first --target install -- -j $ sudo port activate qt4-mac $ open ~/Builds/wsjtx_install/wsjtx.app This process should no longer be necessary as of r5663. I have adjusted the CMake script to avoid a MacPorts Qt4 installation being incorrectly detected ahead of a Qt5 installation. It seems to have worked. I re-activated qt4-mac and then successfully compiled wsjtx. Thanks! There is something funny going on with the size of the buttons. Please see this Grab of the wsjtx window and note that the colored (active) Monitor and Decode buttons are larger than the others, but not by the same amount… https://dl.dropboxusercontent.com/u/33211132/wsjtx_on_osx.tiff 73 Bill G4WJS. Steve k9an -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 29/06/2015 15:00, Bill Somerville wrote: Hi Steve others who build gnuradio and WSJT-X on Mac, ... OK, the problem wasn't quite what I thought. It is an include directive ordering issue but it stems from the use of FFTW3 from MacPorts, this in itself is not an issue but it has the side effect of picking up the Qt4 headers as well. Unfortunately I can't find an easy way of ensuring the -I/opt/local/include is after the includes for Qt5. That would solve the issue but the way that the Qt includes are detected by CMake doesn't seem to have a way to change the ordering. I have posted a question to the CMake ML but for now you should be able to build by deactivating qt4-mac before building WSJT-X. It would be wise to add a '--clean-first' to the CMake build for the first time to ensure any incorrectly built object files are discarded. Something like: $ sudo port deactivate qt4-mac $ cmake --build ~/Builds/wsjtx --clean-first --target install -- -j $ sudo port activate qt4-mac $ open ~/Builds/wsjtx_install/wsjtx.app This process should no longer be necessary as of r5663. I have adjusted the CMake script to avoid a MacPorts Qt4 installation being incorrectly detected ahead of a Qt5 installation. ... 73 Bill G4WJS. -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Steve, Bill, and all, On 6/30/2015 6:18 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. For me, at least, r5644 does not presently compile wsprd correctly on Windows. I believe we need to request a larger stack size when linking wsprd. Something like LDFLAGS = --Wl,--stack,400 that I used in .../wsjtx/lib/wsprd/Makefile.win32 Bill, could you please do the needful in .../src/wsjtx/CMakeLists.txt ? -- 73, Joe, K1jT -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 01/07/2015 13:54, Joe Taylor wrote: Hi Steve, Bill, and all, Hi Joe, On 6/30/2015 6:18 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. For me, at least, r5644 does not presently compile wsprd correctly on Windows. I believe we need to request a larger stack size when linking wsprd. Something like LDFLAGS = --Wl,--stack,400 that I used in .../wsjtx/lib/wsprd/Makefile.win32 Bill, could you please do the needful in .../src/wsjtx/CMakeLists.txt ? I will do this but in the past this has been better solved by finding the offending code and allocating the storage on the heap rather than the stack. Do we know what change caused the larger stack requirement? -- 73, Joe, K1jT 73 Bill G4WJS. -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
There are several easy fixes 500k here: float buffer[2*65536]; 2M here double refi[45000],refq[45000]; double ci[45000],cq[45000],cfi[45000],cfq[45000]; 400k here char hashtab[32768][13]; 73 Mike W9MDB -Original Message- From: Bill Somerville [mailto:g4...@classdesign.com] Sent: Wednesday, July 01, 2015 8:02 AM To: wsjt-devel@lists.sourceforge.net Subject: Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem On 01/07/2015 13:54, Joe Taylor wrote: Hi Steve, Bill, and all, Hi Joe, On 6/30/2015 6:18 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. For me, at least, r5644 does not presently compile wsprd correctly on Windows. I believe we need to request a larger stack size when linking wsprd. Something like LDFLAGS = --Wl,--stack,400 that I used in .../wsjtx/lib/wsprd/Makefile.win32 Bill, could you please do the needful in .../src/wsjtx/CMakeLists.txt ? I will do this but in the past this has been better solved by finding the offending code and allocating the storage on the heap rather than the stack. Do we know what change caused the larger stack requirement? -- 73, Joe, K1jT 73 Bill G4WJS. -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 01/07/2015 14:25, Steven Franke wrote: Bill, Joe, Michael, and all, Hi Steve, Do we know what change caused the larger stack requirement? Yes, I caused this problem by being lazy when I added the arrays used for signal subtraction. I’m at work this morning, but will be able to look at this and move these large arrays to the heap this afternoon. If you’d rather not wait, then feel free to fix it. No problem, I have amended the build script to allow for this so you can deal with the root problem at your leisure. 73 Bill G4WJS. -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hello Bill and all team While I am working on the Hamlib / FT991 issue with Michael I got caught too by the wsprd issue . 1/ 5644 :error message in wsjtx at decode time starting or running wsprd 2/ Dos command wsprd without parameter : just the usage ok 3/ Dos command but trying to open a c2 file from command line it crashes 4 / tried 5647 and it works I suspect it gives an idea of the root cause ! I am back to hamlib issue now … Regards Jean Louis C:\WSJT\wsjtx\binwsprd Usage: wsprd [options...] infile infile must have suffix .wav or .c2 Options: -a path path to writeable data files, default=. -c write .c2 file at the end of the first pass -e x (x is transceiver dial frequency error in Hz) -f x (x is transceiver dial frequency in MHz) -H do not use (or update) the hash table -m decode wspr-15 .wav file -q quick mode - doesn't dig deep for weak signals -s single pass mode, no subtraction (same as original wsprd) -v verbose mode (shows dupes) -w wideband mode - decode signals within +/- 150 Hz of center -z x (x is fano metric table bias, default is 0.42) C:\WSJT\wsjtx\bin C:\WSJT\wsjtx\binwsprd 150526_1904.c2 error wsprd.exe has stopped (windows message) -Message d'origine- De : Bill Somerville [mailto:g4...@classdesign.com] Envoyé : mercredi 1 juillet 2015 12:20 À : wsjt-devel@lists.sourceforge.net Objet : Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem On 01/07/2015 06:16, Robert Kalkwarf wrote: Steve, Hi Bob, Win7 32 bit I get an Error running or starting c:/WSJT/wsjtx/bin/wsprd That looks like you have installed using an installer generated by the package build option. Have a look in the installed folder and see if wsprd.exe is there. It will be C:\WSJT\wsjtx\bin\wsprd.exe. If it is there, try running it from the command line and tell us what you get. Tried build-wsjtx install Tried build-wsjtx package Answered y both times to update. HELP says I am running r5644 Clue Please? 73 Bob w7wo 73 Bill G4WJS. On Jun 30, 2015, at 3:18 PM, Steven Franke mailto:s.j.fra...@icloud.com s.j.fra...@icloud.com wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. Steve k9an On Jun 29, 2015, at 6:25 PM, Joe Taylor mailto:j...@princeton.edu j...@princeton.edu wrote: Hi Steve, The test runs all used the same set of 386 *.wav files, processed with the following decoders: 1. wsprd, from WSPR-X (baseline decoder) 2. wspr4 3. wsprd, as built for WSJT-X v1.6.0 r5636 4. wsprd_exp, signal subtraction using symbol-by-symbol coherence 5. wsprd_exp, subtraction with full coherence and test for local maxima 6. wsprd_exp, subtraction with full coherence and snr min_snr For each run the following table gives the number of decodes, the wall-clock running time, the average time per wav file, and the improvement factor for number of decodes and speed. Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates Thanks for running these tests. These agree with my results, although I see somewhat more improvement as you go down the list, probably because my test files are all from 20m under crowded band conditions. Agreed: I think my test files were not quite so homogeneous as yours. At some point, we should look at the coherent subtraction lowpass filter. The length (nfilt) and impulse response were chosen without much thought... Yes, this may need further tweaking. In addition, I suspect we can find a criterion better than simply smspec[j] min_snr for choosing candidate frequencies, and likely some other speedups, as well. -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ https://www.gigenetcloud.com/ ___ wsjt-devel mailing list mailto:wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 01/07/2015 16:57, f5djl wrote: Hello Bill and all team Bonjour Jean-Louis, While I am working on the Hamlib / FT991 issue with Michael I got caught too by the wsprd issue . 1/ 5644 :error message in wsjtx at decode time starting or running wsprd 2/ Dos command wsprd without parameter : just the usage ok 3/ Dos command but trying to open a c2 file from command line it crashes 4 / tried 5647 and it works I suspect it gives an idea of the root cause ! I am back to hamlib issue now … Yes, this is almost certainly the stack size issue on Windows which has now been resolved as of r5647. Thanks for that test. Regards Jean Louis 73 Bill G4WJS. C:\WSJT\wsjtx\binwsprd Usage: wsprd [options...] infile infile must have suffix .wav or .c2 Options: -a path path to writeable data files, default=. -c write .c2 file at the end of the first pass -e x (x is transceiver dial frequency error in Hz) -f x (x is transceiver dial frequency in MHz) -H do not use (or update) the hash table -m decode wspr-15 .wav file -q quick mode - doesn't dig deep for weak signals -s single pass mode, no subtraction (same as original wsprd) -v verbose mode (shows dupes) -w wideband mode - decode signals within +/- 150 Hz of center -z x (x is fano metric table bias, default is 0.42) C:\WSJT\wsjtx\bin C:\WSJT\wsjtx\binwsprd 150526_1904.c2 error wsprd.exe has stopped (windows message) -Message d'origine- De : Bill Somerville [mailto:g4...@classdesign.com] Envoyé : mercredi 1 juillet 2015 12:20 À : wsjt-devel@lists.sourceforge.net Objet : Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem On 01/07/2015 06:16, Robert Kalkwarf wrote: Steve, Hi Bob, Win7 32 bit I get an Error running or starting c:/WSJT/wsjtx/bin/wsprd That looks like you have installed using an installer generated by the package build option. Have a look in the installed folder and see if wsprd.exe is there. It will be C:\WSJT\wsjtx\bin\wsprd.exe. If it is there, try running it from the command line and tell us what you get. Tried build-wsjtx install Tried build-wsjtx package Answered y both times to update. HELP says I am running r5644 Clue Please? 73 Bob w7wo 73 Bill G4WJS. On Jun 30, 2015, at 3:18 PM, Steven Franke s.j.fra...@icloud.com mailto:s.j.fra...@icloud.com wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. Steve k9an On Jun 29, 2015, at 6:25 PM, Joe Taylor j...@princeton.edu mailto:j...@princeton.edu wrote: Hi Steve, The test runs all used the same set of 386 *.wav files, processed with the following decoders: 1. wsprd, from WSPR-X (baseline decoder) 2. wspr4 3. wsprd, as built for WSJT-X v1.6.0 r5636 4. wsprd_exp, signal subtraction using symbol-by-symbol coherence 5. wsprd_exp, subtraction with full coherence and test for local maxima 6. wsprd_exp, subtraction with full coherence and snr min_snr For each run the following table gives the number of decodes, the wall-clock running time, the average time per wav file, and the improvement factor for number of decodes and speed. Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates Thanks for running these tests. These agree with my results, although I see somewhat more improvement as you go down the list, probably because my test files are all from 20m under crowded band conditions. Agreed: I think my test files were not quite so homogeneous as yours. At some point, we should look at the coherent subtraction lowpass filter. The length (nfilt) and impulse response were chosen without much thought... Yes, this may need further tweaking. In addition, I suspect we can find a criterion better than simply smspec[j] min_snr for choosing candidate frequencies, and likely some other speedups, as well. -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ wsjt
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Goodmorning Bill, Using the JTS-QT environment I did build-wsjtx rinstall and successfully completed r5647 which is behaving just fine. I can only suspect the diff since r5644 and r5647 has resolved my issue. Thanks for the response. Bob Kalkwarf w7wo On Jul 1, 2015, at 3:19 AM, Bill Somerville g4...@classdesign.com wrote: -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Bill, On Jul 1, 2015, at 8:39 AM, Bill Somerville g4...@classdesign.com wrote: On 01/07/2015 14:25, Steven Franke wrote: Bill, Joe, Michael, and all, Hi Steve, Do we know what change caused the larger stack requirement? Yes, I caused this problem by being lazy when I added the arrays used for signal subtraction. I’m at work this morning, but will be able to look at this and move these large arrays to the heap this afternoon. If you’d rather not wait, then feel free to fix it. No problem, I have amended the build script to allow for this so you can deal with the root problem at your leisure. I have moved the large arrays off of the stack. When you get a chance, can you confirm that the program will now compile on Windows without the need to increase the stack size? Steve k9an 73 Bill G4WJS. -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Interesting results with with decoder #5 on 20M this evening: 2015-06-30 22:52 PA0MLC 14.097121 -4 0 JO31aw 5 NO3M EN91 6335 297 2015-06-30 22:52 G6KIZ 14.097121 -16 4 JO02fu 0.2 NO3M EN91 5949 293 2015-07-01 01:16 HB9CZF 14.097071 -1 4 JN47ch 1 NO3M EN91 6719 301 2015-07-01 01:16 KB1MVX 14.097071 -12 -1 EM73 1 NO3M EN91 957 20 In each case, same offset and 11-12 dB SNR difference... slick. There may have been others, but these are ones I caught. Of course, numerous instances of only a Hz or three separation. 73 Eric NO3M (WG2XJM 630M/2200M) On 06/30/2015 06:18 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. Steve k9an -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Steve, Win7 32 bit I get an Error running or starting c:/WSJT/wsjtx/bin/wsprd Tried build-wsjtx install Tried build-wsjtx package Answered y both times to update. HELP says I am running r5644 Clue Please? 73 Bob w7wo On Jun 30, 2015, at 3:18 PM, Steven Franke s.j.fra...@icloud.com wrote: For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. Steve k9an On Jun 29, 2015, at 6:25 PM, Joe Taylor j...@princeton.edu wrote: Hi Steve, The test runs all used the same set of 386 *.wav files, processed with the following decoders: 1. wsprd, from WSPR-X (baseline decoder) 2. wspr4 3. wsprd, as built for WSJT-X v1.6.0 r5636 4. wsprd_exp, signal subtraction using symbol-by-symbol coherence 5. wsprd_exp, subtraction with full coherence and test for local maxima 6. wsprd_exp, subtraction with full coherence and snr min_snr For each run the following table gives the number of decodes, the wall-clock running time, the average time per wav file, and the improvement factor for number of decodes and speed. Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates Thanks for running these tests. These agree with my results, although I see somewhat more improvement as you go down the list, probably because my test files are all from 20m under crowded band conditions. Agreed: I think my test files were not quite so homogeneous as yours. At some point, we should look at the coherent subtraction lowpass filter. The length (nfilt) and impulse response were chosen without much thought... Yes, this may need further tweaking. In addition, I suspect we can find a criterion better than simply smspec[j] min_snr for choosing candidate frequencies, and likely some other speedups, as well. -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
For those testing wspr mode in wsjt-x ver 1.6, I’ve just committed r5644 which makes decoder #5 from Joe’s table, below, the default decoder in wsjt-x ver 1.6. It is no longer necessary to separately compile wsprd_exp to get the benefits of two-pass decoding. Steve k9an On Jun 29, 2015, at 6:25 PM, Joe Taylor j...@princeton.edu wrote: Hi Steve, The test runs all used the same set of 386 *.wav files, processed with the following decoders: 1. wsprd, from WSPR-X (baseline decoder) 2. wspr4 3. wsprd, as built for WSJT-X v1.6.0 r5636 4. wsprd_exp, signal subtraction using symbol-by-symbol coherence 5. wsprd_exp, subtraction with full coherence and test for local maxima 6. wsprd_exp, subtraction with full coherence and snr min_snr For each run the following table gives the number of decodes, the wall-clock running time, the average time per wav file, and the improvement factor for number of decodes and speed. Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates Thanks for running these tests. These agree with my results, although I see somewhat more improvement as you go down the list, probably because my test files are all from 20m under crowded band conditions. Agreed: I think my test files were not quite so homogeneous as yours. At some point, we should look at the coherent subtraction lowpass filter. The length (nfilt) and impulse response were chosen without much thought... Yes, this may need further tweaking. In addition, I suspect we can find a criterion better than simply smspec[j] min_snr for choosing candidate frequencies, and likely some other speedups, as well. -- Joe -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 28/06/2015 22:08, Steven Franke wrote:
Thanks Bill,
Hi Steve,
For what it’s worth, here a link to the VERBOSE build capture:
https://dl.dropboxusercontent.com/u/33211132/k9an_build_capture.txt
Here’s the CMakeCache.txt:
https://dl.dropboxusercontent.com/u/33211132/CMakeCache.txt
OK, the problem wasn't quite what I thought. It is an include directive
ordering issue but it stems from the use of FFTW3 from MacPorts, this in
itself is not an issue but it has the side effect of picking up the Qt4
headers as well. Unfortunately I can't find an easy way of ensuring the
-I/opt/local/include is after the includes for Qt5. That would solve the
issue but the way that the Qt includes are detected by CMake doesn't
seem to have a way to change the ordering. I have posted a question to
the CMake ML but for now you should be able to build by deactivating
qt4-mac before building WSJT-X. It would be wise to add a
'--clean-first' to the CMake build for the first time to ensure any
incorrectly built object files are discarded. Something like:
$ sudo port deactivate qt4-mac
$ cmake --build ~/Builds/wsjtx --clean-first --target install -- -j
$ sudo port activate qt4-mac
$ open ~/Builds/wsjtx_install/wsjtx.app
One the WSJT-X build is complete, it doesn't use the port files as it
has the Qt frameworks bundled, the qt4-mac port can be reactivated.
The --clean-first will only be needed the first time, subsequent builds
can be minimal so long as the qt4-mac port is always deactivated while
building.
Steve k9an
73
Bill
G4WJS.
On Jun 28, 2015, at 4:01 PM, Bill Somerville g4...@classdesign.com wrote:
On 28/06/2015 21:51, Bill Somerville wrote:
On 28/06/2015 21:41, Steven Franke wrote:
John and Bill,
Hi Steve,
On Jun 28, 2015, at 2:24 PM, John Nelson j...@rmnjmn.demon.co.uk wrote:
Steve,
Back with WSJT-X. Running wsprd_exp on my Mac (OSX 10.10.3) and seeing
the improved decodes. Now using .c2 files offline to compare wsprd and
wsprd_exp. Good stuff….
Thanks, John. I’ve been meaning to ask you and/or Bill for advice. I do
all of the wsprd development on my Mac, but I have never been able to get
wsjt-x to compile. I get stuck when compiling /lib/ipcomm.cpp. I have to
resort to an Ubuntu 14.04 virtual machine if I want to test wsjt-x on the
mac.
I think that my problem may have to do with having qt4 installed via
macports (for gnuradio) and a separate installation of Qt5 for wsjt-x.
I’ll include the error messages below. I have Qt5 installed per the
instructions in the “INSTALL” text file. I have no idea why it is looking
in my /opt/local path. I used the following cmake command:
MacPorts installs stuff in /opt/local and it is correctly being picked
up by the compilers.
t
cmake -D CMAKE_PREFIX_PATH=~/local/qt-macx-clang;~/Builds/hamlib3.0 -D
CMAKE_INSTALL_PREFIX=~/Builds/wsjtx_install ~/Builds/wsjtx
Any suggestions would be much appreciated!
The problem seems to be that the compiler is getting the
/opt/local/include path ahead of the stuff included via the
CMAKE_PREFIX_PATH. That shouldn't be happening.
Looks like this is a known issue with the qt4-mac port. I'll install it
on my Mac VM and see if I can find an easy workaround.
I suggest that a fresh build tree and configure with CMake followed by a
CMake build adding ' -- VERBOSE=1' to the end of the build command.
Capture the output and post it somewhere I can have a look at it along
with the CMakeCache.txt file from the build tree root.
Steve k9an
73
Bill
G4WJS.
Here’s the error log:
[ 69%] Building CXX object CMakeFiles/jt9.dir/lib/ipcomm.cpp.o
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:65:9:
error:
unknown type name 'QMessageLogContext'
QMessageLogContext context;
^
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'isDetached' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2255:63: note: expanded from macro
'Q_DECLARE_SHARED'
template inline bool qIsDetachedTYPE(TYPE t) { return
t.isDetached(); } \
~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:16: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Steve, I use a script to make life easy. The working part of the script is this: cmake -D CMAKE_BUILD_TYPE=$ctype -D CMAKE_INSTALL_PREFIX=~/G4KLA/Rev$1/$rel \ -D CMAKE_PREFIX_PATH=~/Qt5.4.0;/usr/local/hamlib \ -D CMAKE_OSX_DEPLOYMENT_TARGET=10.9 \ -D CMAKE_C_COMPILER=clang -D CMAKE_CXX_COMPILER=clang++ \ -D CMAKE_OSX_SYSROOT=/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.9.sdk \ -D WSJT_SKIP_MANPAGES=ON -D WSJT_GENERATE_DOCS=OFF ~/G4KLA/Rev$1/wsjtx cmake --build . --target $btype -- -kj $ctype is either Debug or Release $1 points to the current location of the downloaded software $rel can be either rel, the directory for a release version; or rel_deb the directory for the debug version $btype is eitherinstall to produce a local version or package to produce a full-formed .dmg for distribution. I use the latest Qt version I have downloaded Bill's hamlib which I keep uptodate. I do not use Macports. So, for me,wsjtx_comp X5636 Release installbuilds a local package. Hope this helps... --- John G4KLA -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Joe, On Jun 29, 2015, at 11:53 AM, Joe Taylor j...@princeton.edu wrote: Hi Steve and all, I have run a new series of tests of various WSPR decoders, with results that may be of interest to others. The test runs all used the same set of 386 *.wav files, processed with the following decoders: 1. wsprd, from WSPR-X (baseline decoder) 2. wspr4 3. wsprd, as built for WSJT-X v1.6.0 r5636 4. wsprd_exp, signal subtraction using symbol-by-symbol coherence 5. wsprd_exp, subtraction with full coherence and test for local maxima 6. wsprd_exp, subtraction with full coherence and snr min_snr For each run the following table gives the number of decodes, the wall-clock running time, the average time per wav file, and the improvement factor for number of decodes and speed. Decodes Time1 AvgTimeImprovement Decoder (s)(s)Decodes Speed 1. 1451 2111 5.5 1.001.00 baseline 2. 1693 1599 4.1 1.171.32 wspr4 3. 2208335 0.9 1.526.30 WSJT-X v1.6.0 r5636 4. 2464413 1.1 1.705.11 partial coherence 5. 2567431 1.1 1.774.90 full coherence 6. 2839 2136 5.5 1.960.99 more candidates Thanks for running these tests. These agree with my results, although I see somewhat more improvement as you go down the list, probably because my test files are all from 20m under crowded band conditions. At some point, we should look at the coherent subtraction lowpass filter. The length (nfilt) and impulse response were chosen without much thought... Steve k9an I think these results show some truly remarkable improvements in performance! Our slowest decoder, that used for run #6, is essentially the same speed as the original decoder packaged with WSPR-X -- yet it produces twice as many decodes! Although it's arguably fast enough already, I am confident that we can make it faster. Run #5, which used the two-pass decoder with full-coherence subtraction of decoded signals, is impressive with respect to *both* speed and thoroughness. -- Joe, K1JT -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Don't Limit Your Business. Reach for the Cloud. GigeNET's Cloud Solutions provide you with the tools and support that you need to offload your IT needs and focus on growing your business. Configured For All Businesses. Start Your Cloud Today. https://www.gigenetcloud.com/ ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
I'm curious...can you test what happens if you make it a one-sided test? That
would eliminate local minimums.
if((smspec[j]smspec[j-1]) || (smspec[j]smspec[j+1]) (npk200))
{
Also...what's the distribution of the snr values for the successful vs
unsuccessful decodes? Maybe there's a better value to be had there.
73
Mike W9MDB
-Original Message-
From: Steven Franke [mailto:s.j.fra...@icloud.com]
Sent: Sunday, June 28, 2015 9:47 AM
To: WSJT software development
Subject: Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Joe,
Frequency-sorting has now been committed.
It dawned on me that it is no longer really appropriate to insist that a
decoding candidate correspond to a local maximum in the average spectrum. I
tried this simple change:
$ diff wsprd_exp.c ~/Builds/wsjtx/lib/wsprd/wsprd_exp.c
848,850c848,849
for(j=1; j410; j=j+2) {
//if((smspec[j]smspec[j-1]) (smspec[j]smspec[j+1])
(npk200)) {
if((smspec[j]min_snr) (npk200)) {
---
for(j=1; j410; j++) {
if((smspec[j]smspec[j-1]) (smspec[j]smspec[j+1])
(npk200)) {
On my 20m wav files it gives us another 10% over the current wsprd_exp with
subtraction and two-passes, or a whopping 47% improvement over the current
default wsprd:
Default wsprd: 1315 in 163s
wsprd_exp: 1758 in 270s
no peak requirement: 1934 in 1487s
With this change, a case that yields 16 decodes from the current wsprd_exp now
yields 19 decodes from one .wav file!
It is dog-slow as it stands. But I’m sure that there are things that we can do
to speed it up significantly. This might be a good application for openmpi, no?
Steve k9an
--
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors network
devices and physical virtual servers, alerts via email sms for fault.
Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel
--
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical virtual servers, alerts via email sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
It is interesting to see how far we’ve come. I just analyzed my favorite .wav
file with several versions of the decoder:
1. wspr0 from python-based wspr: 7 decodes
2. current wsprd from wsjt-x 1.6: 10 decodes
3. wsprd_exp with subtraction and two-passes:16 decodes
4. no-peak-requirement modification to wsprd_exp: 19 decodes
Steve k9an
On Jun 28, 2015, at 9:46 AM, Steven Franke s.j.fra...@icloud.com wrote:
Joe,
Frequency-sorting has now been committed.
It dawned on me that it is no longer really appropriate to insist that a
decoding candidate correspond to a local maximum in the average spectrum. I
tried this simple change:
$ diff wsprd_exp.c ~/Builds/wsjtx/lib/wsprd/wsprd_exp.c
848,850c848,849
for(j=1; j410; j=j+2) {
//if((smspec[j]smspec[j-1]) (smspec[j]smspec[j+1])
(npk200)) {
if((smspec[j]min_snr) (npk200)) {
---
for(j=1; j410; j++) {
if((smspec[j]smspec[j-1]) (smspec[j]smspec[j+1])
(npk200)) {
On my 20m wav files it gives us another 10% over the current wsprd_exp with
subtraction and two-passes, or a whopping 47% improvement over the current
default wsprd:
Default wsprd: 1315 in 163s
wsprd_exp: 1758 in 270s
no peak requirement: 1934 in 1487s
With this change, a case that yields 16 decodes from the current wsprd_exp
now yields 19 decodes from one .wav file!
It is dog-slow as it stands. But I’m sure that there are things that we can
do to speed it up significantly. This might be a good application for
openmpi, no?
Steve k9an
--
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical virtual servers, alerts via email sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel
--
Monitor 25 network devices or servers for free with OpManager!
OpManager is web-based network management software that monitors
network devices and physical virtual servers, alerts via email sms
for fault. Monitor 25 devices for free with no restriction. Download now
http://ad.doubleclick.net/ddm/clk/292181274;119417398;o
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Bill, On Jun 28, 2015, at 9:59 AM, Bill Somerville g4...@classdesign.com wrote: On 28/06/2015 15:46, Steven Franke wrote: Hi Steve, ... It is dog-slow as it stands. But I’m sure that there are things that we can do to speed it up significantly. This might be a good application for openmpi, no? There is fairly major technical issue with this suggestion. On Mac we don't have a C++ OpenMP (OpenMPI is a different tool for message passing) implementation available. To get the current Fortran OpenMP code working on Mac we have had to take some liberties with mixing gfortran OpenMP code with C C++ code compiled with Apple clang clang++ which have no OpenMP support. We must use Apple clang++ on Mac since that is the only fully supported C++ compiler with Qt on that platform. I would strongly suggest using threading probably supported by the Qt framework if we wish to obtain parallelism in our C++ code. Thanks. I will study up on threading and how it might apply here. Steve. Steve k9an 73 Bill G4WJS. -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 28/06/2015 16:40, Steven Franke wrote: Hi Bill, Hi Steve, Thanks. I will study up on threading and how it might apply here. Steve. It basically boils down to how you can break the work to be done into independent chunks that can be processed in parallel. The independence is key here, if a chunk of work X can be divided into two or more completely independent chunks Y and Z, ... then there is a gain to be had if the time for splitting X, executing the longer of Y and Z, ... and recombining the results of Y and Z, ... is less than the time to execute X alone. If Y and Z are not truly independent then there is an added overhead for communication between them, usually in the form of some form of synchronization constraint. This is also where the cost of complexity can overwhelm any gains as synchronization constraints are a huge source of defects and maintenance costs. The rest is implementation detail. Steve k9an 73 Bill G4WJS. -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 28/06/2015 15:46, Steven Franke wrote: Hi Steve, ... It is dog-slow as it stands. But I’m sure that there are things that we can do to speed it up significantly. This might be a good application for openmpi, no? There is fairly major technical issue with this suggestion. On Mac we don't have a C++ OpenMP (OpenMPI is a different tool for message passing) implementation available. To get the current Fortran OpenMP code working on Mac we have had to take some liberties with mixing gfortran OpenMP code with C C++ code compiled with Apple clang clang++ which have no OpenMP support. We must use Apple clang++ on Mac since that is the only fully supported C++ compiler with Qt on that platform. I would strongly suggest using threading probably supported by the Qt framework if we wish to obtain parallelism in our C++ code. Steve k9an 73 Bill G4WJS. -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 28/06/2015 21:51, Bill Somerville wrote:
On 28/06/2015 21:41, Steven Franke wrote:
John and Bill,
Hi Steve,
On Jun 28, 2015, at 2:24 PM, John Nelson j...@rmnjmn.demon.co.uk wrote:
Steve,
Back with WSJT-X. Running wsprd_exp on my Mac (OSX 10.10.3) and seeing
the improved decodes. Now using .c2 files offline to compare wsprd and
wsprd_exp. Good stuff….
Thanks, John. I’ve been meaning to ask you and/or Bill for advice. I do all
of the wsprd development on my Mac, but I have never been able to get wsjt-x
to compile. I get stuck when compiling /lib/ipcomm.cpp. I have to resort to
an Ubuntu 14.04 virtual machine if I want to test wsjt-x on the mac.
I think that my problem may have to do with having qt4 installed via
macports (for gnuradio) and a separate installation of Qt5 for wsjt-x.
I’ll include the error messages below. I have Qt5 installed per the
instructions in the “INSTALL” text file. I have no idea why it is looking in
my /opt/local path. I used the following cmake command:
MacPorts installs stuff in /opt/local and it is correctly being picked
up by the compilers.
t
cmake -D CMAKE_PREFIX_PATH=~/local/qt-macx-clang;~/Builds/hamlib3.0 -D
CMAKE_INSTALL_PREFIX=~/Builds/wsjtx_install ~/Builds/wsjtx
Any suggestions would be much appreciated!
The problem seems to be that the compiler is getting the
/opt/local/include path ahead of the stuff included via the
CMAKE_PREFIX_PATH. That shouldn't be happening.
Looks like this is a known issue with the qt4-mac port. I'll install it
on my Mac VM and see if I can find an easy workaround.
I suggest that a fresh build tree and configure with CMake followed by a
CMake build adding ' -- VERBOSE=1' to the end of the build command.
Capture the output and post it somewhere I can have a look at it along
with the CMakeCache.txt file from the build tree root.
Steve k9an
73
Bill
G4WJS.
Here’s the error log:
[ 69%] Building CXX object CMakeFiles/jt9.dir/lib/ipcomm.cpp.o
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:65:9:
error:
unknown type name 'QMessageLogContext'
QMessageLogContext context;
^
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'isDetached' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2255:63: note: expanded from macro
'Q_DECLARE_SHARED'
template inline bool qIsDetachedTYPE(TYPE t) { return t.isDetached();
} \
~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:16: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:35: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:50: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
^
/opt/local/include/QtCore/qglobal.h:2249:19: note: expanded from macro '\
Q_DECLARE_SHARED_STL'
{ swap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:50: note: expanded
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Thanks Bill,
For what it’s worth, here a link to the VERBOSE build capture:
https://dl.dropboxusercontent.com/u/33211132/k9an_build_capture.txt
Here’s the CMakeCache.txt:
https://dl.dropboxusercontent.com/u/33211132/CMakeCache.txt
Steve k9an
On Jun 28, 2015, at 4:01 PM, Bill Somerville g4...@classdesign.com wrote:
On 28/06/2015 21:51, Bill Somerville wrote:
On 28/06/2015 21:41, Steven Franke wrote:
John and Bill,
Hi Steve,
On Jun 28, 2015, at 2:24 PM, John Nelson j...@rmnjmn.demon.co.uk wrote:
Steve,
Back with WSJT-X. Running wsprd_exp on my Mac (OSX 10.10.3) and seeing
the improved decodes. Now using .c2 files offline to compare wsprd and
wsprd_exp. Good stuff….
Thanks, John. I’ve been meaning to ask you and/or Bill for advice. I do
all of the wsprd development on my Mac, but I have never been able to get
wsjt-x to compile. I get stuck when compiling /lib/ipcomm.cpp. I have to
resort to an Ubuntu 14.04 virtual machine if I want to test wsjt-x on the
mac.
I think that my problem may have to do with having qt4 installed via
macports (for gnuradio) and a separate installation of Qt5 for wsjt-x.
I’ll include the error messages below. I have Qt5 installed per the
instructions in the “INSTALL” text file. I have no idea why it is looking
in my /opt/local path. I used the following cmake command:
MacPorts installs stuff in /opt/local and it is correctly being picked
up by the compilers.
t
cmake -D CMAKE_PREFIX_PATH=~/local/qt-macx-clang;~/Builds/hamlib3.0 -D
CMAKE_INSTALL_PREFIX=~/Builds/wsjtx_install ~/Builds/wsjtx
Any suggestions would be much appreciated!
The problem seems to be that the compiler is getting the
/opt/local/include path ahead of the stuff included via the
CMAKE_PREFIX_PATH. That shouldn't be happening.
Looks like this is a known issue with the qt4-mac port. I'll install it
on my Mac VM and see if I can find an easy workaround.
I suggest that a fresh build tree and configure with CMake followed by a
CMake build adding ' -- VERBOSE=1' to the end of the build command.
Capture the output and post it somewhere I can have a look at it along
with the CMakeCache.txt file from the build tree root.
Steve k9an
73
Bill
G4WJS.
Here’s the error log:
[ 69%] Building CXX object CMakeFiles/jt9.dir/lib/ipcomm.cpp.o
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:65:9:
error:
unknown type name 'QMessageLogContext'
QMessageLogContext context;
^
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'isDetached' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2255:63: note: expanded from macro
'Q_DECLARE_SHARED'
template inline bool qIsDetachedTYPE(TYPE t) { return t.isDetached();
} \
~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:16: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:35: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/QDebug:1:
/Users/sfranke/local/qt-macx-clang/lib/QtCore.framework/Headers/qdebug.h:129:1:
error: no
member named 'data_ptr' in 'QDebug'
Q_DECLARE_SHARED(QDebug)
^~~~
/opt/local/include/QtCore/qglobal.h:2257:50: note: expanded from macro
'Q_DECLARE_SHARED'
{ qSwap(value1.data_ptr(), value2.data_ptr()); } \
^
/opt/local/include/QtCore/qglobal.h:2249:19: note: expanded from macro '\
Q_DECLARE_SHARED_STL'
{ swap(value1.data_ptr(), value2.data_ptr()); } \
~~ ^
In file included from /Users/sfranke/Builds/wsjtx/lib/ipcomm.cpp:1:
In file included from
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Steve, Back with WSJT-X. Running wsprd_exp on my Mac (OSX 10.10.3) and seeing the improved decodes. Now using .c2 files offline to compare wsprd and wsprd_exp. Good stuff --- John g4KLA -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Steve, On 6/27/2015 8:36 PM, Steven Franke wrote: I just captured a .c2 file after commenting out the call to timf2 in wspr_downsample and replacing x1 with x0 in the call to mixlpf. The dropouts are gone. So it looks like the problem is in timf2. Good work! As far as I can remember: since we're not presently doing noise blanking here anyway, timf2 would be doing nothing useful even if it were working properly. Pending further work to correct the bug, at least, let's just do without timf2 and downsample from x0 into c0 -- as you have done. -- Joe, K1JT -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
On 27/06/2015 23:58, Steven Franke wrote: Hi Steve, Hi Joe - Yes, I am comfortable with making wsprd_exp the official wsprd. It has been working very well here. I had a couple of 16-decode cases again last night on 20 meters. Say, I just happened to be sitting here working on tracking down the signal dropouts. When you get a chance, would you please have a look at the images linked below: https://dl.dropboxusercontent.com/u/33211132/375Hzdata.png https://dl.dropboxusercontent.com/u/33211132/1500Hzdata.png The first one is absolute value of the complex 375 Hz data from a .c2 file plotted as a 108x400 pixel image. The dropouts are clearly seen along to the top of the image. The second one is the 1500 Hz c0 “common” data written from within the writec2.f90 function. The second image is (108*4)x400 pixels - and shows that the features have a 432-pt fundamental period (at 1500 Hz). I’m scratching my head over here trying to figure out how a pattern like this gets produced. Right now I’m looking at the wspr_downsample function, and specifically the lowpass filter function. Does this sound right to you? I’m not clear on what the timf2 function is doing - do you think that the problem could originate in there? That's some funky custom filtering going on there! One thing that looks wrong to me is that the variable 'nb' in wspr_downsample.f90 really ought to be initialized, I'd guess to '0'. Having said that a quick glance thought the code seems to imply that if 'nb' is zero then the whole divide weak and strong frequencies in timf2.f90 may not achieve anything. I may well be well of track here as my DSP knowledge is way short of this sort of custom filtering code :( Steve 73 Bill G4WJS. On Jun 27, 2015, at 5:46 PM, Joe Taylor j...@princeton.edu wrote: Hi Steve, Sorry to be slow in getting back to you. After my post about wsprd_exp I got involved in chasing a bug in the ISCAT decoder ... On 6/26/2015 12:31 PM, Steven Franke wrote: I’m glad to see that you were able to confirm the improved performance of the two-pass decoder. I’m guessing that your dataset includes a more representative mixture of bands and conditions than the group of 20m files that I used. Hence the smaller, but still significant, increase in the number of decodes over the default wsprd. Probably so. I thought the increased number of decodes was very worthwhile, anyway. I am surprised by your observation that the two-pass decoder is faster than the default one. That’s not what I see here. Are you using your wspr_timer.out times? Or some other measure of execution time? The numbers that I reported were the “Total” times from wspr_timer.out. I ran both tests a couple of times, and I also used the “Total” times from wspr_timer.out. However, I was concentrating on decoder performance rather than timing, so my observation needs a more careful look before being taken very seriously. I hope to find time to look at it more thoroughly next week, and maybe see if any further optimizations are possible. Are you comfortable with making wsprd_exp the official wsprd now ? -- Joe -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
One more point, while I think of it. Since all WSPR-mode decodes are displayed at nearly the same time, anyway, wouldn't it be a good idea to sort them in order of increasing frequency before writing them out? Having them in frequency order makes it much easier to compaere decodes with signals on the waterfall. -- Joe -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Steve and Joe, Just started running wsprd_exp on my Raspberry Pi. Compilation went clean and I am decoding spots. Over the weekend I will do some more tests with some recorded wspr audio files. The recent improvements on wsprd are simply remarkable. The techniques employed are novel and would make a excellent topic for a QEX article! Many thanks and congratulations for the achievements. 73, Edson PY2SDR --- - We humans have the capability to do amazing things if we work together. - Nós seres humanos temos a capacidade de fazer coisas incríveis se trabalharmos juntos. On Fri, Jun 26, 2015 at 1:31 PM, Steven Franke s.j.fra...@icloud.com wrote: Hi Joe, I’m glad to see that you were able to confirm the improved performance of the two-pass decoder. I’m guessing that your dataset includes a more representative mixture of bands and conditions than the group of 20m files that I used. Hence the smaller, but still significant, increase in the number of decodes over the default wsprd. I am surprised by your observation that the two-pass decoder is faster than the default one. That’s not what I see here. Are you using your wspr_timer.out times? Or some other measure of execution time? The numbers that I reported were the “Total” times from wspr_timer.out. I just ran the analysis of my 20m files using the current default wsprd. It was slightly slower than running wsprd_exp with the -s (single-pass option): wsprd: 1315 decodes in 163s wsprd_exp -s: 1315 decodes in 159s (taken from Table 1 in the .pdf writeup) But in my case, both of these single-pass times are much shorter than the two-pass execution time, which was 270s. I wonder if there is some compiler optimization setting that was different between your wsprd and wsprd_exp instances? Steve k9an On Jun 26, 2015, at 11:00 AM, Joe Taylor j...@princeton.edu wrote: Hi all, I have committed a Makefile.win32 for building wsprd_exp.exe during testing. I have now run compartson tests of wsprd.exe and wsprd_exp.exe using a group of 410 *.wav files, with the following results: - Decoder Decodes Time (s) - 1. wsprd 2291 524 2. wsprd_exp 2551 418 3. wsprd_exp 2653 434 - Run #1 used the default wsprd.exe now built along with WSJT-X v1.6.0. Run #2 uses Steve's wsprd_exp with incoherent (symbol-by-symbol) signal subtraction; #3 used his fully coherent subtraction routine. Important note: to make the coherent subtraction work in Windows I had to increase the stack size -- see LDFALGS in Makefile.win32. So, with these example files I got 11% more decodes with symbol-by-symbol subtraction and 16% more decodes with coherent subtraction. The two-pass decoder appears to be faster than the single-pass one. (I don't yet know why, but in a couple of runs this seems to be repeatable.) I think these results are very impressive! We should certainly make wsprd_exp (renamed to wsprd) the default WSPR decoder. -- 73, Joe, K1JT -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi all, I have committed a Makefile.win32 for building wsprd_exp.exe during testing. I have now run compartson tests of wsprd.exe and wsprd_exp.exe using a group of 410 *.wav files, with the following results: - Decoder Decodes Time (s) - 1. wsprd 2291 524 2. wsprd_exp 2551 418 3. wsprd_exp 2653 434 - Run #1 used the default wsprd.exe now built along with WSJT-X v1.6.0. Run #2 uses Steve's wsprd_exp with incoherent (symbol-by-symbol) signal subtraction; #3 used his fully coherent subtraction routine. Important note: to make the coherent subtraction work in Windows I had to increase the stack size -- see LDFALGS in Makefile.win32. So, with these example files I got 11% more decodes with symbol-by-symbol subtraction and 16% more decodes with coherent subtraction. The two-pass decoder appears to be faster than the single-pass one. (I don't yet know why, but in a couple of runs this seems to be repeatable.) I think these results are very impressive! We should certainly make wsprd_exp (renamed to wsprd) the default WSPR decoder. -- 73, Joe, K1JT -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Greg, On Jun 25, 2015, at 11:10 PM, KI7MT ki7m...@gmail.com wrote: Hi Steve, Just so I am clear on this. The Makefile (Linux) has three targets, wsprd, wsprsim and wspr_exp. All we need to build is wspr_exp as the wsprd is being dealt with by Cmake yes? Yes, the regular wsprd and the simulation program wsprsim are built by Cmake, but not wsprd_exp. I'll be adding this to JTSDK Nix to build and cp the wspr_exp decoder to install/bin location on each turn. I had brief look at the Windows Makefile.MinGW but did not see the wsprd_exp target listed, so I am assuming this is only being tested on *Nix ?? I have only tested wsprd_exp on linux and OS X. I don’t have a Windows machine. Thanks for adding wsprd_exp to the WSJT-X build script. Some time soon I think that we’ll want to just rename wsprd_exp to wsprd and have it replace the current decoder. Before we do that, Id like to see that at least a couple of people besides me have been able to use wsprd_exp without problems. Steve k9an 73's Greg, KI7MT On 06/24/2015 07:30 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x, I have placed a .pdf file containing information on the current status of the experimental two-pass decoder wsprd_exp at this link: https://dl.dropboxusercontent.com/u/33211132/signal_subtraction.pdf I have been running the two-pass decoder with wsjt-x and with my 8-channel gnuradio-based setup for the past several days without any problems. If you would like to play with the new decoder, the Makefile in the wsjt-x/lib/wsprd directory will compile it. For testing with wsjt-x, I renamed the executable wsprd and copied it into the wsjt-x install/bin directory. While testing this new decoder I used a batch of .wav files and also a separate batch of .c2 files that were written by the latest wsjt-x. I eventually realized that all of the .c2 files that were written by wsjt-x were contaminated by signal dropouts. See “Case 3” in the pdf document for an example and more details. After discovering the problem with the .c2 files, I saved a batch of .wav and .c2 files using wsjt-x and found that the .wav files were fine, but that the .c2 files were contaminated. This makes me wonder if the problem lies in the writec2 routine in wsjt-x. I welcome input/opinion on this from those who are more familiar with the code. Could this problem somehow be specific to my setup? Steve k9an -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hello Steve, Can you confirm that this is the right path for wsprd_ext source? https://sourceforge.net/p/wsjt/wsjt/HEAD/tree/branches/wsjtx/lib/wsprd/ I will compile it on the R-Pi and run some tests. 73, Edson PY2SDR --- - We humans have the capability to do amazing things if we work together. - Nós seres humanos temos a capacidade de fazer coisas incríveis se trabalharmos juntos. On Fri, Jun 26, 2015 at 10:10 AM, Steven Franke s.j.fra...@icloud.com wrote: Hi Greg, On Jun 25, 2015, at 11:10 PM, KI7MT ki7m...@gmail.com wrote: Hi Steve, Just so I am clear on this. The Makefile (Linux) has three targets, wsprd, wsprsim and wspr_exp. All we need to build is wspr_exp as the wsprd is being dealt with by Cmake yes? Yes, the regular wsprd and the simulation program wsprsim are built by Cmake, but not wsprd_exp. I'll be adding this to JTSDK Nix to build and cp the wspr_exp decoder to install/bin location on each turn. I had brief look at the Windows Makefile.MinGW but did not see the wsprd_exp target listed, so I am assuming this is only being tested on *Nix ?? I have only tested wsprd_exp on linux and OS X. I don’t have a Windows machine. Thanks for adding wsprd_exp to the WSJT-X build script. Some time soon I think that we’ll want to just rename wsprd_exp to wsprd and have it replace the current decoder. Before we do that, Id like to see that at least a couple of people besides me have been able to use wsprd_exp without problems. Steve k9an 73's Greg, KI7MT On 06/24/2015 07:30 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x, I have placed a .pdf file containing information on the current status of the experimental two-pass decoder wsprd_exp at this link: https://dl.dropboxusercontent.com/u/33211132/signal_subtraction.pdf I have been running the two-pass decoder with wsjt-x and with my 8-channel gnuradio-based setup for the past several days without any problems. If you would like to play with the new decoder, the Makefile in the wsjt-x/lib/wsprd directory will compile it. For testing with wsjt-x, I renamed the executable wsprd and copied it into the wsjt-x install/bin directory. While testing this new decoder I used a batch of .wav files and also a separate batch of .c2 files that were written by the latest wsjt-x. I eventually realized that all of the .c2 files that were written by wsjt-x were contaminated by signal dropouts. See “Case 3” in the pdf document for an example and more details. After discovering the problem with the .c2 files, I saved a batch of .wav and .c2 files using wsjt-x and found that the .wav files were fine, but that the .c2 files were contaminated. This makes me wonder if the problem lies in the writec2 routine in wsjt-x. I welcome input/opinion on this from those who are more familiar with the code. Could this problem somehow be specific to my setup? Steve k9an -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Steve, I have compiled the two-pass decoder in Windows, and am running it now. To make it work I had to change line 1062 so that it calls subtract_signal() rather than subtract_signal2(). Haven't yet tried to determine what's amiss in the fully coherent subtraction routine. I will report back on results and any developments... -- Joe, K1JT On 6/26/2015 9:10 AM, Steven Franke wrote: Hi Greg, On Jun 25, 2015, at 11:10 PM, KI7MTki7m...@gmail.com wrote: Hi Steve, Just so I am clear on this. The Makefile (Linux) has three targets, wsprd, wsprsim and wspr_exp. All we need to build is wspr_exp as the wsprd is being dealt with by Cmake yes? Yes, the regular wsprd and the simulation program wsprsim are built by Cmake, but not wsprd_exp. I'll be adding this to JTSDK Nix to build and cp the wspr_exp decoder to install/bin location on each turn. I had brief look at the Windows Makefile.MinGW but did not see the wsprd_exp target listed, so I am assuming this is only being tested on *Nix ?? I have only tested wsprd_exp on linux and OS X. I don’t have a Windows machine. Thanks for adding wsprd_exp to the WSJT-X build script. Some time soon I think that we’ll want to just rename wsprd_exp to wsprd and have it replace the current decoder. Before we do that, Id like to see that at least a couple of people besides me have been able to use wsprd_exp without problems. Steve k9an 73's Greg, KI7MT On 06/24/2015 07:30 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x, I have placed a .pdf file containing information on the current status of the experimental two-pass decoder wsprd_exp at this link: https://dl.dropboxusercontent.com/u/33211132/signal_subtraction.pdf I have been running the two-pass decoder with wsjt-x and with my 8-channel gnuradio-based setup for the past several days without any problems. If you would like to play with the new decoder, the Makefile in the wsjt-x/lib/wsprd directory will compile it. For testing with wsjt-x, I renamed the executable wsprd and copied it into thewsjt-x install/bin directory. While testing this new decoder I used a batch of .wav files and also a separate batch of .c2 files that were written by the latest wsjt-x. I eventually realized that all of the .c2 files that were written by wsjt-x were contaminated by signal dropouts. See “Case 3” in the pdf document for an example and more details. After discovering the problem with the .c2 files, I saved a batch of .wav and .c2 files using wsjt-x and found that the .wav files were fine, but that the .c2 files were contaminated. This makes me wonder if the problem lies in the writec2 routine in wsjt-x. I welcome input/opinion on this from those who are more familiar with the code. Could this problem somehow be specific to my setup? Steve k9an -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
Re: [wsjt-devel] wspr two-pass decoder status and .c2 file problem
Hi Steve, Just so I am clear on this. The Makefile (Linux) has three targets, wsprd, wsprsim and wspr_exp. All we need to build is wspr_exp as the wsprd is being dealt with by Cmake yes? I'll be adding this to JTSDK Nix to build and cp the wspr_exp decoder to install/bin location on each turn. I had brief look at the Windows Makefile.MinGW but did not see the wsprd_exp target listed, so I am assuming this is only being tested on *Nix ?? 73's Greg, KI7MT On 06/24/2015 07:30 PM, Steven Franke wrote: For those testing wspr mode in wsjt-x, I have placed a .pdf file containing information on the current status of the experimental two-pass decoder wsprd_exp at this link: https://dl.dropboxusercontent.com/u/33211132/signal_subtraction.pdf I have been running the two-pass decoder with wsjt-x and with my 8-channel gnuradio-based setup for the past several days without any problems. If you would like to play with the new decoder, the Makefile in the wsjt-x/lib/wsprd directory will compile it. For testing with wsjt-x, I renamed the executable wsprd and copied it into the wsjt-x install/bin directory. While testing this new decoder I used a batch of .wav files and also a separate batch of .c2 files that were written by the latest wsjt-x. I eventually realized that all of the .c2 files that were written by wsjt-x were contaminated by signal dropouts. See “Case 3” in the pdf document for an example and more details. After discovering the problem with the .c2 files, I saved a batch of .wav and .c2 files using wsjt-x and found that the .wav files were fine, but that the .c2 files were contaminated. This makes me wonder if the problem lies in the writec2 routine in wsjt-x. I welcome input/opinion on this from those who are more familiar with the code. Could this problem somehow be specific to my setup? Steve k9an -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
[wsjt-devel] wspr two-pass decoder status and .c2 file problem
For those testing wspr mode in wsjt-x, I have placed a .pdf file containing information on the current status of the experimental two-pass decoder wsprd_exp at this link: https://dl.dropboxusercontent.com/u/33211132/signal_subtraction.pdf I have been running the two-pass decoder with wsjt-x and with my 8-channel gnuradio-based setup for the past several days without any problems. If you would like to play with the new decoder, the Makefile in the wsjt-x/lib/wsprd directory will compile it. For testing with wsjt-x, I renamed the executable wsprd and copied it into the wsjt-x install/bin directory. While testing this new decoder I used a batch of .wav files and also a separate batch of .c2 files that were written by the latest wsjt-x. I eventually realized that all of the .c2 files that were written by wsjt-x were contaminated by signal dropouts. See “Case 3” in the pdf document for an example and more details. After discovering the problem with the .c2 files, I saved a batch of .wav and .c2 files using wsjt-x and found that the .wav files were fine, but that the .c2 files were contaminated. This makes me wonder if the problem lies in the writec2 routine in wsjt-x. I welcome input/opinion on this from those who are more familiar with the code. Could this problem somehow be specific to my setup? Steve k9an -- Monitor 25 network devices or servers for free with OpManager! OpManager is web-based network management software that monitors network devices and physical virtual servers, alerts via email sms for fault. Monitor 25 devices for free with no restriction. Download now http://ad.doubleclick.net/ddm/clk/292181274;119417398;o ___ wsjt-devel mailing list wsjt-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/wsjt-devel
