Re: [wsjt-devel] WSPR decoder: Jelinek vs Fano

2015-07-30 Thread Steven Franke
Joe,
Here are my results for your data set. I ran 3 cases. The execution times are 
the average of two runs.

Cases
1. wsprd 
2. wsprd_exp (Fano, 1 cycles)
3. wsprd_exp (Jelinek, 5000 cycles)

Results
1. 2657 (2) decodes in 359s
2. 2760 (13) decodes in 359s
3. 2749 (3) decodes in 346s

The interesting part is the number in parentheses. This time, I paid attention 
to the number of obviously bad decodes. It’s not easy to find the bad decodes 
that show up as type 1 callsigns - but it is easy to find and count the ones 
that show up as type 2 or 3 callsigns with a forward slash “/“. The number in 
parentheses is the number of bad decodes with a slash in the callsign. It needs 
to be said that we see only the bad decodes that aren’t trapped by a sanity 
check in the unpacking routines.

There is something funny going on with the Fano decoder in case 2. Here is the 
result of doing a grep for “/“ in the ALL_WSPR results from the three cases:

Case 1. wsprd
$ grep / Results_wsprd
0342 -28 0.5 0.001523 0 PH6/OK1SCE 10
0630 -14 -0.8 0.001518 0 M0N/BX6IJG 30

Case 2. wsprd_exp Fano
$ grep / Results_Fano.txt
0114 -16 -0.3 0.001524 0 88Y/9E3XMR 33
0148 -22 -0.9 0.001523 0 C4S/U23 27
0512 -12 -1.4 0.001544 -1 EYJ/BD3OWF 43
0526 -5 -1.1 0.001515 -1 J28/JH9VOA 10
0530 -10 -1.3 0.001527 -1 XIR/L12IRI 57
0534 -21 0.1 0.001451 0 5EY/588TIB 53
0540 -9 -1.3 0.001498 -1 286/CI7RCI 13
0614 -8 -1.2 0.001523 -1 W64/CZ9IYO 13
0616 -31 -1.0 0.001491 0 M2Q/ZG4VPX 13
0704 -10 -1.3 0.001550 -1 KN4OHP/44 53
0746 -8 -1.4 0.001525 -1 ATD/012KCR 27
0856 -19 -0.8 0.001523 0 I02/VK3PNP 20
1400 -17 -0.5 0.001459 0 P2INE/2 53

Case 3. wsprd_exp Jelinek
$ grep / Results_Jelinek5000.txt
0114 -16 -0.3 0.001524 0 88Y/9E3XMR 33
0616 -31 -1.0 0.001491 0 M2Q/ZG4VPX 13
0654 -12 -1.3 0.001523 -1 1LY/GH4 40

Note the large number of bad decodes coming out of the Fano decoder in case 2. 
There is only one bad decode that is common to cases 2 and 3. If you look at 
the times, it appears that the bad decodes in case 2 are coming in bursts. I 
have to wonder if this corresponds to special noise conditions, e.g. lightning 
storm.

It’s hard to reconcile the large difference in bad decodes between pairs 1-2 
and 2-3. In 1-2 the decoding algorithm is the same and in 2-3 the candidates 
are the same.  Strange, eh?  

I’ve just gone back and looked at bad decodes using the same “forward-slash” 
criterion on two groups of my own wav files and in each case I see either 2 or 
3 bad decodes out of about 2000 for Fano and Jelinek. There are no big 
differences between the number of bad decodes in cases 1-3 for my test data. 
Still strange.

Steve k9an

> On Jul 30, 2015, at 8:01 AM, Joe Taylor  wrote:
> 
> Hi Greg,
> 
> I have updated Makefile.win32 in ^/branches/wsjtx so that it builds 
> Steve's new wsprd_exp.exe correctly.
> 
> I have made a tarfile with the set of WSPR *.wav files I used most 
> recently.  It is now posted at
> 
> http://physics.princeton.edu/pulsar/K1JT/wspr_data.tgz
> 
> It's about 1 GB in size.
> 
>   -- Joe, K1JT
> 
> On 7/29/2015 11:52 PM, KI7MT wrote:
>> Hi Steve, Joe,
>> 
>> I hit another show stopper error also. I'll look at what Joe is using in
>> ^/branches/wsjtx_exp and see what the diff's are from the main devel
>> branch.
>> 
>> By chance, do you all have a standard set of WSPR .wav files that your
>> using to compare with? Would be nice to be able to use a standard set
>> for testing.
>> 
>> 73's
>> Greg, KI7MT
>> 
>> 
>> 
>> On 07/29/2015 07:36 PM, Steven Franke wrote:
>>> Greg -
>>> The windows Makefile has not been updated for the stack decoder. I’ve only 
>>> tested it on linux and osx. It looks like the Makefile in Joe’s 
>>> experimental branch is close to what would be needed - though it shouldn’t 
>>> need the extended stacksize anymore since we moved the big arrays to heap 
>>> storage.
>>> Steve k9an
>>> 
 On Jul 29, 2015, at 1:22 AM, Greg Beam  wrote:
 
 Hi Joe, Steve,
 
 This is off list.
 
 I tried to build wsprd_exp on Windows (using Qt 5.2.1 Tool-Chain, not the 
 5.5 Tool-Chain) and ran into an error. I'm using 
 ^/branches/wsjtx/lib/wsprd folder, and Makefile.win32, is that the correct 
 location and Makefile file?
 
 Here's the error I'm getting:
 -
 wsprd_exp.o:wsprd_exp.c:(.text.startup+0x244c): undefined reference to 
 `jelinek'
 collect2.exe: error: ld returned 1 exit status
 Makefile.win32:34: recipe for target 'wsprd_exp' failed
 mingw32-make: *** [wsprd_exp] Error 1
 
 
 Any Ideas?
 
 73's
 Greg, KI7MT
 
 
 
 On 7/28/2015 1:49 PM, Steven Franke wrote:
> Hi Greg and Joe,
> 
> As Joe said, the stack decoder is only in wsprd_exp and it requires a 
> command-line argument (-J) to activate it, as the default algorithm in 
> wsprd_exp is the Fano algorithm.
> 
> The tests conducted by me and Joe show that my implementation of 
> Jelinek’s stack-bucket alg

Re: [wsjt-devel] JTSDK Nix v2.0.12 Available

2015-07-30 Thread Greg Beam
Hi ALan,

Ah, ok, that's good to know.

Maybe a change in Makefile.in should be made. I've not specifically 
tested changing ownership to just $USER, rather than both $USER:$USER ( 
user and group).

I'll do some testing on that for the next update. To make sure I've got 
your edits correct, can you send me a quick patch between the orig, and 
modified Makefile and / or Makefile.in ?

Thanks.

73's
Greg, KI7MT

On 7/30/2015 4:01 PM, Alan VK2ZIW wrote:
> Hi Greg,
>
> Fedora 21 x86_64
>
> "./autogen.sh" ran fine.
>
> "make" failed:
>
> Package : JTSDK 2.0.12
> /bin/sh: -c: line 0: syntax error near unexpected token `('
> /bin/sh: -c: line 0: `echo " Distribution ..: "Fedora release 21
> (Twenty One)" x86_64"'
> Makefile:96: recipe for target 'make-summary' failed
> make: *** [make-summary] Error 1
>
> So I changed DESC in Makefile, removed "()".
>
> Running "make install" failed:
> ..Changing /home/alanb/jtsdk Ownership to: [ alanb ]
> /usr/bin/chown: invalid group: ‘alanb:alanb’
> Makefile:116: recipe for target 'install' failed
> make: *** [install] Error 1
>
> ---
> My system does not have a group named "alanb",
> this is up to the sys-admin.
>
> Thanks
>
> Alan VK2ZIW
>
>
>
>
>
> On Thu, 30 Jul 2015 14:52:07 -0600, KI7MT wrote
>> Hi Pino,
>>
>> Thanks for catching the URL Typo:
>>
>> Correct SVN TAGS URL for jtsdk-nix-2.0.12:
>>
>> svn co https://svn.code.sf.net/p/jtsdk/jtsdk/jtsdk-nix/tags/jtsdk-
>> nix-2.0.12
>>
>> 73's
>> Greg, KI7MT
>>
>> --
>> ___
>> wsjt-devel mailing list
>> wsjt-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/wsjt-devel
>
>
> Alan
>
> Man's greatest waste of time: Worshipping the wrong God.
> Consider Jesus.
> ---
> Alan Beard   Unix Support Technician from 1984 to today
> 70 Wedmore Rd.   Sun Solaris, AIX, HP/UX, Linux, SCO, MIPS
> Emu Heights N.S.W. 2750  Routers, terminal servers, printers, terminals etc..
> +61 2 47353013 (h)   Support Programming, shell scripting, "C", assembler
> 0414 353013 (mobile) After uni, electronics tech
>

--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


Re: [wsjt-devel] JTSDK Nix v2.0.12 Available

2015-07-30 Thread Alan VK2ZIW
Hi Greg,

Fedora 21 x86_64

"./autogen.sh" ran fine.

"make" failed:

Package : JTSDK 2.0.12
/bin/sh: -c: line 0: syntax error near unexpected token `('
/bin/sh: -c: line 0: `echo " Distribution ..: "Fedora release 21
(Twenty One)" x86_64"'
Makefile:96: recipe for target 'make-summary' failed
make: *** [make-summary] Error 1

So I changed DESC in Makefile, removed "()".

Running "make install" failed:
..Changing /home/alanb/jtsdk Ownership to: [ alanb ]
/usr/bin/chown: invalid group: ‘alanb:alanb’
Makefile:116: recipe for target 'install' failed
make: *** [install] Error 1

---
My system does not have a group named "alanb",
this is up to the sys-admin.
 
Thanks

Alan VK2ZIW





On Thu, 30 Jul 2015 14:52:07 -0600, KI7MT wrote
> Hi Pino,
> 
> Thanks for catching the URL Typo:
> 
> Correct SVN TAGS URL for jtsdk-nix-2.0.12:
> 
> svn co https://svn.code.sf.net/p/jtsdk/jtsdk/jtsdk-nix/tags/jtsdk-
> nix-2.0.12
> 
> 73's
> Greg, KI7MT
> 
> --
> ___
> wsjt-devel mailing list
> wsjt-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/wsjt-devel


Alan

Man's greatest waste of time: Worshipping the wrong God.
Consider Jesus.
---
Alan Beard   Unix Support Technician from 1984 to today
70 Wedmore Rd.   Sun Solaris, AIX, HP/UX, Linux, SCO, MIPS
Emu Heights N.S.W. 2750  Routers, terminal servers, printers, terminals etc..
+61 2 47353013 (h)   Support Programming, shell scripting, "C", assembler
0414 353013 (mobile) After uni, electronics tech


--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


[wsjt-devel] JTSDK Win32 - Planned Upgrades

2015-07-30 Thread KI7MT
Hello All,

Following Bill's ( G4WJS ) message to the development list regarding
Qt5.5 / GCC 4.9 tool chain testing:

OP: http://sourceforge.net/p/wsjt/mailman/message/34322744/

I've updated the the WSJT-X + Hamlib3 build scripts in JTSDK Win32 to
allow for testing ( switching between ) QT5.5 / GCC 4.9 and Qt5.2 / GCC
4.8 frame works.

The upgrade will require two actions:

1. Updating JTSDK Scripts ( Start Menu or JTSDK Maintenance terminal )
2. Installing jtsdk-win32-u2.exe ( InnoSetup Installer )

At present, Sourceforge is still restoring various developer services,
the files download section being one of them. ETA JUL-31st.

Once the files section is restored, I can then add the U2 installer so
folks to download it. This is a fairly hefty file ~600MG compressed,
requiring ~4GB install space, as it's a full QT55, GCC Mingw 4.9 and
QtCreator installation.

Operating the switch if fairly simple - ( Note, this will not function
properly until the U2 installer has been run, but should not affect
builds using the Qt5.2 / GCC 4.8 )

* Open JTSDK-QT
* Type: qt55-enable
* Close and Then re-open JTSDK-QT

That should set the Qt5.5 and MinGW 4.9 tool chain as the default tool
set. You should see, on the opening screen, messages indicating  which
tool-chain / QT framework is active.

To switch back to the Qt5.2 / GCC 4.8 tool-chain:
* Open JTSDK-QT
* Type: qt55-disable
* Close and Then re-open JTSDK-QT

The build, install and package directories are all separate from the
standard locations, including Hamlib3, suffixed with "-qt55", for example:


When Disabled: ( using Qt5.2 / GCC 4.8 ):
C:\JTSDK\wsjtx\{build,install,package .. .. ..}
C:\JTSDK\hamlib3\{bin,include,lib .. .. ..}


When Enabled: ( using Qt5.5 / GCC 4.9 )::

C:\JTSDK\wsjtx-qt55\{build,install,package .. .. ..}
C:\JTSDK\hamlib3-qt55\{bin,include,lib .. .. ..}


The source directories, for both WSJTX and Hamlib3 remain as is:

C:\JTSDk\src\ .. .. ..


All build commands remain as is:

* checkout-wsjtx
* build-wsjtx rinstall

and so on.

Before building WSJT-X, using the QT5.5 / GCC 4.9 tool-chain, remember
to build Hamlib3 first, otherwise, you will likely get a Cmake fault
during the configuration phase stating Hamlib3 cannot be found.

Additionally, QT5.5 was built with MSVC-2013 as opposed to MSVC-2010 for
Qt5.2. As such, if you do not have the MSVC 2013 Redist DLL's installed,
which "may be" required for proper runtime testing, you will need to
install them. Not too worry, the Qt55 installation bundles the correct
Redist-Instller. You will find find the Redist-Installer located in:

C:\JTSDK\qt55\redist

or similar location. Simply running the installer should get you what is
needed.


When the jtsdk-win32-u2.exe installer is available from Sourceforge, I
will send out additional information on how-to perform the upgrade and
installation for JTSDK Win32.


73's
Greg, KI7MT

--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


Re: [wsjt-devel] JTSDK Nix v2.0.12 Available

2015-07-30 Thread KI7MT
Hi Pino,

Thanks for catching the URL Typo:

Correct SVN TAGS URL for jtsdk-nix-2.0.12:

svn co https://svn.code.sf.net/p/jtsdk/jtsdk/jtsdk-nix/tags/jtsdk-nix-2.0.12


73's
Greg, KI7MT

--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


[wsjt-devel] JTSDK Nix v2.0.12 Available

2015-07-30 Thread Pino Zollo


El 30/07/15 a las 16:17, wsjt-devel-requ...@lists.sourceforge.net escribió:
> *DEBIAN/UBUNTU UPGRADE INSTRUCTIONS*
> 
> * Supported ARCH: i386, amd64 and ARMv7
> * Open a terminal, then
> * sudo apt-get update && sudo apt-get upgrade
> 
> 
> * SOURCE BUILD UPGRADE INSTRUCTIONS*
> * Open a terminal, then
> * svn co https://svn.code.sf.net/p/jtsdk/jtsdk/tags/jtsdk-nix-2.0.12
> * cd jtsdk-nix-2.0.12
> * ./autogen.sh && make && sudo make install && sudo -k
> 
> NOTE: The Sourceforge file downloading area is current undergoing
> maintenance. ETA is End of Day JUL-31st. At which point, a tar.gz file
> will be made available for JTSDK v2.0.12. Until this time, using the
> tags section of the svn repos should suffice.
> 
> 
> 73's
> Greg, KI7MT


svn co https://svn.code.sf.net/p/jtsdk/jtsdk/tags/jtsdk-nix-2.0.12
svn: E17: El URL
«https://svn.code.sf.net/p/jtsdk/jtsdk/tags/jtsdk-nix-2.0.12» no existe
pino@Radio3:~$

URL does not exist :-(

73

Pino ZP4KFX

--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


[wsjt-devel] JTSDK Nix v2.0.12 Available

2015-07-30 Thread KI7MT
Hello All,

Thanks to Tom (N8TL) and others for sending in issues reports and
testing fixes.


*CHANGE-LOG*
-Fixed various $USER path issues with configure, make, make install
-Fixed path issue in jtsdk-wspr which cased the script to error out
-Fixed / Added KVASD link function with messaging
-Added WSJT-X v1.6.0-devel branch Superbuild script
-Updated On-Screen Messages
-Re-Activated WSJT-X v1.6.1 builds ( WSJT-X EXP builds )
-De-Activated WSJT-X RC Builds as there are no pending releases
-Ubuntu 14.10 ( Utopic ) is now EOL. Updates are no longer available.


*SUPERBUILD-NOTES*
The WSJT-X Superbuild from Bill ( G4WJS ) is a new feature addition to
JTSDK. It's been in the SVN repo for some time, but just now being added
to JTSDK Nix. Superbuild is also used to produce the wsjtx.tgz files
used in compiling the WSJTX-NEXT PPA. Basically, it will perform the
following tasks ( all from the SVN repositories ):

* Downloads WSJT-X v1.6.0 ( ^/branches/wsjtx ) & Hamlib3 sources
* Create a single tar.gz file ready for compiling or transfer
* Configures and Builds WSJT-X using the downloaded Hamlib3 sources
* Install WSJT-X v1.6.0 to the user space for testing
* All build and install locations are separated from the normal v1.6.0
build and install paths

*SUPERBUILD-INFO*
Link:
http://sourceforge.net/p/wsjt/wsjt/HEAD/tree/branches/wsjtx-superbuild/


*DEBIAN/UBUNTU UPGRADE INSTRUCTIONS*

* Supported ARCH: i386, amd64 and ARMv7
* Open a terminal, then
* sudo apt-get update && sudo apt-get upgrade


* SOURCE BUILD UPGRADE INSTRUCTIONS*
* Open a terminal, then
* svn co https://svn.code.sf.net/p/jtsdk/jtsdk/tags/jtsdk-nix-2.0.12
* cd jtsdk-nix-2.0.12
* ./autogen.sh && make && sudo make install && sudo -k

NOTE: The Sourceforge file downloading area is current undergoing
maintenance. ETA is End of Day JUL-31st. At which point, a tar.gz file
will be made available for JTSDK v2.0.12. Until this time, using the
tags section of the svn repos should suffice.


73's
Greg, KI7MT

--
___
wsjt-devel mailing list
wsjt-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wsjt-devel


Re: [wsjt-devel] WSPR decoder: Jelinek vs Fano

2015-07-30 Thread KI7MT
Hi Joe,

Thanks. I'm downloading the data now and will do some test runs later
this evening.

73's
Greg, KI7MT


On 07/30/2015 07:01 AM, Joe Taylor wrote:
> Hi Greg,
> 
> I have updated Makefile.win32 in ^/branches/wsjtx so that it builds 
> Steve's new wsprd_exp.exe correctly.
> 
> I have made a tarfile with the set of WSPR *.wav files I used most 
> recently.  It is now posted at
> 
> http://physics.princeton.edu/pulsar/K1JT/wspr_data.tgz
> 
> It's about 1 GB in size.
> 
>   -- Joe, K1JT
> 
> On 7/29/2015 11:52 PM, KI7MT wrote:
>> Hi Steve, Joe,
>>
>> I hit another show stopper error also. I'll look at what Joe is using in
>> ^/branches/wsjtx_exp and see what the diff's are from the main devel
>> branch.
>>
>> By chance, do you all have a standard set of WSPR .wav files that your
>> using to compare with? Would be nice to be able to use a standard set
>> for testing.
>>
>> 73's
>> Greg, KI7MT
>>
>>
>>
>> On 07/29/2015 07:36 PM, Steven Franke wrote:
>>> Greg -
>>> The windows Makefile has not been updated for the stack decoder. I’ve only 
>>> tested it on linux and osx. It looks like the Makefile in Joe’s 
>>> experimental branch is close to what would be needed - though it shouldn’t 
>>> need the extended stacksize anymore since we moved the big arrays to heap 
>>> storage.
>>> Steve k9an
>>>
 On Jul 29, 2015, at 1:22 AM, Greg Beam  wrote:

 Hi Joe, Steve,

 This is off list.

 I tried to build wsprd_exp on Windows (using Qt 5.2.1 Tool-Chain, not the 
 5.5 Tool-Chain) and ran into an error. I'm using 
 ^/branches/wsjtx/lib/wsprd folder, and Makefile.win32, is that the correct 
 location and Makefile file?

 Here's the error I'm getting:
 -
 wsprd_exp.o:wsprd_exp.c:(.text.startup+0x244c): undefined reference to 
 `jelinek'
 collect2.exe: error: ld returned 1 exit status
 Makefile.win32:34: recipe for target 'wsprd_exp' failed
 mingw32-make: *** [wsprd_exp] Error 1
 

 Any Ideas?

 73's
 Greg, KI7MT



 On 7/28/2015 1:49 PM, Steven Franke wrote:
> Hi Greg and Joe,
>
> As Joe said, the stack decoder is only in wsprd_exp and it requires a 
> command-line argument (-J) to activate it, as the default algorithm in 
> wsprd_exp is the Fano algorithm.
>
> The tests conducted by me and Joe show that my implementation of 
> Jelinek’s stack-bucket algorithm doesn’t seem to provide any significant 
> advantage over the Fano decoder in the wspr application. I am still 
> inclined to replace the current wsprd with the Fano version of wsprd_exp. 
> All of my tests indicate that the default configuration of wsprd_exp 
> produces more decodes in less time than wsprd does. This is due to 
> improvements in the sync algorithm and not due to anything related to the 
> sequential decoder. However --- when Joe compared wsprd to wsprd_exp 
> (Fano) he didn’t find any significant difference between the two. If you 
> decide to do some tests, Greg, it’d be interesting to see if you see any 
> difference between wsprd and wsprd_exp (with the default settings).
>
> Steve
>
>> On Jul 28, 2015, at 2:22 PM, Joe Taylor  wrote:
>>
>> Hi Greg,
>>
>> The experimental ("Jelinek") decoder is currently being built only as
>> wsprd_exp.
>>  -- Joe
>>
>> On 7/28/2015 3:08 PM, Greg Beam wrote:
>>> Hi Joe, Steve,
>>>
>>> Are these updates in the main wsprd binary, or do we still need to build
>>> the wsprd_exp binary and copy it over to wsprd to test the changes?
>>>
>>> 73's
>>> Greg, KI7MT
>>>
>>> On 7/28/2015 12:22 PM, Joe Taylor wrote:
 Hi Steve,

 Nice job with implementation of a sequential decoder using the Jelinek
 Stack Algorithm!

 I have now run some reasonably thorough tests of it, comparing results
 with the default Fano decoder in wsprd. I confirm essentially all of
 your basic conclusions.  Jelinek with maxcycles=5000 produces nearly 
 the
 same results, in the same execution time, as Fano with maxcycles=1.

 In my tests the command-line "-d" option produced about 7-8% more
 decodes, at the cost of roughly 5 x longer execution time.  Again, this
 was true for both Fano and Jelinek.

 Now we know... which is good!

-- Joe, K1JT

 --
 ___
 wsjt-devel mailing list
 wsjt-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/wsjt-devel
>>>
>>> --
>>> ___
>>> wsjt-devel mailing list

Re: [wsjt-devel] WSPR decoder: Jelinek vs Fano

2015-07-30 Thread Joe Taylor
Hi Greg,

I have updated Makefile.win32 in ^/branches/wsjtx so that it builds 
Steve's new wsprd_exp.exe correctly.

I have made a tarfile with the set of WSPR *.wav files I used most 
recently.  It is now posted at

http://physics.princeton.edu/pulsar/K1JT/wspr_data.tgz

It's about 1 GB in size.

-- Joe, K1JT

On 7/29/2015 11:52 PM, KI7MT wrote:
> Hi Steve, Joe,
>
> I hit another show stopper error also. I'll look at what Joe is using in
> ^/branches/wsjtx_exp and see what the diff's are from the main devel
> branch.
>
> By chance, do you all have a standard set of WSPR .wav files that your
> using to compare with? Would be nice to be able to use a standard set
> for testing.
>
> 73's
> Greg, KI7MT
>
>
>
> On 07/29/2015 07:36 PM, Steven Franke wrote:
>> Greg -
>> The windows Makefile has not been updated for the stack decoder. I’ve only 
>> tested it on linux and osx. It looks like the Makefile in Joe’s experimental 
>> branch is close to what would be needed - though it shouldn’t need the 
>> extended stacksize anymore since we moved the big arrays to heap storage.
>> Steve k9an
>>
>>> On Jul 29, 2015, at 1:22 AM, Greg Beam  wrote:
>>>
>>> Hi Joe, Steve,
>>>
>>> This is off list.
>>>
>>> I tried to build wsprd_exp on Windows (using Qt 5.2.1 Tool-Chain, not the 
>>> 5.5 Tool-Chain) and ran into an error. I'm using ^/branches/wsjtx/lib/wsprd 
>>> folder, and Makefile.win32, is that the correct location and Makefile file?
>>>
>>> Here's the error I'm getting:
>>> -
>>> wsprd_exp.o:wsprd_exp.c:(.text.startup+0x244c): undefined reference to 
>>> `jelinek'
>>> collect2.exe: error: ld returned 1 exit status
>>> Makefile.win32:34: recipe for target 'wsprd_exp' failed
>>> mingw32-make: *** [wsprd_exp] Error 1
>>> 
>>>
>>> Any Ideas?
>>>
>>> 73's
>>> Greg, KI7MT
>>>
>>>
>>>
>>> On 7/28/2015 1:49 PM, Steven Franke wrote:
 Hi Greg and Joe,

 As Joe said, the stack decoder is only in wsprd_exp and it requires a 
 command-line argument (-J) to activate it, as the default algorithm in 
 wsprd_exp is the Fano algorithm.

 The tests conducted by me and Joe show that my implementation of Jelinek’s 
 stack-bucket algorithm doesn’t seem to provide any significant advantage 
 over the Fano decoder in the wspr application. I am still inclined to 
 replace the current wsprd with the Fano version of wsprd_exp. All of my 
 tests indicate that the default configuration of wsprd_exp produces more 
 decodes in less time than wsprd does. This is due to improvements in the 
 sync algorithm and not due to anything related to the sequential decoder. 
 However --- when Joe compared wsprd to wsprd_exp (Fano) he didn’t find any 
 significant difference between the two. If you decide to do some tests, 
 Greg, it’d be interesting to see if you see any difference between wsprd 
 and wsprd_exp (with the default settings).

 Steve

> On Jul 28, 2015, at 2:22 PM, Joe Taylor  wrote:
>
> Hi Greg,
>
> The experimental ("Jelinek") decoder is currently being built only as
> wsprd_exp.
>   -- Joe
>
> On 7/28/2015 3:08 PM, Greg Beam wrote:
>> Hi Joe, Steve,
>>
>> Are these updates in the main wsprd binary, or do we still need to build
>> the wsprd_exp binary and copy it over to wsprd to test the changes?
>>
>> 73's
>> Greg, KI7MT
>>
>> On 7/28/2015 12:22 PM, Joe Taylor wrote:
>>> Hi Steve,
>>>
>>> Nice job with implementation of a sequential decoder using the Jelinek
>>> Stack Algorithm!
>>>
>>> I have now run some reasonably thorough tests of it, comparing results
>>> with the default Fano decoder in wsprd. I confirm essentially all of
>>> your basic conclusions.  Jelinek with maxcycles=5000 produces nearly the
>>> same results, in the same execution time, as Fano with maxcycles=1.
>>>
>>> In my tests the command-line "-d" option produced about 7-8% more
>>> decodes, at the cost of roughly 5 x longer execution time.  Again, this
>>> was true for both Fano and Jelinek.
>>>
>>> Now we know... which is good!
>>>
>>> -- Joe, K1JT
>>>
>>> --
>>> ___
>>> wsjt-devel mailing list
>>> wsjt-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/wsjt-devel
>>
>> --
>> ___
>> wsjt-devel mailing list
>> wsjt-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/wsjt-devel
> --
> ___
> wsjt-devel mailing list
> wsjt-devel@lists.sourceforge.net
> http

Re: [wsjt-devel] UDP messages dropped

2015-07-30 Thread Michael Black
Well..by "busy" I mean he's got only 2 idle cores when running.  The other 6
are not pegged at all but run 25-50% or so.
73
Mike W9MDB

-Original Message-
From: KI7MT [mailto:ki...@yahoo.com] 
Sent: Wednesday, July 29, 2015 11:26 PM
To: WSJT software development
Subject: Re: [wsjt-devel] UDP messages dropped

I wouldn't think the box is loaded to hard with an 8350 engine, those have a
bit of pep to them, unless he's go allot of background tasking going on.

Way OT here, but:  I've had a pile of the AMD FX Black edition CPU's at one
point, and still have a couple in the basement running as servers.
Early models were not too good, but the 8-Series seems ok.

My next build is going to be on a Tyan or Supermicro motherboard, with at
least 2x 6-Series Opteron's, like the 6344's or there about would be nice..
I'd like a 4-hole motherboard, but that can get expensive in a hurry :-)

73's
Greg, KI7MT

On 07/29/2015 09:48 PM, Michael Black wrote:
> Ran some tests and confirmed WSJT-X was sending out all packets.
> Interesting that when we used multicast no packets got dropped 
> ever.only when using unicast localhost.
> 
>  
> 
> Laurie said JTAlert only has a 128 byte buffer so that may explain the 
> problem.  He's aware now and hopefully we'll have a fix soon.
> 
>  
> 
> I have to write a test program for my friend as his system appears to 
> be single-threading WSJT-X.  He's running a Flex 3000 so his 8-core 
> system is still pretty busy but the JT9 decodes have a noticeable 
> delay after the JT65 and are all bunched together.
> 
> So I'll create a program to test how many cores his system reports.  
> Is an AMD 8350 CPU.
> 
>  
> 
> 73
> 
> Mike W9MDB
> 
>  
> 
> From: Bill Somerville [mailto:g4...@classdesign.com]
> Sent: Wednesday, July 29, 2015 10:30 AM
> To: wsjt-devel@lists.sourceforge.net
> Subject: Re: [wsjt-devel] UDP messages dropped
> 
>  
> 
> On 29/07/2015 16:19, Michael Black wrote:
> Hi Mike,
> 
> Actually just tested and looks like JTAlert is doing multicast too.  
> So I'll see about tracking this with him.
> 
> That can't be so if you cannot change the server address, multicast 
> will only work with a multicast group address as it requires 
> cooperation from the NIC and any routers in the network path.
> 
> Beware of running multiple servers on the same host without multicast 
> addressing, in that case each datagram will only be delivered to one 
> application and appear dropped to the other(s).
> 
> 
> 
> I watched his system for a while and didn't see interspersed JT9's but 
> I'll watch close next time.
> 
> Gotta' get some activity on the bands to see this I think.  I'll watch 
> my own system but can't say I've noticed this (and not sure I would 
> have either since I wasn't looking for it).
> 
> Was really obvious on his systems since he doesn't have many JT9's and 
> they were all missing from JTAlert.
> 
>  
> 
> I'm not sure of the underlying logic which causes UDP reordering.  I 
> went through an argument with a banking software firm many years ago 
> having to inform them that TCP wasn't a guaranteed protocol which they 
> though it was and they were blaming our software for dropping 
> transactions when it wasn't our fault at all and they finally had to 
> add another layer of ACK/NAK to the transactions to ensure end-to-end
integrity even over dropped connections.
> 
> UDP reordering usually requires a complex network of routers (the 
> Internet
> usually) it can happen if a router fails, has to retry or, decides a 
> lower cost path is possible. Not really relevant to our application 
> although WSJT-X doesn't make any assumptions about where on the 
> Internet the UDP server lives.
> 
> 
> 
>  
> 
> Thanks and I'll let you know the results.
> 
>  
> 
> 73
> 
> Mike W9MDB
> 
> 73
> Bill
> G4WJS.
> 
> 
> 
>  
> 
> From: Bill Somerville [mailto:g4...@classdesign.com]
> Sent: Wednesday, July 29, 2015 10:08 AM
> To: wsjt-devel@lists.sourceforge.net
> Subject: Re: [wsjt-devel] UDP messages dropped
> 
>  
> 
> On 29/07/2015 15:58, Michael Black wrote:
> Hi Mike,
> 
> Actually he's running a Flex 3000 and an 8-core machine.
> 
> Interesting, is it possible he has set CPU affinity. Maybe it was just 
> that all the JT9 decodes took longer than the longest JT65 decode but 
> that is fairly unusual.
> 
> 
> 
> 
> JTAlert doesn't currently allow setting the IP address so it's not 
> multi-cast.  I'll see if about getting that done though.
> 
> It's not quite as simple as setting the address, a multicast server 
> has to join the group as well.
> 
> 
> 
> 
> Side-by-side is good idea.
> 
> And a sequence number does take a step towards TCP but is still not a 
> bad idea so you can at least detect dropped packets.  People could be 
> using this now and not know they are missing decodes.
> 
> Datagrams can also be delivered out of order so it gets complicated fast.
> Anyway on a loopback connector neither out of order delivery nor 
> dropped datagrams should happen unless the re