Re: [sword-devel] HowTo: create ztext module?

2006-05-26 Thread Greg Hellings
DM, That seems to be the exact type of algorithm that David Cary was suggesting. It certainly does seem like it would have great potential, does it not? --Greg On 5/25/06, DM Smith <[EMAIL PROTECTED]> wrote: I'll reiterate my previous comment. The problem with many compression algorithms is t

Re: [sword-devel] HowTo: create ztext module?

2006-05-25 Thread DM Smith
I'll reiterate my previous comment. The problem with many compression algorithms is that they are adaptive, constantly changing the "dictionary" based upon what was previously seen and the current "window". The way to do the compression such that it can be applied to a verse at a time is

Re: [sword-devel] HowTo: create ztext module?

2006-05-25 Thread David Cary
Dear SWORD developers, From: L.Allan-pbio ... I can think of several reasons for rawtext (non-compressed): ... 2. Search speed can be significantly faster. ... That may be true for zText. However, other compression formats are faster to search than plain text. 3. It is easier to debug/ex

Re: [sword-devel] HowTo: create ztext module?

2006-05-10 Thread L.Allan-pbio
I've gotten a little further, but could use some more help. I'm trying to create a NT compressed module based on the rawtext Twenty Bible (smaller than a complete OT+NT Bible). The Twenty module works ok with sword.exe 1.5.8 rc1. (WinXp SP2) I created a file ztwenty.conf that has these conten

Re: [sword-devel] HowTo: create ztext module?

2006-05-10 Thread L.Allan-pbio
Thanks. I'll revise the earlier tutorial for module preparation to describe making a ztext compressed module. Later today, it should be at: http://lcdbible.sf.net/misc/CwModuleTutorial_060510e.doc http://lcdbible.sf.net/misc/CwModuleTutorial.doc (same file) and http://lcdbible.sf.net/misc/CwM

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread L.Allan-pbio
IIRC, Huffman encoding seems to produce an optimal compression. The basic idea is to build a trie with the shortest paths through the trie being the most frequent patterns. The algorithms that I saw did this on input assuming a single byte character encoding such as ASCII or Latin-1. It is readi

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread DM Smith
L.Allan-pbio wrote: While not simpler, there are ways to compress the files that don't use stream compression such that each verse can be handled independently. I'd be interested in how to do this, and still get decent compression. The basic, overly simplified technique is to build a mapping f

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread L.Allan-pbio
While not simpler, there are ways to compress the files that don't use stream compression such that each verse can be handled independently. I'd be interested in how to do this, and still get decent compression. My limited experience is that if you don't have a large block of data (book), then

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread L.Allan-pbio
DM Smith wrote: On May 8, 2006, at 8:36 PM, Greg Hellings wrote: This brings up another interesting question (in my opinion). Why are there several standard modules which are distributed without compression? Things like the the ASV, the Vulgate and the WEB are all distributed in uncompress

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread L.Allan-pbio
Greg Hellings wrote: This brings up another interesting question (in my opinion). Why are there several standard modules which are distributed without compression? Things like the the ASV, the Vulgate and the WEB are all distributed in uncompressed format. Might it be beneficial for us to

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread DM Smith
On May 8, 2006, at 8:36 PM, Greg Hellings wrote: This brings up another interesting question (in my opinion). Why are there several standard modules which are distributed without compression? Things like the the ASV, the Vulgate and the WEB are all distributed in uncompressed format. Might

Re: [sword-devel] HowTo: create ztext module?

2006-05-09 Thread Barry Drake
L.Allan-pbio wrote: What would the command line steps be to compress something like the WEB (currently rawtext)? Do you have to change the web.conf, and, if so, in what ways? I think your problem might be in the directory name - it must exist already. I generally create a directory off the S

Re: [sword-devel] HowTo: create ztext module?

2006-05-08 Thread Greg Hellings
Lynn On 5/8/06, L.Allan-pbio <[EMAIL PROTECTED]> wrote: Thanks for the hints. I build mod2zmod.exe and wrestled with it for a while, but didn't end up with anything that showed up in sword.exe 1.5.8 rc1. What would the command line steps be to compress something like the WEB (currently raw

Re: [sword-devel] HowTo: create ztext module?

2006-05-08 Thread L.Allan-pbio
Thanks for the hints. I build mod2zmod.exe and wrestled with it for a while, but didn't end up with anything that showed up in sword.exe 1.5.8 rc1. What would the command line steps be to compress something like the WEB (currently rawtext)? Do you have to change the web.conf, and, if so, in

Re: [sword-devel] HowTo: create ztext module?

2006-05-07 Thread Barry Drake
Hi Lynn . L.Allan-pbio wrote: I'd appreciate a hint or two on how to create ztext modules. It's really simple. You make a plaintext module and install it as a Sword module, then run the command line utility mod2zmod. This can make a compressed module either with or without a cipherke

[sword-devel] HowTo: create ztext module?

2006-05-07 Thread L.Allan-pbio
I'd appreciate a hint or two on how to create ztext modules. (Or a link to documentation or previous list post on this). I've been able to create plaintext modules for Bible texts, commentaries, devotionals, etc. that the rawtext driver can read, but I'm fuzzy how to create a ztext module that