Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-16 Thread Jerome Shidel
Hi Darik, One more thing… The “workflow” for packages… I download, restructure, compile, etc. the software. It then gets staged in completely uncompressed package format as a project at https://gitlab.com/FDOS (The sub-groups & projects there will probable be

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-16 Thread Jerome Shidel
Hi Darik, Also... > On Nov 16, 2021, at 1:00 PM, Darik Horn wrote: > [..] > This bash script does the same thing. The file is also in the shared > folder in case the listserv mangles it here. I will submit PRs for > additional work now that I know about the Gitlab account. FYI, I still need

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-16 Thread Jerome Shidel
Hi Darik, > On Nov 16, 2021, at 1:01 PM, Darik Horn wrote: > > Jerome, > >> First, the new versions would need to be checked to ensure compatibility. >> They would probably be fine. But, testing would still need done. I honestly >> just done have the time for that at present. > > This work

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-16 Thread Darik Horn
Jerome, > First, the new versions would need to be checked to ensure compatibility. > They would probably be fine. But, testing would still need done. I honestly > just done have the time for that at present. This work is, in part, the result of doing coverage testing on the distribution. >

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-15 Thread Eric Auer
Hi Darik and Jerome, > * The 1.44 MB floppy set is reduced from eight to three diskettes. > * The 1.20 MB floppy set is reduced from ten to four diskettes. > * The 720 KB floppy set is reduced from fifteen to six diskettes. That is a huge difference and RAR is not overly exotic. I also would

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-15 Thread Jerome Shidel
Hi Darik, > On Nov 15, 2021, at 5:08 AM, Darik Horn wrote: > > Jerome, > >> If you can figure out how to get it to work, then it will be worth >> considering. > > It works. Updated builds are posted here: > >

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-15 Thread Jerome Shidel
Hi Darik, I appreciate the effort you put into creating a PowerShell script to repack the repository. However, I do not know if we are going to do that. First, the new versions would need to be checked to ensure compatibility. They would probably be fine. But, testing would still need done. I

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-15 Thread Darik Horn
Jerome, > If you can figure out how to get it to work, then it will be worth > considering. It works. Updated builds are posted here: https://drive.google.com/drive/folders/1b7IE-EsK5R1ROmXTaEvYNi9-kfVvH5wi?usp=sharing * The 1.44 MB floppy set is reduced from eight to three diskettes. * The

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-15 Thread Darik Horn
Jerome, This PowerShell script generates the optimization that I want as an end-user on the 'freedos/files/repositories/latest' tree. Only 7Z.exe is used because 7-Zip 19.00 and AdvZip 2.1 generate outputs that are nearly identical for a full repack. # FDREPACK.PS1: FreeDOS repository repacking

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Jerome Shidel
Hi Darik, I did not read every entry in that list of files. But there were a couple things I noticed while skimming it… Those files are in the mirrors section of the ibiblio server. They don’t really have anything directly to do with the packages in the software repo area. Nor do they have

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Darik Horn
Eric, > Please describe that "normalizing" process which makes > the source codes inside the distro packages behave like a > solid archive. Look at a FreeDOS package like 'latest/apps/doszip.zip' and notice the embedded SOURCE/SOURCES.ZIP file. Every package with long file names in upstream

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Jerome Shidel
Hi Eric, > On Nov 11, 2021, at 4:13 PM, E. Auer wrote: > >  > Hi! Please describe that "normalizing" process which makes > the source codes inside the distro packages behave like a > solid archive. If you remove them from the ZIP and add a > TAR of the sources to the ZIP instead, you would

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread E. Auer
Hi! Please describe that "normalizing" process which makes the source codes inside the distro packages behave like a solid archive. If you remove them from the ZIP and add a TAR of the sources to the ZIP instead, you would get that type of result, but it would mean that the install process will

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Jerome Shidel
Hi Darik, > On Nov 11, 2021, at 1:56 PM, Darik Horn wrote: > [..] > RAR implements the PKZIP listfile syntax, so the SETUP.BAT invocation > would change to this; > > SET TCPU=8086 > REM vinfo stuff goes here... > unrar x freedos.rar @%TCPU%.txt > > Where the @LISTFILE corresponds to a

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Darik Horn
Jerome, > I’m not sure what version of UnRAR you are using. I used these two upstream releases to repack the latest FreeDOS 1.3 release candidate: 1. ftp://ftp.rarlab.com/rar/rar250.exe for decompression. FreeDOS ships the 16-bit UnRAR 2.50 binary from this release, and the IDOS.SFX module

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Rugxulo
Hi, On Thu, Nov 11, 2021 at 5:05 AM Jerome Shidel wrote: > > On Nov 11, 2021, at 12:12 AM, Darik Horn wrote: > > The UnRAR in FreeDOS is 32,086 bytes and already implements all of the things > that you want for SCLICER, which is currently 28,188 bytes. > (Compression, installation scripting,

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Jerome Shidel
Hi Travis, > On Nov 11, 2021, at 10:37 AM, Travis Siegel wrote: > > I have never used slicer, so can't comment on it. > I wouldn’t expect you to use it. In almost every case, there are other utilities that are in common use. And/or, better suited to a task. Slicer was created specifically

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Travis Siegel
I have never used slicer, so can't comment on it.  However, I have used rar for years, and I've never found a task it can't be made to do with proper command line parameters.  If you only want a specific file extracted, it's easy enough to tell it to use that file only, (or a range of files if

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-11 Thread Jerome Shidel
Hi Darik, > On Nov 11, 2021, at 12:12 AM, Darik Horn wrote: > [..] > SLICER is small. Less than 1/10th the size of RAR. While, this does not > matter as much for a 1.44mb diskette. It matters a lot if a user only has a > 160K drive to work with. With RAR being roughly 353K, that is not going

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-10 Thread Darik Horn
Eric, I suggest a much shorter algorithm: Simply apply > advzip with the "recompress" option to the ZIP > files :-) If you do this on freedos/files/repositories/latest today, then you'll get: 2,586,758,742 bytes, original total ZIP size 2,535,458,056 bytes, after `advzip -k -p -z -3 `

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-10 Thread Darik Horn
Jerome, Recompression is something that will be considered for the next version of > the repository management utilities. > Your insight is appreciated. I saw the earlier discussion about media size and wanted to point out that there are savings available now at nearly zero cost. SLICER is

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-09 Thread E. Auer
Hi Jerome and Darik, 1. Unzip each FDN package. 2. Further unpack each ZIP and 7Z source file. 3. Zip+Store each SOURCES/* tree like it has LFN. 4. Rezip each FDN package like usual. 5. Optimize each package with AdvanceCOMP. I suggest a much shorter algorithm: Simply apply advzip

Re: [Freedos-user] ISO repack reduces size by 10%

2021-11-09 Thread Jerome Shidel
Hi Darik, > On Nov 8, 2021, at 6:55 PM, Darik Horn wrote: > > Hi all, > > The FreeDOS repo ISO file that was published today can be reduced from 632MB > to 579MB by repacking it. This adds 53MB of media headroom, which should > reduce pressure to bump packages in future point releases. Just

[Freedos-user] ISO repack reduces size by 10%

2021-11-08 Thread Darik Horn
Hi all, The FreeDOS repo ISO file that was published today can be reduced from 632MB to 579MB by repacking it. This adds 53MB of media headroom, which should reduce pressure to bump packages in future point releases. Original (as of 2021-11-08):