Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-06-28 Thread Steve McIntyre
On Wed, Jun 23, 2010 at 03:42:19PM +0200, Goswin von Brederlow wrote:
Steve McIntyre st...@einval.com writes:

 On Thu, May 27, 2010 at 03:17:08PM +0100, Steve McIntyre wrote:
On Sat, May 22, 2010 at 06:58:52PM +0200, Petter Reinholdtsen wrote:

I've added code into debian-cd to generate images with firmware on the
first CD. Add FORCE_FIRMWARE=1 in CONF.sh. I've also tweaked the
build scripts so that we'll start generating them. I can see that I've
got all the firmware debs in /firmware in the ISO, but I don't see any
feedback to suggest that the installer is picking up on them. Test
images available at

I haven't tested it but just from this short text you seem to be doing
it wrong.

Thanks for that helpful feedback.

From memory you should add the debs to the normal repository structure
on the CD under non-free and in the Release file specify that the CD
carries main and non-free. Iirc you also need to list non-free in the DI
info file but I'm not sure. Last time I did this was by hand and when
lenny was frozen.

DI then sees that you have both main and non-free on the CD and reads
main/binary-arch/Packages and non-free/binary-arch/Packages and sees all
the firmware debs (same for udebs).

Try reading up-thread to see what Petter has implemented...?

-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
Google-bait:   http://www.debian.org/CD/free-linux-cd
  Debian does NOT ship free CDs. Please do NOT contact the mailing
  lists asking us to send them to you.


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100628212422.gd4...@einval.com



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-06-23 Thread Goswin von Brederlow
Steve McIntyre st...@einval.com writes:

 On Thu, May 27, 2010 at 03:17:08PM +0100, Steve McIntyre wrote:
On Sat, May 22, 2010 at 06:58:52PM +0200, Petter Reinholdtsen wrote:

I've added code into debian-cd to generate images with firmware on the
first CD. Add FORCE_FIRMWARE=1 in CONF.sh. I've also tweaked the
build scripts so that we'll start generating them. I can see that I've
got all the firmware debs in /firmware in the ISO, but I don't see any
feedback to suggest that the installer is picking up on them. Test
images available at

I haven't tested it but just from this short text you seem to be doing
it wrong.

From memory you should add the debs to the normal repository structure
on the CD under non-free and in the Release file specify that the CD
carries main and non-free. Iirc you also need to list non-free in the DI
info file but I'm not sure. Last time I did this was by hand and when
lenny was frozen.

DI then sees that you have both main and non-free on the CD and reads
main/binary-arch/Packages and non-free/binary-arch/Packages and sees all
the firmware debs (same for udebs).

MfG
Goswin


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/874ogteuh0@frosties.localdomain



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-06-14 Thread Steve McIntyre
Stefano wrote:
On Wed, Jun 09, 2010 at 01:16:27PM +0100, Steve McIntyre wrote:
...
 http://cdimage.debian.org/cdimage/daily-builds/sid_d-i/20100527-7/i386/iso-cd/firmware-testing-i386-netinst.iso

I used it to install a IBM/Lenovo ThinkPad R52 with Intel Wireless card and
anything went right. I'll open an bug report with the installation report
as soon I'll be back from holiday.

Cool, thanks.

  * how to describe them in the README on the disc. For now I've added:
 
This disc includes non-free firmware files to make installation
 easier on some systems. See http://wiki.debian.org/Firmware for
 more details.

I think it should be better: This disc includes non-free firmware to 
make installation easier on systems requiring proprietary but 
redistributable firmware. See http://wiki.debian.org/Firmware for more
 details.  

Sounds good, taken. :-)

-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
Because heaters aren't purple! -- Catherine Pitt


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/e1oohbo-ei...@jack.mossbank.org.uk



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-06-10 Thread Alexander Reichle-Schmehl
Hi!

* Steve McIntyre st...@einval.com [100609 14:16]:

  * how to describe them in the README on the disc. For now I've added:
 
This disc includes non-free firmware files to make installation
 easier on some systems. See http://wiki.debian.org/Firmware for
 more details.
 
but I'm open to suggestions for something better.
 No responses yet. Anyone???

Sounds okay to me.


Best Regards,
  Alexander


signature.asc
Description: Digital signature


Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-06-09 Thread Steve McIntyre
On Thu, May 27, 2010 at 03:17:08PM +0100, Steve McIntyre wrote:
On Sat, May 22, 2010 at 06:58:52PM +0200, Petter Reinholdtsen wrote:

I've added code into debian-cd to generate images with firmware on the
first CD. Add FORCE_FIRMWARE=1 in CONF.sh. I've also tweaked the
build scripts so that we'll start generating them. I can see that I've
got all the firmware debs in /firmware in the ISO, but I don't see any
feedback to suggest that the installer is picking up on them. Test
images available at

http://cdimage.debian.org/cdimage/daily-builds/sid_d-i/20100527-7/i386/iso-cd/firmware-testing-i386-netinst.iso
http://cdimage.debian.org/cdimage/daily-builds/sid_d-i/20100527-7/amd64/iso-cd/firmware-testing-amd64-netinst.iso

in case anybody else wants to help testing them. I've still got a
couple more things to decide about these new firmware-included images
even once we've got these working:

 * where exactly to put them on cdimage (for now they're alongside the
   normal images)

 * how to describe them in the README on the disc. For now I've added:

   This disc includes non-free firmware files to make installation
easier on some systems. See http://wiki.debian.org/Firmware for
more details.

   but I'm open to suggestions for something better.

No responses yet. Anyone???

-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
...In the UNIX world, people tend to interpret `non-technical user'
 as meaning someone who's only ever written one device driver. -- Daniel Pead


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100609121627.gb6...@einval.com



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-05-27 Thread Steve McIntyre
On Sat, May 22, 2010 at 06:58:52PM +0200, Petter Reinholdtsen wrote:

Today I had a look at this issue, and tested a bit.  A new package was
just uploaded to unstable with the changes I believe we need in Debian
Edu.

I changed the hw-detect code that take care of the firmware loading,
to see if the .deb file include a preinst, and run it if it exist.
With the firmware-ipw2x00 package, the license question was displayed
as it should and answering now causes the firmware package to be
removed from d-i and the firmware not to be used.

To allow firmware to be found also when it is on the installation CD
or DVD, I added code to look in /cdrom/firmware/ for firmware (u)debs.
It will not accept loose firmware files in this location, only
packages.  To test it, build your own CD with the firmware .debs
symlinked from /firmware/ to /pool/.

To allow firmware to be found when booting via PXE, it will also look
in /firmware/ for (u)debs.  To test this feature, the PXE initrd need
to be repacked with the wanted firmware packages stored in /firmware/.

If the firmware is in a .deb package, the same package will also be
installed in /target/, and if preseeding of the license is allowed,
the license question will not show up again (this is the case for
firmware-ipw2x00).  If preseeding isn't allowed, I believe dpkg will
try to show the license again (and fail, because debconf forwarding is
not set up in that part of the code).  I guess we should solve that
problem if we run into firmware .debs which do not allow preseeding. :)

Give it a try, and let me know if it work for you. :)

I've added code into debian-cd to generate images with firmware on the
first CD. Add FORCE_FIRMWARE=1 in CONF.sh. I've also tweaked the
build scripts so that we'll start generating them. I can see that I've
got all the firmware debs in /firmware in the ISO, but I don't see any
feedback to suggest that the installer is picking up on them. Test
images available at

http://cdimage.debian.org/cdimage/daily-builds/sid_d-i/20100527-7/i386/iso-cd/firmware-testing-i386-netinst.iso
http://cdimage.debian.org/cdimage/daily-builds/sid_d-i/20100527-7/amd64/iso-cd/firmware-testing-amd64-netinst.iso

in case anybody else wants to help testing them. I've still got a
couple more things to decide about these new firmware-included images
even once we've got these working:

 * where exactly to put them on cdimage (for now they're alongside the
   normal images)

 * how to describe them in the README on the disc. For now I've added:

   This disc includes non-free firmware files to make installation
easier on some systems. See http://wiki.debian.org/Firmware for
more details.

   but I'm open to suggestions for something better.

Cheers,
-- 
Steve McIntyre, Cambridge, UK.st...@einval.com
You raise the blade, you make the change... You re-arrange me 'til I'm sane...


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100527141708.ga27...@einval.com



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-05-22 Thread Petter Reinholdtsen

Today I had a look at this issue, and tested a bit.  A new package was
just uploaded to unstable with the changes I believe we need in Debian
Edu.

I changed the hw-detect code that take care of the firmware loading,
to see if the .deb file include a preinst, and run it if it exist.
With the firmware-ipw2x00 package, the license question was displayed
as it should and answering now causes the firmware package to be
removed from d-i and the firmware not to be used.

To allow firmware to be found also when it is on the installation CD
or DVD, I added code to look in /cdrom/firmware/ for firmware (u)debs.
It will not accept loose firmware files in this location, only
packages.  To test it, build your own CD with the firmware .debs
symlinked from /firmware/ to /pool/.

To allow firmware to be found when booting via PXE, it will also look
in /firmware/ for (u)debs.  To test this feature, the PXE initrd need
to be repacked with the wanted firmware packages stored in /firmware/.

If the firmware is in a .deb package, the same package will also be
installed in /target/, and if preseeding of the license is allowed,
the license question will not show up again (this is the case for
firmware-ipw2x00).  If preseeding isn't allowed, I believe dpkg will
try to show the license again (and fail, because debconf forwarding is
not set up in that part of the code).  I guess we should solve that
problem if we run into firmware .debs which do not allow preseeding. :)

Give it a try, and let me know if it work for you. :)

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/2flpr0n27qr@login1.uio.no



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Petter Reinholdtsen
[Petter Reinholdtsen]
 Yesterday, I figured out a workaround for this, and I wanted to
 share the solution with the rest of you, and ask if perhaps the
 default behaviour of debian-cd or d-i (hw-detect) should change to
 make this workaround unneeded.

Further testing of this fix proved that it is insufficient.  hw-detect
call check-missing-firmware, which look on several devices (disk, USB
sticks, floppies) for firmware, but fail to look on the CD itself.
This, I must admit, is very sad.  I had a look at the source of
check-missing-firmware and saw it was looking in the firmware/
directory of several devices, and assumed it would also check the boot
media, but no. :(

Should hw-detect also look for firmware on the CD?

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100316104634.ga4...@login1.uio.no



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Holger Levsen
Hi,

On Dienstag, 16. März 2010, Frans Pop wrote:
 An additional issue with non-free firmware is that including it in the way
 you propose would (I think) mean it will get loaded without any prompting
 of the user, which may in some cases violate licence terms.

i thought the same at first, but actually that's not the case. The user is 
still asked (by the package) if she wants to accept the licence. (As no 
preseeding takes place.)

So there is only the issue of having the firmwares accessable in the first 
place, which should be preseeded/preseedable just like using non-free.


cheers,
Holger

P.S.: should this be moved to a proper bug?


signature.asc
Description: This is a digitally signed message part.


Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Petter Reinholdtsen
[Frans Pop]
 I think the problem with that is that including the firmware on the
 CD in the first place is in contradiction with Debian's current
 policy not to include firmware in the distribution.  The current
 firmware support is very explicitly limited to support loading from
 external media *prepared by the user*.

Well, the use case I am working on would be identical for a user who
prepared a CD or DVD, so I believe it should work the same way with
CDs and USB sticks. :)

 An additional issue with non-free firmware is that including it in
 the way you propose would (I think) mean it will get loaded without
 any prompting of the user, which may in some cases violate licence
 terms.

Perhaps.  I have not gotten to a point where I can test what happen.
I believe the .deb will be installed normally into /target/ and
display the license question at that point, but do not know yet. :)

 I can see that others may want to do things differently, but I'm not
 sure how much we can/should support that in standard D-I
 functionality.

I'm working on a patch for hw-detect.

 One option you have is to implement a custom, alternative version of
 'mountmedia' for d-edu.

Actually, something causes main-menu to crash if I adjust mountmedia
to return CD devices too, so I suspect it is better to adjust
check-missing-firmware to also look in /cdrom/firmware/ for debs.
This is the approach I am testing at the moment.

Anyone know how the PXE installation can be adjusted to load firmware
automatically from the .debs?  I want servers with network cards
needing firmware to work with PXE installation. :)

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100316114835.gc4...@login1.uio.no



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Frans Pop
On Tuesday 16 March 2010, Holger Levsen wrote:
 On Dienstag, 16. März 2010, Frans Pop wrote:
  An additional issue with non-free firmware is that including it in the
  way you propose would (I think) mean it will get loaded without any
  prompting of the user, which may in some cases violate licence terms.

 i thought the same at first, but actually that's not the case. The user
 is still asked (by the package) if she wants to accept the licence. (As
 no preseeding takes place.)

But that's only at the point where the package gets installed in the target 
system. And at that point the firmware is already in use.

IMO a proper solution would ensure the licence dialog gets displayed before 
the firmware first gets loaded by the installer.


--
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201003161350.45073.elen...@planet.nl



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Frans Pop
On Tuesday 16 March 2010, Petter Reinholdtsen wrote:
 Actually, something causes main-menu to crash if I adjust mountmedia
 to return CD devices too, so I suspect it is better to adjust
 check-missing-firmware to also look in /cdrom/firmware/ for debs.

Probably because the CD is already mounted and in use and mountmedia messes 
that up?


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201003161352.30877.elen...@planet.nl



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Petter Reinholdtsen
[Holger Levsen]
 P.S.: should this be moved to a proper bug?

Yes.  Patch for hw-detect submitted in #574116.

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100316124952.ge4...@login1.uio.no



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-16 Thread Joey Hess
Frans Pop wrote:
 On Tuesday 16 March 2010, Holger Levsen wrote:
  On Dienstag, 16. März 2010, Frans Pop wrote:
   An additional issue with non-free firmware is that including it in the
   way you propose would (I think) mean it will get loaded without any
   prompting of the user, which may in some cases violate licence terms.
 
  i thought the same at first, but actually that's not the case. The user
  is still asked (by the package) if she wants to accept the licence. (As
  no preseeding takes place.)
 
 But that's only at the point where the package gets installed in the target 
 system. And at that point the firmware is already in use.

I checked, and the assumption that the firmware deb's debconf prompt is
displayed seems to be untrue:

hw-detect.post-base-installer.d/50install-firmware:
for deb in /var/cache/firmware/*.deb; do
if [ -f $deb ]; then
cp -a $deb /target/tmp
# TODO debconf passthrough
if ! in-target dpkg -i /tmp/$(basename $deb); then
# dpkg failed, force removal of package
in-target dpkg --force-depends --remove 
$(deb_package $deb) || true
fi

in-target does not provide debconf passthrough, and apt-install cannot
be used here.

To use debconf passthrough here would require ripping the passthrough setup
code out of debconf-apt-progress, It might be more expedient to make a
pkgsel hook that uses apt-install to re-download and install the firmware
debs.

-- 
see shy jo


signature.asc
Description: Digital signature


Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-15 Thread Petter Reinholdtsen
[Joey Hess]
 That source package does not contain all available firmware, FWIW.
 You're missing at least zd1211-firmware and
 atmel-firmware. debian-cd has a list in tasks/firmware.

Btw, tasks/firmware refer to the non-existing package
firmware-ipw3945.  Did it change name, go away or is it planned
introduced in the future?

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100315065237.gp11...@login2.uio.no



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-15 Thread Frans Pop
On Monday 15 March 2010, Petter Reinholdtsen wrote:
  That source package does not contain all available firmware, FWIW.
  You're missing at least zd1211-firmware and
  atmel-firmware. debian-cd has a list in tasks/firmware.

 Btw, tasks/firmware refer to the non-existing package
 firmware-ipw3945.  Did it change name, go away or is it planned
 introduced in the future?

The answer to that question is simple enough to find with either a quick 
look at packages.d.o, or simply:
$ rmadison firmware-ipw3945
firmware-ipw3945 |0.4 | etch-m68k/non-free | all
firmware-ipw3945 | 0.4+etchnhalf.1 | oldstable/non-free | all

The firmware task should probably be made release-specific...


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201003150834.41461.elen...@planet.nl



Re: Getting d-i to find firmware on the CD generated by debian-cd

2010-03-14 Thread Petter Reinholdtsen
[Joey Hess]
 The problem with making hw-detect look in pool/ is that it does not know
 what debs contain firmware. It assumes there will not be too many debs
 in the places it looks, and so it examines them all, unpacking them to
 find ones that contain the firmware files. If it also looked in pool/,
 it would unpack every deb on the CD, which would be horribly slow.

Right.  Perhaps hw-detect should be told?  A mechanism like the ones
used by iceweasel plugins, adding information to the packages, might
work.  For example the gnash plugin contain this info:

  Xb-Npp-Applications: 
ec8030f7-c20a-464f-9b0e-13a3a9e97384,92650c4d-4b8e-4d2a-b7eb-24ecf4f6b63a,aa5ca914-c309-495d-91cf-3141bbb04115
  Xb-Npp-MimeType: application/x-shockwave-flash
  Xb-Npp-Name: Gnash SWF Player

Why not add the name of the firmware file included in the deb using a
similar mechanism, and teach hw-detect to search for it?


 That source package does not contain all available firmware, FWIW.
 You're missing at least zd1211-firmware and
 atmel-firmware. debian-cd has a list in tasks/firmware.

Thank you.  I'll try to make sure we include the complete list on the
Debian Edu CD and DVD. :)

Happy hacking,
-- 
Petter Reinholdtsen


-- 
To UNSUBSCRIBE, email to debian-cd-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/20100314210147.go11...@login2.uio.no