Re: failing debootstrap

2017-02-02 Thread Yaroslav Halchenko

On Thu, 02 Feb 2017, John Paul Adrian Glaubitz wrote:

> On 02/02/2017 05:00 PM, Yaroslav Halchenko wrote:
> > any ideas on how to mitigate this problem would be most welcome!

> We did have some problems with LVM on sparc64, but I thought those
> were mitigated now, see [1].

> Did you try investigating the current LVM setup with lvscan?

isn't a problem somewhere "below" LVM level, since even partitions are not
visible (so no swap, which is not under LVM's control)?  or LVM somehow
could remove those partition drives?

For me I am just getting

# lvscan  --verbose
  ACTIVE'/dev/disks/debian' [127.34 GiB] inherit

BTW -- mdstat reports using entire (?) drives whenever only a partition on each
drive was given to md:

root@sparky:/home/yoh# pvdisplay 
  --- Physical volume ---
  PV Name   /dev/md0
  VG Name   disks
  PV Size   127.35 GiB / not usable 1.31 MiB
  Allocatable   yes (but full)
  PE Size   4.00 MiB
  Total PE  32600
  Free PE   0
  Allocated PE  32600
  PV UUID   kk1bpa-GzIa-J2dr-Rg3s-goiP-67p6-BoOzAV
   
root@sparky:/home/yoh# cat /proc/mdstat 
Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5] [raid4] 
[raid10] 
md0 : active raid1 sdb[1] sda[0]
  133530944 blocks super 1.2 [2/2] [UU]
  bitmap: 1/1 pages [8KB], 65536KB chunk

unused devices: 

root@sparky:/home/yoh# fdisk -l /dev/sda
Disk /dev/sda: 136.7 GiB, 146810536448 bytes, 286739329 sectors
Geometry: 255 heads, 63 sectors/track, 17848 cylinders
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: sun

Device Start   End   Sectors   Size Id Type  Flags
/dev/sda1  0 267193079 267193080 127.4G fd Linux raid autodetect  
/dev/sda2  267193080 269153009   1959930   957M  1 Boot   
/dev/sda3  0 286728119 286728120 136.7G  5 Whole disk 
/dev/sda4  269153010 286728119  17575110   8.4G 82 Linux swap 

-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik



Re: failing debootstrap

2017-02-02 Thread John Paul Adrian Glaubitz
On 02/02/2017 05:00 PM, Yaroslav Halchenko wrote:
> any ideas on how to mitigate this problem would be most welcome!

We did have some problems with LVM on sparc64, but I thought those
were mitigated now, see [1].

Did you try investigating the current LVM setup with lvscan?

Adrian

> [1] https://lists.debian.org/debian-sparc/2016/02/msg00022.html

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer - glaub...@debian.org
`. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
  `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913



Re: failing debootstrap

2017-02-02 Thread Yaroslav Halchenko

On Fri, 27 Jan 2017, Yaroslav Halchenko wrote:

>   I am enjoying partial success with installing sparc64 on ultrasparc T5140. 
> used installer cd from last may. interesting
>   glitch is that system when booted doesn't see any partitioning of the 
> drives -- only LVM volume for the / is available
>   this precludes enabling swaps and mounting /boot
>   here is how it looks:

> root@sparky:/tmp# fdisk -l /dev/sd[ab]
> Disk /dev/sda: 136.7 GiB, 146810536448 bytes, 286739329 sectors
> Geometry: 255 heads, 63 sectors/track, 17848 cylinders
> Units: sectors of 1 * 512 = 512 bytes
> Sector size (logical/physical): 512 bytes / 512 bytes
> I/O size (minimum/optimal): 512 bytes / 512 bytes
> Disklabel type: sun

> Device Start   End   Sectors   Size Id Type  Flags
> /dev/sda1  0 267193079 267193080 127.4G fd Linux raid autodetect  
> /dev/sda2  267193080 269153009   1959930   957M  1 Boot   
> /dev/sda3  0 286728119 286728120 136.7G  5 Whole disk 
> /dev/sda4  269153010 286728119  17575110   8.4G 82 Linux swap 
> >...<
> root@sparky:/tmp# ls -ld /dev/sd*
> brw-rw 1 root disk 8,  0 Jan 26 09:28 /dev/sda
> brw-rw 1 root disk 8, 16 Jan 26 09:28 /dev/sdb

> any clues how to mitigate or what is possibly wrong?

any ideas on how to mitigate this problem would be most welcome!

-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik



Re: failing debootstrap

2017-01-27 Thread Yaroslav Halchenko

On Mon, 23 Jan 2017, John Paul Adrian Glaubitz wrote:
> > So installation was completed ok and the beast rebooted but doesn't boot 
> > (see
> > below the transcript from the screen).  May be the reason is my obnoxious (I
> > guess I like that word that much to use twice) partitioning

> > 2 drives partitioned (RAID part + swap part) -> MD RAID1 -> LVM -> / (ext3)

> > So may be SILO just can't find/boot from such an abomination and I should 
> > have
> > created a small boot partition for it first?

> Exactly. As long as you're using SILO, your boot partition should be on a 
> plain
> and simple ext3 partition to avoid any issues.

> You can try to install grub2 from the "unreleased" repository manually during
> the installation by opening a shell from the debian-installer, chrooting into
> /target, running "apt update && apt install grub2". But I haven't tested this
> _at all_, so I can't tell if this works or not.

> However, any tests with the +sparc64 grub2 version from "unreleased" are 
> highly
> appreciated and welcome on the list.

I was weak -- having seen some discussions on the list with grub2 issues I just
went first old SILO way.  It was quite a bit painful to have drive
repartitioned since changes to the partitioning were not picked up by the
kernel unless I rebooted it and I was trying to split swap partition into boot
and swap two partitions.

And after installation succeeded and boot went on, the problem is as I
have reported on IRC:

  I am enjoying partial success with installing sparc64 on ultrasparc T5140. 
used installer cd from last may. interesting
  glitch is that system when booted doesn't see any partitioning of the drives 
-- only LVM volume for the / is available
  this precludes enabling swaps and mounting /boot
  here is how it looks:

root@sparky:/tmp# fdisk -l /dev/sd[ab]
Disk /dev/sda: 136.7 GiB, 146810536448 bytes, 286739329 sectors
Geometry: 255 heads, 63 sectors/track, 17848 cylinders
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: sun

Device Start   End   Sectors   Size Id Type  Flags
/dev/sda1  0 267193079 267193080 127.4G fd Linux raid autodetect  
/dev/sda2  267193080 269153009   1959930   957M  1 Boot   
/dev/sda3  0 286728119 286728120 136.7G  5 Whole disk 
/dev/sda4  269153010 286728119  17575110   8.4G 82 Linux swap 


Disk /dev/sdb: 136.7 GiB, 146810536448 bytes, 286739329 sectors
Geometry: 255 heads, 63 sectors/track, 17848 cylinders
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: sun

Device Start   End   Sectors   Size Id Type  Flags
/dev/sdb1  0 267193079 267193080 127.4G fd Linux raid autodetect  
/dev/sdb2  267193080 286728119  19535040   9.3G 82 Linux swap 
/dev/sdb3  0 286728119 286728120 136.7G  5 Whole disk 
root@sparky:/tmp# ls -l /dev/disk/by-uuid/
total 0
lrwxrwxrwx 1 root root  9 Jan 26 09:36 2016-05-04-14-13-13-00 -> ../../sr0
lrwxrwxrwx 1 root root 10 Jan 26 09:28 70cd7f29-78c4-4907-9101-ffdc2a7c8582 -> 
../../dm-0
root@sparky:/tmp# ls -l /dev/disk/by-id/
total 0
lrwxrwxrwx 1 root root 10 Jan 26 09:28 dm-name-disks-debian -> ../../dm-0
lrwxrwxrwx 1 root root 10 Jan 26 09:28 
dm-uuid-LVM-SHQBSSnkYpgqZEVBwqjrJHNngR3xnryCTemrrQ6v4auqKYt71XZcNsFm1YDGoP4b -> 
../../dm-0
lrwxrwxrwx 1 root root  9 Jan 26 09:28 
lvm-pv-uuid-kk1bpa-GzIa-J2dr-Rg3s-goiP-67p6-BoOzAV -> ../../md0
lrwxrwxrwx 1 root root  9 Jan 26 09:28 md-name-megaspark:0 -> ../../md0
lrwxrwxrwx 1 root root  9 Jan 26 09:28 
md-uuid-72005f8f:6bb79fc7:44b4d997:897c735a -> ../../md0
lrwxrwxrwx 1 root root  9 Jan 26 09:28 scsi-35000c5000f3e0453 -> ../../sda
lrwxrwxrwx 1 root root  9 Jan 26 09:28 scsi-35000c5000f3e9697 -> ../../sdb
lrwxrwxrwx 1 root root  9 Jan 26 09:36 
usb-TSSTcorp_CD_DVDW_TS-T632A_B030B0D6311A-0:0 -> ../../sr0
lrwxrwxrwx 1 root root  9 Jan 26 09:28 wwn-0x5000c5000f3e0453 -> ../../sda
lrwxrwxrwx 1 root root  9 Jan 26 09:28 wwn-0x5000c5000f3e9697 -> ../../sdb
root@sparky:/tmp# ls -ld /dev/sd*
brw-rw 1 root disk 8,  0 Jan 26 09:28 /dev/sda
brw-rw 1 root disk 8, 16 Jan 26 09:28 /dev/sdb


kernel: 4.5.0-2-sparc64-smp

any clues how to mitigate or what is possibly wrong?

PS please CC me in replies

-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik



Re: failing debootstrap

2017-01-23 Thread Yaroslav Halchenko

On Mon, 23 Jan 2017, John Paul Adrian Glaubitz wrote:
> > So installation was completed ok and the beast rebooted but doesn't boot 
> > (see
> > below the transcript from the screen).  May be the reason is my obnoxious (I
> > guess I like that word that much to use twice) partitioning

> > 2 drives partitioned (RAID part + swap part) -> MD RAID1 -> LVM -> / (ext3)

> > So may be SILO just can't find/boot from such an abomination and I should 
> > have
> > created a small boot partition for it first?

> Exactly. As long as you're using SILO, your boot partition should be on a 
> plain
> and simple ext3 partition to avoid any issues.

> You can try to install grub2 from the "unreleased" repository manually during
> the installation by opening a shell from the debian-installer, chrooting into
> /target, running "apt update && apt install grub2". But I haven't tested this
> _at all_, so I can't tell if this works or not.

> However, any tests with the +sparc64 grub2 version from "unreleased" are 
> highly
> appreciated and welcome on the list.

since I might end up just redoing the whole installation (to repartition
more or less sanely), I will give this one a shot first and report
back.  

Thanks!
-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik



Re: failing debootstrap

2017-01-23 Thread John Paul Adrian Glaubitz
On 01/23/2017 04:09 PM, Yaroslav Halchenko wrote:
> So installation was completed ok and the beast rebooted but doesn't boot (see
> below the transcript from the screen).  May be the reason is my obnoxious (I
> guess I like that word that much to use twice) partitioning
> 
> 2 drives partitioned (RAID part + swap part) -> MD RAID1 -> LVM -> / (ext3)
> 
> So may be SILO just can't find/boot from such an abomination and I should have
> created a small boot partition for it first?

Exactly. As long as you're using SILO, your boot partition should be on a plain
and simple ext3 partition to avoid any issues.

You can try to install grub2 from the "unreleased" repository manually during
the installation by opening a shell from the debian-installer, chrooting into
/target, running "apt update && apt install grub2". But I haven't tested this
_at all_, so I can't tell if this works or not.

However, any tests with the +sparc64 grub2 version from "unreleased" are highly
appreciated and welcome on the list.

Thanks,
Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer - glaub...@debian.org
`. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
  `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913



Re: failing debootstrap

2017-01-23 Thread Yaroslav Halchenko

On Wed, 18 Jan 2017, John Paul Adrian Glaubitz wrote:

> Hi Yaroslav!

> On 01/18/2017 04:09 AM, Yaroslav Halchenko wrote:
> > followed https://wiki.debian.org/Sparc64
> > and grabbed
> > https://people.debian.org/~glaubitz/debian-cd/2016-12-13/debian-9.0-sparc64-NETINST-1.iso
> > image.  After figuring out how to boot the beast off cd, went ahead with
> > partitioning (software raid, lvm, ext3) and install base system.  That
> > is the step which failed.  Log (4th screen) ends with:

> We have had multiple reports that there are issues with the latest images.

> Could you try this older image from May and report back?

> > https://people.debian.org/~glaubitz/debian-cd/2016-05-04/

Hi Adrian

and sorry for a delay with the reply.Here is a brief report/new problem 
statement ;)

I have burnt image from 2016/05/04 and proceeded through installation much
smoother than before:

- having basic dialog black and white interface without obnoxious redrawing the
  screen in ANSI coloring over serial comm was much more usable!!

- having said that I somewhat missed the use of "screen" which was present in
  the most recent installer -- so I had to go to menu item for shell to perform
  any of the items in the shell

- thanks to louis ayotte's feedback (off-list comm) I was ready to 

  - specify http://ftp.de.debian.org/debian-ports/ mirror whenever
installer just asked for some mirror to use
  - fetch newer keyring
https://packages.debian.org/sid/all/debian-keyring/download
and still had to fetch/apt-key add  the key  

So installation was completed ok and the beast rebooted but doesn't boot (see
below the transcript from the screen).  May be the reason is my obnoxious (I
guess I like that word that much to use twice) partitioning

2 drives partitioned (RAID part + swap part) -> MD RAID1 -> LVM -> / (ext3)

So may be SILO just can't find/boot from such an abomination and I should have
created a small boot partition for it first?



Captured in the terminal (screen session):

  ┌─┤ Finishing the installation ├──┐
  │ │
  │   95%   │
  │ │
The system is going down NOW!ystem...   │
Sent SIGTERM to all processes   │
Sent SIGKILL to all processes───┘
Requesting system reboot
[20848.293056] reboot: Restarting system

!!! LPe11000-M4 Fcode, Copyright (c) 2000-2007 Emulex !!!  Version 3.01a1


!!! LPe11000-M4 Fcode, Copyright (c) 2000-2007 Emulex !!!  Version 3.01a1



T5140, No Keyboard
Copyright (c) 1998, 2011, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.0.b, 48928 MB memory available, Serial #83064236.
Ethernet address 0:14:4f:f3:75:ac, Host ID: 84f375ac.



Boot device: disk  File and args:
The file just loaded does not appear to be executable.
{0} ok boot disk

!!! LPe11000-M4 Fcode, Copyright (c) 2000-2007 Emulex !!!  Version 3.01a1


!!! LPe11000-M4 Fcode, Copyright (c) 2000-2007 Emulex !!!  Version 3.01a1



T5140, No Keyboard
Copyright (c) 1998, 2011, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.33.0.b, 48928 MB memory available, Serial #83064236.
Ethernet address 0:14:4f:f3:75:ac, Host ID: 84f375ac.



Boot device: /pci@400/pci@0/pci@8/scsi@0/disk@0  File and args: 
The file just loaded does not appear to be executable.
{0} ok probe-scsi-all
This command may hang the system if a Stop-A or halt command
has been executed.  Please type reset-all to reset the system 
before executing this command. 
Do you wish to continue? (y/n) y
/pci@500/pci@0/pci@9/lpfc@0
Cannot Init Link.

/pci@400/pci@0/pci@c/lpfc@0
Cannot Init Link.

/pci@400/pci@0/pci@8/scsi@0

MPT Version 1.05, Firmware Version 1.27.00.00

Target 0 
Unit 0   Disk SEAGATE ST914602SSUN146G0603286739329 Blocks, 146 GB
  SASAddress 5000c5000f3e0451  PhyNum 0 
Target 3 
Unit 0   Disk SEAGATE ST914602SSUN146G0603286739329 Blocks, 146 GB
  SASAddress 5000c5000f3e9695  PhyNum 3 

/pci@400/pci@0/pci@1/pci@0/usb@0,2/storage@2
  Unit 0   Removable Read Only deviceTSSTcorpCD/DVDW TS-T632ASR03



-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik



Re: failing debootstrap

2017-01-17 Thread John Paul Adrian Glaubitz
Hi Yaroslav!

On 01/18/2017 04:09 AM, Yaroslav Halchenko wrote:
> followed https://wiki.debian.org/Sparc64
> and grabbed
> https://people.debian.org/~glaubitz/debian-cd/2016-12-13/debian-9.0-sparc64-NETINST-1.iso
> image.  After figuring out how to boot the beast off cd, went ahead with
> partitioning (software raid, lvm, ext3) and install base system.  That
> is the step which failed.  Log (4th screen) ends with:

We have had multiple reports that there are issues with the latest images.

Could you try this older image from May and report back?

> https://people.debian.org/~glaubitz/debian-cd/2016-05-04/

THanks,
Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer - glaub...@debian.org
`. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
  `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913



failing debootstrap

2017-01-17 Thread Yaroslav Halchenko
Hi Sparc gurus,

I finally got a "new" sparc box to replace passed away previous one some
SunFire IIRC, which I use for upstream CI on big-endians.
I have got now an UltraSparc T2 with 48GB of RAM -- whoohoo

followed https://wiki.debian.org/Sparc64
and grabbed
https://people.debian.org/~glaubitz/debian-cd/2016-12-13/debian-9.0-sparc64-NETINST-1.iso
image.  After figuring out how to boot the beast off cd, went ahead with
partitioning (software raid, lvm, ext3) and install base system.  That
is the step which failed.  Log (4th screen) ends with:

... 
Jan 18 02:50:20 main-menu[228]: (process:3771): /lib/partman/fstab.d/zfs:   
Jan 18 02:50:20 main-menu[228]: (process:3771): line 49:
Jan 18 02:50:20 main-menu[228]: (process:3771): zpool: not found
Jan 18 02:50:20 main-menu[228]: (process:3771): 
Jan 18 02:50:20 main-menu[228]: (process:3771): /bin/block-attr:
Jan 18 02:50:20 main-menu[228]: (process:3771): line 33:
Jan 18 02:50:20 main-menu[228]: (process:3771): blkid: not found
Jan 18 02:50:20 main-menu[228]: (process:3771): 
Jan 18 02:50:20 main-menu[228]: (process:3771): /bin/block-attr:
Jan 18 02:50:20 main-menu[228]: (process:3771): line 33:
Jan 18 02:50:20 main-menu[228]: (process:3771): blkid: not found
Jan 18 02:50:20 main-menu[228]: (process:3771): 
Jan 18 02:50:23 main-menu[228]: DEBUG: resolver (libgcc1): package doesn't 
exist (ignored) 
 
Jan 18 02:50:23 main-menu[228]: INFO: Falling back to the package description 
for brltty-udeb 
  
Jan 18 02:50:23 main-menu[228]: INFO: Falling back to the package description 
for brltty-udeb 
  
Jan 18 02:50:23 main-menu[228]: INFO: Menu item 'bootstrap-base' selected   
Jan 18 02:51:13 debootstrap: mknod: /target/dev/null: No such file or directory 


if you try to rerun installation of the base system, it fails in other
miserable ways:

Jan 18 03:08:55 debootstrap: tar: can't open 
'./usr/share/doc/gcc-6-base/README.Debian.sparc64.gz': File exists

any clues on how to overcome or recommendations on another  image/release
to use on the beast

Thanks in advance and please keep me CCed
-- 
Yaroslav O. Halchenko
Center for Open Neuroscience http://centerforopenneuroscience.org
Dartmouth College, 419 Moore Hall, Hinman Box 6207, Hanover, NH 03755
Phone: +1 (603) 646-9834   Fax: +1 (603) 646-1419
WWW:   http://www.linkedin.com/in/yarik