Re: ClefOS setting up guest LAN for HiperSockets
Cornelia - thank you for your reply. I am working from the Redbook: Virtualization Cookbook ... Volume 1 and am finding typos in it. In this case the cio_ignore command was botched up and included in the description before a set of steps to configure hipersockets on RH. it should have been step number 1. So, I can report partial success, i now have hipersocket network up and the guests can ping each other. But it is deathly slow - nothing hiper about it. Here are the tuning 'knobs' that i am aware of: [1] MTU size my LAN is set up with 64K: DEFINE LAN ZVTSMLAN OWNERID SYSTEM TYPE HIPER IP MFS 64K and the guest has a NICDEF to match: NICDEF 0204 TYPE HIPER DEVICES 3 LAN SYSTEM ZVTSMLAN oddly, when i look at the network connections on linux, it shows the MTU as 57344 (?): # ip a . . . 3: enccw0.0.0204: mtu 57344 qdisc pfifo_fast state UP group default qlen 1000 link/ether 02:00:00:00:00:5f brd ff:ff:ff:ff:ff:ff inet 192.0.1.32/24 brd 192.0.1.255 scope global noprefixroute enccw0.0.0204 valid_lft forever preferred_lft forever [2] QIOASSIST setting i have QIOASSIST ON system wide and have set in on specifically for the two guests i am testing with - Z4 is a VSE guest, LNXADMIN is ClefOS 7.4 guest: q qioassist z4 ALL USERS SET - ON USER SETTING STATUS Z4ONACTIVE Ready; T=0.01/0.01 09:37:01 q qioassist lnxadmin ALL USERS SET - ON USER SETTING STATUS LNXADMIN ONACTIVE [3] networking buffers should i mess with changing buffers on ClefOS ? (i read somewhere that the default was change from 16 to 128) # lsqeth enccw0.0.0204 Device name : enccw0.0.0204 - card_type: GuestLAN: SYSTEM ZVTSMLAN (Type: HIPERS) cdev0: 0.0.0204 cdev1: 0.0.0205 cdev2: 0.0.0206 chpid: 01 online : 1 portname : no portname required portno : 0 route4 : no route6 : no state: UP (LAN ONLINE) priority_queueing: always queue 2 fake_broadcast : 0 buffer_count : 128 layer2 : 0 isolation: none sniffer : 0 Are there other tuning knobs? How can I figure out why this connection is slow? -- Phillip Gramly Systems Programmer Communications Data Group Champaign, Illinois On Mon, 2018-07-16 at 03:27 -0500, Cornelia Huck wrote: > I'm seconding the suggestion of using chzdev, but some additional > notes > from me: -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For more information on Linux on System z, visit http://wiki.linuxvm.org/
Re: ClefOS setting up guest LAN for HiperSockets
On Fri, 13 Jul 2018 14:38:44 -0500 Phillip Gramly wrote: I'm seconding the suggestion of using chzdev, but some additional notes from me: > # vmcp q v 204-206 > OSA 0204 ON NIC 0204 UNIT 000 SUBCHANNEL = 0001 > 0204 DEVTYPE HIPER VIRTUAL CHPID 01 IQD > 0204 MAC 02-00-00-00-00-46 CURRENT > 0204 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE > OSA 0205 ON NIC 0204 UNIT 001 SUBCHANNEL = 0002 > 0205 DEVTYPE HIPER VIRTUAL CHPID 01 IQD > 0205 MAC 02-00-00-00-00-46 CURRENT > 0205 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE > OSA 0206 ON NIC 0204 UNIT 002 SUBCHANNEL = 0003 > 0206 DEVTYPE HIPER VIRTUAL CHPID 01 IQD > 0206 MAC 02-00-00-00-00-46 CURRENT > 0206 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE > > # lscss --all > IO Subchannels and Devices: > Device Subchan. DevType CU Type Use PIM PAM POM CHPIDs > -- > 0.0.0100 0.0. 9336/10 6310/80 yes 80 80 ff 2d00 > 0.0.0009 0.0.0004 /00 3215/00 yes 80 80 ff 0100 > 0.0.0600 0.0.000c 1732/01 1731/01 yes 80 80 ff 0200 > 0.0.0601 0.0.000d 1732/01 1731/01 yes 80 80 ff 0200 > 0.0.0602 0.0.000e 1732/01 1731/01 yes 80 80 ff 0200 > 0.0.0300 0.0.000f 9336/10 6310/80 yes 80 80 ff 0100 > 0.0.0301 0.0.0010 9336/10 6310/80 yes 80 80 ff 0100 If you don't see the devices in lscss, the reason is often that they are on the ignore list (many distributions default to using cio_ignore to ignore every device but the ones explicitly configured). Use 'cio_ignore -l' to display the ranges of ignored devices. You need to un-ignore your devices to make them visible (try 'cio_ignore -r 0.0.0204-0.0.0206'). > > # echo 0.0.204,0.0.205,0.0.206 > /sys/bus/ccwgroup/drivers/qeth/group > -bash: echo: write error: Invalid argument You cannot group devices that don't show up in lscss. But even more importantly, the IDs always are of the format 0.m. (so you'd need to use 0.0.0204 instead of 0.0.204). Background: the IDs are not integers, but strings, so they need to match exactly. -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For more information on Linux on System z, visit http://wiki.linuxvm.org/
Re: ClefOS setting up guest LAN for HiperSockets
The chzdev command also simplifies things. It's part of s390utils-base. On 7/14/18, 06:38, "Linux on 390 Port on behalf of R P Herrold" wrote: On Fri, 13 Jul 2018, Phillip Gramly wrote: > # echo 0.0.204,0.0.205,0.0.206 > /sys/bus/ccwgroup/drivers/qeth/group > -bash: echo: write error: Invalid argument > > I'm missing something somewhere. can anybody help me? Hi, Phillip, Thanks for using ClefOS 1. This is just my OCD talking, but I would 'protect' that echo, as a matter of defensive coding echo "0.0.204,0.0.205,0.0.206" > \ /sys/bus/ccwgroup/drivers/qeth/group I know, I know -- OCD 2. What is shown with: # ls -l /sys/bus/ccwgroup/drivers/qeth/ I get this locally: [root@lclef01 ~]# ls -l /sys/bus/ccwgroup/drivers/qeth/ total 0 lrwxrwxrwx. 1 root root0 Jul 9 16:23 0.0.0340 -> \ ../../../../devices/qeth/0.0.0340 --w---. 1 root root 4096 Jul 13 16:28 bind --w---. 1 root root 4096 Jul 9 16:23 group lrwxrwxrwx. 1 root root0 Jul 13 16:28 module -> \ ../../../../module/qeth --w---. 1 root root 4096 Jul 9 16:23 uevent --w---. 1 root root 4096 Jul 13 16:28 unbind This is pointing up into: /sys/ and particularly I see there: [root@lclef01 ~]# ls /sys/devices/qeth/ 0.0.0340 module power uevent [ I have indicated the line wrap with backslashes, although of course not really there ] The parallels on my settings for completeness: [root@lclef01 ~]# vmcp q v 0340-0342 OSA 0340 ON NIC 0340 UNIT 000 SUBCHANNEL = 0340 DEVTYPE OSA VIRTUAL CHPID 13 OSD 0340 MAC 02-00-10-00-00-6D CURRENT 0340 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE OSA 0341 ON NIC 0340 UNIT 001 SUBCHANNEL = 0001 0341 DEVTYPE OSA VIRTUAL CHPID 13 OSD 0341 MAC 02-00-10-00-00-6D CURRENT 0341 QDIO-ELIGIBLE QIOASSIST-ELIGIBLE OSA 0342 ON NIC 0340 UNIT 002 SUBCHANNEL = 0002 0342 DEVTYPE OSA VIRTUAL CHPID 13 OSD 0342 MAC 02-00-10-00-00-6D CURRENT 0342 QDIO ACTIVE QIOASSIST-ELIGIBLE 0342 0342 INP + 01 IOCNT = 00598184 ADP = 055 PROG = 000 UNAVAIL = 073 0342 BYTES = 05B90B44 0342 OUT + 01 IOCNT = ADP = 000 PROG = 000 UNAVAIL = 128 0342 BYTES = 0342 OUT + 02 IOCNT = ADP = 000 PROG = 000 UNAVAIL = 128 0342 BYTES = 0342 OUT + 03 IOCNT = 00037157 ADP = 000 PROG = 128 UNAVAIL = 000 0342 BYTES = 006BFE58 0342 OUT + 04 IOCNT = ADP = 000 PROG = 000 UNAVAIL = 128 0342 BYTES = [root@lclef01 ~]# [root@lclef01 ~]# lscss --all IO Subchannels and Devices: Device Subchan. DevType CU Type Use PIM PAM POM CHPIDs -- 0.0.0340 0.0. 1732/01 1731/01 yes 80 80 ff 1300 0.0.0341 0.0.0001 1732/01 1731/01 yes 80 80 ff 1300 0.0.0342 0.0.0002 1732/01 1731/01 yes 80 80 ff 1300 0.0.01b0 0.0.0004 3390/0c 3990/e9 yes f8 f8 ff 0e101921 2300 0.0.0009 0.0.0006 /00 3215/00 yes 80 80 ff 1300 CHSC Subchannels: Device Subchan. -- EADM Subchannels: Device Subchan. -- -- Russ herrold -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For more information on Linux on System z, visit http://wiki.linuxvm.org/ -- For LINUX-390 subscribe / signoff / archive access instructions, send email to lists...@vm.marist.edu with the message: INFO LINUX-390 or visit http://www.marist.edu/htbin/wlvindex?LINUX-390 -- For more information on Linux on System z, visit http://wiki.linuxvm.org/
