Re: FreeBSD PVHVM call for testing

2013-07-22 Thread Jeroen van der Ham
Hi,

After some more testing I thought it would be good to put this into production 
for my personal server. I've used pvhvm_v19 and built it without debugging 
options and installed it on a FreeBSD 9.1 system.

I've run into some hiccups with 9.1 user land and a 10-CURRENT kernel, but 
that's all solvable[0].

My VPS has some very limited memory (256M), but I've compensated with swap 
space (1G)

Now anytime I'm putting the system under stress, by building ports or by 
running a git clone on the kernel repository here, I'm seeing a lot of messages 
about swap_pager:

 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 132545, size: 4096

The system also becomes very sluggish and sometimes unresponsive.
The weird thing was that one of these messages happened right after a reboot 
when I rebuilt an outdated port and on the main console was checking the swap 
memory:

 jeroen:~/ $ swapinfo  
 [8:13:29]
 Device  1K-blocks UsedAvail Capacity
 /dev/ada0p2524288 2484   521804 0%
 /dev/md0  1048576 2364  1046212 0%
 Total 1572864 4848  1568016 0%
 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 131424, size: 4096


Is anyone else seeing something similar?
I certainly did not experience something like this on 9.0 with a XENHVM kernel.

If necessary I can rebuild a kernel with debugging support and do some more 
recording of what is actually going on.

Jeroen.


[0]: I have edited bsd.port.mk to always apply the FBSD10_FIX, and for version 
checking I am  running pkg version with UNAME_r=9.1-RELEASE.
___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org


Re: FreeBSD PVHVM call for testing

2013-07-22 Thread Jeroen van der Ham
Hi,

On 22 Jul 2013, at 10:29, Roger Pau Monné roger@citrix.com wrote:
 Is your guest running a 32bit or a 64bit kernel?

$ uname -a
FreeBSD positron.dckd.nl 10.0-CURRENT FreeBSD 10.0-CURRENT #0 r+a09eac7-dirty: 
Wed Jul 17 17:51:10 CEST 2013 
root@image01:/usr/obj/usr/home/jeroen/freebsd/sys/XENHVM  amd64

 
 Could you also provide the config file used to launch your guest and the
 Xen and Dom0 kernel versions?

Guest config:

kernel = '/usr/lib/xen-4.0/boot/hvmloader'
device_model = '/usr/lib/xen-4.0/bin/qemu-dm'
builder = 'hvm'
shadow_memory = 8
memory = 512
name = positron
vcpus = 2
cpus = 2-7
maxvcpus = 4
xen_shell = 'root, jeroen'

vif = [
'type=vifname=positron.wan,bridge=br-wan,mac=00:16:3E:2F:AD:99,ip=94.142.246.99'
,
'type=vifname=positron.lan,bridge=br-lan,mac=00:16:3E:0D:96:5C,ip=10.20.0.99'
]

disk = ['phy:/xen/domains/positron/positron-disk1,hda,w']

xen_platform_pci=1
boot = 'c'
sdl=0
stdvga=0
serial='pty'


Xen info:

host   : soleus01.soleus.nu
release: 2.6.32-5-xen-amd64
version: #1 SMP Mon Oct 3 07:53:54 UTC 2011
machine: x86_64
nr_cpus: 8
nr_nodes   : 2
cores_per_socket   : 4
threads_per_core   : 1
cpu_mhz: 2200
hw_caps: 
178bf3ff:efd3fbff::1310:00802001::37ff:
virt_caps  : hvm
total_memory   : 65534
free_memory: 6865
node_to_cpu: node0:0-3
 node1:4-7
node_to_memory : node0:3128
 node1:3737
node_to_dma32_mem  : node0:3128
 node1:0
max_node_id: 1
xen_major  : 4
xen_minor  : 0
xen_extra  : .1
xen_caps   : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler  : credit
xen_pagesize   : 4096
platform_params: virt_start=0x8000
xen_changeset  : unavailable
xen_commandline: placeholder dom0_mem=1852M
cc_compiler: gcc version 4.4.5 (Debian 4.4.5-10)
cc_compile_by  : waldi
cc_compile_domain  : debian.org
cc_compile_date: Wed Jan 12 14:04:06 UTC 2011
xend_config_format : 4

 Could you also try a HEAD XENHVM kernel (without my patches), to see if
 the issue is related to my changes or to some bug already present in HEAD?

Will do.


Jeroen.

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org


Re: FreeBSD PVHVM call for testing

2013-07-22 Thread Roger Pau Monné
On 22/07/13 10:40, Jeroen van der Ham wrote:
 Hi,
 
 On 22 Jul 2013, at 10:29, Roger Pau Monné roger@citrix.com wrote:
 Is your guest running a 32bit or a 64bit kernel?
 
 $ uname -a
 FreeBSD positron.dckd.nl 10.0-CURRENT FreeBSD 10.0-CURRENT #0 
 r+a09eac7-dirty: Wed Jul 17 17:51:10 CEST 2013 
 root@image01:/usr/obj/usr/home/jeroen/freebsd/sys/XENHVM  amd64
 

 Could you also provide the config file used to launch your guest and the
 Xen and Dom0 kernel versions?
 
 Guest config:
 
 kernel = '/usr/lib/xen-4.0/boot/hvmloader'
 device_model = '/usr/lib/xen-4.0/bin/qemu-dm'
 builder = 'hvm'
 shadow_memory = 8

Are you setting the shadow memory size manually because your hardware
lacks HAP support?

 memory = 512
 name = positron
 vcpus = 2
 cpus = 2-7
 maxvcpus = 4
 xen_shell = 'root, jeroen'

This doesn't seem like a standard xl config option.

 
 vif = [
 'type=vifname=positron.wan,bridge=br-wan,mac=00:16:3E:2F:AD:99,ip=94.142.246.99'
 ,
 'type=vifname=positron.lan,bridge=br-lan,mac=00:16:3E:0D:96:5C,ip=10.20.0.99'
 ]
 
 disk = ['phy:/xen/domains/positron/positron-disk1,hda,w']
 
 xen_platform_pci=1
 boot = 'c'
 sdl=0
 stdvga=0
 serial='pty'
 
 
 Xen info:
 
 host   : soleus01.soleus.nu
 release: 2.6.32-5-xen-amd64
 version: #1 SMP Mon Oct 3 07:53:54 UTC 2011
 machine: x86_64
 nr_cpus: 8
 nr_nodes   : 2
 cores_per_socket   : 4
 threads_per_core   : 1
 cpu_mhz: 2200
 hw_caps: 
 178bf3ff:efd3fbff::1310:00802001::37ff:
 virt_caps  : hvm
 total_memory   : 65534
 free_memory: 6865
 node_to_cpu: node0:0-3
  node1:4-7
 node_to_memory : node0:3128
  node1:3737
 node_to_dma32_mem  : node0:3128
  node1:0
 max_node_id: 1
 xen_major  : 4
 xen_minor  : 0
 xen_extra  : .1
 xen_caps   : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 
 hvm-3.0-x86_32p hvm-3.0-x86_64
 xen_scheduler  : credit
 xen_pagesize   : 4096
 platform_params: virt_start=0x8000
 xen_changeset  : unavailable
 xen_commandline: placeholder dom0_mem=1852M
 cc_compiler: gcc version 4.4.5 (Debian 4.4.5-10)
 cc_compile_by  : waldi
 cc_compile_domain  : debian.org
 cc_compile_date: Wed Jan 12 14:04:06 UTC 2011
 xend_config_format : 4

I've set up a XENHVM system with 256MB of RAM and swap and this is what
I see when doing a make buildkernel:

[root@ ~]# swapinfo
Device  1K-blocks UsedAvail Capacity
/dev/ada0p3   1048540   351116   69742433%

I don't see any messages on the console or anything else, the system
seems to be sluggish while doing the build, but that's quite normal when
using only 256MB of RAM.

This test was done using the pvhvm_20 branch, but it should not contain
any significant code changes in comparison with pvhvm_v19 (it's just a
rebase on top of HEAD and a reorder of patches). Could this be because
you are using a 9 userland with a 10 kernel?

Roger.

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org


Current problem reports assigned to freebsd-xen@FreeBSD.org

2013-07-22 Thread FreeBSD bugmaster
Note: to view an individual PR, use:
  http://www.freebsd.org/cgi/query-pr.cgi?pr=(number).

The following is a listing of current problems submitted by FreeBSD users.
These represent problem reports covering all versions including
experimental development code and obsolete releases.


S Tracker  Resp.  Description

o kern/176471  xen[xen] xn driver crash on detach
o kern/176053  xen[xen] [patch] i386: Correct wrong usage of vsnprintf()
o kern/175954  xen[xen] XENHVM xn network driver extreme packet loss dur
o kern/175822  xen[xen] FreeBSD 9.1 does not work with Xen 4.0
o kern/175757  xen[xen] [patch] xen pvhvm looses keyboard input from VNC
o kern/171873  xen[xen] xn network device floods warning in dmesg
o kern/171118  xen[xen] FreeBSD XENHVM guest doesn't shutdown cleanly
o kern/166174  xen[xen] Problems ROOT MOUNT ERROR freebsd 8.3
o kern/165418  xen[xen] Problems mounting root filesystem from XENHVM
o kern/164630  xen[xen] XEN HVM kernel: run_interrupt_driven_hooks: stil
o kern/164450  xen[xen] Failed to install FreeeBSD 9.0-RELEASE from CD i
o kern/162677  xen[xen] FreeBSD not compatible with Current Stable Xen
o kern/161318  xen[xen] sysinstall crashes with floating point exception
o kern/155468  xen[xen] Xen PV i386 multi-kernel CPU system is not worki
o kern/155353  xen[xen] [patch] put nudging TOD message under boot_ver
o kern/154833  xen[xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. 
o kern/154473  xen[xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not 
o kern/154472  xen[xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot
o kern/154428  xen[xen] xn0 network interface and PF - Massive performan
o kern/153674  xen[xen] i386/XEN idle thread shows wrong percentages
o kern/153672  xen[xen] [panic] i386/XEN panics under heavy fork load
o kern/153620  xen[xen] Xen guest system clock drifts in AWS EC2 (FreeBS
o kern/153477  xen[xen] XEN pmap code abuses vm page queue lock
o kern/153150  xen[xen] xen/ec2: disable checksum offloading on interfac
o kern/152228  xen[xen] [panic] Xen/PV panic with machdep.idle_mwait=1
o kern/144629  xen[xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor
o kern/143398  xen[xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor
o kern/143340  xen[xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor
f kern/143069  xen[xen] [panic] Xen Kernel Panic - Memory modified after
f kern/135667  xenufs filesystem corruption on XEN DomU system
f kern/135421  xen[xen] FreeBSD Xen PVM DomU network failure - netfronc.
f kern/135178  xen[xen] Xen domU outgoing data transfer stall when TSO i
p kern/135069  xen[xen] FreeBSD-current/Xen SMP doesn't function at all 
f i386/124516  xen[xen] FreeBSD-CURRENT Xen Kernel Segfaults when config
o kern/118734  xen[xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b

35 problems total.

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org


Re: FreeBSD PVHVM call for testing

2013-07-22 Thread Jeroen van der Ham
Hi,

On 22 Jul 2013, at 10:40, Jeroen van der Ham jer...@dckd.nl wrote:
 Could you also try a HEAD XENHVM kernel (without my patches), to see if
 the issue is related to my changes or to some bug already present in HEAD?

It seems I was worrying too soon.

I have been putting the system through the wringer some more, and I now believe 
that it has been caused by adding a new swap file. Just before I rebooted my 
system I created a larger swap file to be used by /etc/rc.d/add_swap.
Right after I rebooted I started compiling and doing other things. And I am 
getting the feeling that the system was still initialising that swap file and 
was unable to provide swap space at that time.

I've rebooted my system again with the PVHVM system, abused it even more than I 
did before and I'm not seeing the same messages again, nor getting any 
exaggerated sluggishness.

So my apologies for the false alarm.

Jeroen.

___
freebsd-xen@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-xen
To unsubscribe, send any mail to freebsd-xen-unsubscr...@freebsd.org