Re: [Xen-devel] XEN 4.0 + 2.6.31.13 pvops kernel : system crashes on starting 155th domU

[Pasi Kärkkäinen <pasik@xxxxxx>]

On Tue, Apr 27, 2010 at 11:58:42AM -0700, Yuvraj Agarwal wrote:
> I did make that change (dom0_mem=8192M), but I still get the same error.
> When I started the 154th domU (last time it was 155th) the dom0 crashes
> (it kills network connections and I have to manually go and reboot it). 
>

Hmm.. interesting. It should never crash.. 

Do you have a serial console so you could capture the error/crash messages? 
See: http://wiki.xensource.com/xenwiki/XenSerialConsole

> I did get a little bit more information on xend.log and daemon.log
> (attached).  After the last successful VM startup I did check and make
> sure the dom0 did indeed have enough memory.
> 
> root@MESL-BlackBox:/home/xen/noswap-configs# xm list | grep testing | wc
> -l
> 153
> root@MESL-BlackBox:/home/xen/noswap-configs# xm info | grep mem
> 
> total_memory           : 24490
> free_memory            : 9254

Ok so over 9 GB of free memory in the hypervisor.
How's the memory in dom0? It still has 8 GB and most of it is free?

> node_to_memory         : node0:2076
> node_to_dma32_mem      : node0:2076
> xen_commandline        : dom0_mem=8192M
> root@MESL-BlackBox:/home/xen/noswap-configs# xm create
> testing-ss-157.ucsd.edu
> Using config file "./testing-ss-157.ucsd.edu".
> Started domain testing-ss-157.ucsd.edu (id=154)
> 

How much memory does that ss-157 domU have configured? 

> /var/log/daemon.log  --> daemon.log <attached>
> /var/log/xend.log    --> xend.log   <attached>
> 
> We'd appreciate any pointers to fix this...
> 

Did you disable dom0 ballooning from xend-config.sxp? 
Did you make sure dom0 is NOT ballooned? Or does this crash happen when dom0 is 
ballooned? 

Please capture Xen and dom0 messages when it crashes..

-- Pasi

> Thank you
> --Yuvraj
> 
> -----Original Message-----
> From: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
> [mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Pasi
> Kärkkäinen
> Sent: Tuesday, April 27, 2010 10:19 AM
> To: Yuvraj Agarwal
> Cc: xen-devel@xxxxxxxxxxxxxxxxxxx
> Subject: Re: [Xen-devel] XEN 4.0 + 2.6.31.13 pvops kernel : system crashes
> on starting 155th domU
> 
> On Tue, Apr 27, 2010 at 10:14:40AM -0700, Yuvraj Agarwal wrote:
> > I am not using grub2; using grub-legacy instead.
> >
> > Also, once the dom0 boots up I do have to set the dom0 mem to:
> >
> > (1) xm mem-set 0 12000   (otherwise when starting up a lot of domU it
> > would run out of memory)
> > and
> > (2) echo 1548576 > /proc/sys/fs/aio-max-nr
> >
> 
> You might want to use dom0_mem=<X>M option for xen.gz instead.
> 
> See:
> http://wiki.xensource.com/xenwiki/XenBestPractices
> 
> -- Pasi
> 
> >
> > My /boot/grub/menu.lst  (pasted relevant lines)
> > **************************************************
> >
> > root@MESL-BlackBox:/usr/src# cat /boot/grub/menu.lst
> > # menu.lst - See: grub(8), info grub, update-grub(8)
> > #            grub-install(8), grub-floppy(8),
> > #            grub-md5-crypt, /usr/share/doc/grub
> > #            and /usr/share/doc/grub-doc/.
> >
> > ## default num
> > # Set the default entry to the entry number NUM. Numbering starts from
> 0,
> > and
> > # the entry number 0 is the default if the command is not used.
> > #
> > # You can specify 'saved' instead of a number. In this case, the default
> > entry
> > # is the entry saved with the command 'savedefault'.
> > # WARNING: If you are using dmraid do not use 'savedefault' or your
> > # array will desync and will not let you boot your system.
> > default         0
> >
> > ## timeout sec
> > # Set a timeout, in SEC seconds, before automatically booting the
> default
> > entry
> > # (normally the first entry defined).
> > timeout         20
> >
> > ### BEGIN AUTOMAGIC KERNELS LIST
> > ## lines between the AUTOMAGIC KERNELS LIST markers will be modified
> > ## by the debian update-grub script except for the default options below
> >
> > ## DO NOT UNCOMMENT THEM, Just edit them to your needs
> >
> > ## ## Start Default Options ##
> > ## default kernel options
> > ## default kernel options for automagic boot options
> > ## If you want special options for specific kernels use kopt_x_y_z
> > ## where x.y.z is kernel version. Minor versions can be omitted.
> > ## e.g. kopt=root=/dev/hda1 ro
> > ##      kopt_2_6_8=root=/dev/hdc1 ro
> > ##      kopt_2_6_8_2_686=root=/dev/hdc2 ro
> > # kopt=root=UUID=909f7c32-639a-469d-b34b-b418d2b6a2dc ro
> >
> > ## default grub root device
> > ## e.g. groot=(hd0,0)
> > # groot=909f7c32-639a-469d-b34b-b418d2b6a2dc
> >
> > ## should update-grub create alternative automagic boot options
> > ## e.g. alternative=true
> > ##      alternative=false
> > # alternative=true
> >
> > ## should update-grub lock alternative automagic boot options
> > ## e.g. lockalternative=true
> > ##      lockalternative=false
> > # lockalternative=false
> >
> > ## additional options to use with the default boot option, but not with
> > the
> > ## alternatives
> > ## e.g. defoptions=vga=791 resume=/dev/hda5
> > # defoptions=quiet splash
> >
> > ## should update-grub lock old automagic boot options
> > ## e.g. lockold=false
> > ##      lockold=true
> > # lockold=false
> >
> > ## Xen hypervisor options to use with the default Xen boot option
> > # xenhopt=dom0_max_vcpus=1 dom0_mem=8192
> >
> > ## Xen Linux kernel options to use with the default Xen boot option
> > # xenkopt=console=tty0
> >
> > ## altoption boot targets option
> > ## multiple altoptions lines are allowed
> > ## e.g. altoptions=(extra menu suffix) extra boot options
> > ##      altoptions=(recovery) single
> > # altoptions=(recovery mode) single
> >
> > ## controls how many kernels should be put into the menu.lst
> > ## only counts the first occurence of a kernel, not the
> > ## alternative kernel options
> > ## e.g. howmany=all
> > ##      howmany=7
> > # howmany=all
> >
> > ## specify if running in Xen domU or have grub detect automatically
> > ## update-grub will ignore non-xen kernels when running in domU and vice
> > versa
> > ## e.g. indomU=detect
> > ##      indomU=true
> > ##      indomU=false
> > # indomU=detect
> >
> > ## should update-grub create memtest86 boot option
> > ## e.g. memtest86=true
> > ##      memtest86=false
> > # memtest86=true
> >
> > ## should update-grub adjust the value of the default booted system
> > ## can be true or false
> > # updatedefaultentry=false
> >
> > ## should update-grub add savedefault to the default options
> > ## can be true or false
> > # savedefault=false
> >
> > ## ## End Default Options ##
> >
> > title           Xen 4.0.0 / Debian GNU/Linux, kernel 2.6.31.13
> > root            (hd0,0)
> > kernel          /boot/xen-4.0.0.gz
> > module          /boot/vmlinuz-2.6.31.13 root=/dev/sda1 ro
> >
> > title           Xen 3.4.2 / Debian GNU/Linux, kernel 2.6.31.8-xenapr2010
> > root            (hd0,0)
> > kernel          /boot/xen-3.4.2.gz
> > module          /boot/vmlinuz-2.6.31.8-xenapr2010 root=/dev/sda1 ro
> > console=tty0
> > module          /boot/initrd.img-2.6.31.8-xenapr2010
> >
> > ### END DEBIAN AUTOMAGIC KERNELS LIST
> >
> >
> > Please paste your dom0 grub.conf.
> > Are you using memory ballooning?
> >
> > -- Pasi
> >
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel




_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel