[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Network driver domain broken


  • To: Roger Pau Monné <roger.pau@xxxxxxxxxx>
  • From: Andrea Stevanato <andrea.stevanato@xxxxxxxxxxxxxxx>
  • Date: Mon, 7 Mar 2022 12:39:22 +0100
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=santannapisa.it; dmarc=pass action=none header.from=santannapisa.it; dkim=pass header.d=santannapisa.it; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=P9vq27DMxWML12du5uN59XinDWxYicu43CCMny+ntBU=; b=eGbSBehb1/4cD3uyTpPUiMZb28WpwDNTCszehW3zOvs3xSG3bDmBu7k3i2JlcDbWeJLbZ2zTRTMWsQVfLird3hozOpdouzG0O06S2YdZLqLF+GjdzLgw6zkOgsMvB7GREsE0v47Zs+fcJWKoeXAQkmNgqVTwkrRvXYohvKlDFxGAftE0moF3QALOSoGriwd0Gn7k7LMHvYL6+56WitEpKMWiZBkCL2pjO8FJfflAFVpJpGaJJF49k/8SvcFDD0r1Ko0HlKk5StJ36CNlcZjimWes+D9eRCpOfRNGcOpQ1eOEdYfBg4AkU8FcoKyX8bT+kejQpiWi3oagMID9Zi48Hg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MGpdivGnmw0q5IKQgqRhXpgag81F8OXYxLfbSTaLjlTm3gBGyXRi7ScR20gaWci1CGykCqZh3hZCOSbr3DRHeEvTLi6EaXyBVNnmrx0FFiOcw+bfw4XdlJJNiJpFZojRNrmpnlHoFJ+l5r1GD2ANiF0lCj/LAhZSTHhmio7Xug1gOSdtFzZsIExlsuTWpUA1hBqqCxdL0dWSnITDaj/A+UaFCVwi0OdqQ/us4hZ7PGBfbp45NXUHr699wSysXkPxRI87U2lUt8F4xEdJtrYgeFNtwnvpFHfJjvVuP6/3mbZ+2OLLi5uV1Rdml2ntQqCprlRM/9WuWyTXkbVpAS21cQ==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=santannapisa.it;
  • Cc: Jason Andryuk <jandryuk@xxxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxxx>, "wl@xxxxxxx" <wl@xxxxxxx>, Anthony PERARD <anthony.perard@xxxxxxxxxx>
  • Delivery-date: Mon, 07 Mar 2022 11:39:38 +0000
  • List-id: Xen developer discussion <xen-devel.lists.xenproject.org>

On 3/7/22 12:22, Roger Pau Monné wrote:
On Fri, Mar 04, 2022 at 02:46:37PM +0100, Andrea Stevanato wrote:
On 3/4/2022 1:27 PM, Roger Pau Monné wrote:
On Fri, Mar 04, 2022 at 01:05:55PM +0100, Andrea Stevanato wrote:
On 3/4/2022 12:52 PM, Roger Pau Monné wrote:
On Thu, Mar 03, 2022 at 01:08:31PM -0500, Jason Andryuk wrote:
On Thu, Mar 3, 2022 at 11:34 AM Roger Pau Monné <roger.pau@xxxxxxxxxx> wrote:

On Thu, Mar 03, 2022 at 05:01:23PM +0100, Andrea Stevanato wrote:
On 03/03/2022 15:54, Andrea Stevanato wrote:
Hi all,

according to the conversation that I had with royger, aa67b97ed34  broke the 
driver domain support.

What I'm trying to do is to setup networking between guests using driver 
domain. Therefore, the guest (driver) has been started with the following cfg.

name    = "guest0"
kernel  = "/media/sd-mmcblk0p1/Image"
ramdisk = "/media/sd-mmcblk0p1/rootfs.cpio.gz"
extra   = "console=hvc0 rdinit=/sbin/init root=/dev/ram0"
memory  = 1024 vcpus   = 2
driver_domain = 1

On guest0 I created the bridge, assigned a static IP and started the udhcpd on 
xenbr0 interface.
While the second guest has been started with the following cfg:

name    = "guest1"
kernel  = "/media/sd-mmcblk0p1/Image"
ramdisk = "/media/sd-mmcblk0p1/rootfs.cpio.gz"
extra   = "console=hvc0 rdinit=/sbin/init root=/dev/ram0"
memory  = 1024 vcpus   = 2
vcpus   = 2
vif = [ 'bridge=xenbr0, backend=guest0' ]

Follows the result of strace xl devd:

# strace xl devd
execve("/usr/sbin/xl", ["xl", "devd"], 0xffffdf0420c8 /* 13 vars */) = 0

ioctl(5, _IOC(_IOC_NONE, 0x50, 0, 0x30), 0xffffe6e41b40) = -1 EPERM (Operation 
not permitted)
write(2, "libxl: ", 7libxl: )                  = 7
write(2, "error: ", 7error: )                  = 7
write(2, "libxl_utils.c:820:libxl_cpu_bitm"..., 
87libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve the maximum number of 
cpus) = 87
write(2, "\n", 1
)                       = 1
clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, 
child_tidptr=0xffff9ee7a0e0) = 814
wait4(814, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], 0, NULL) = 814
--- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=814, si_uid=0, 
si_status=0, si_utime=2, si_stime=2} ---

xl devd is daemonizing, but strace is only following the first
process.  Use `strace xl devd -F` to prevent the daemonizing (or
`strace -f xl devd` to follow children).

Or as a first step try to see what kind of messages you get from `xl
devd -F` when trying to attach a device using the driver domain.

Nothing has changed. On guest0 (the driver domain):

# xl devd -F
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
[  696.805619] xenbr0: port 1(vif2.0) entered blocking state
[  696.810334] xenbr0: port 1(vif2.0) entered disabled state
[  696.824518] device vif2.0 entered promiscuous mode

Can you use `xl -vvv devd -F` here?

# xl -vvv devd -F
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
libxl: error: libxl_utils.c:820:libxl_cpu_bitmap_alloc: failed to retrieve
the maximum number of cpus
libxl: debug: libxl_device.c:1749:libxl_device_events_handler: ao
0xaaaaece52130: create: how=(nil) callback=(nil) poller=0xaaaaece52430
libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch
w=0xffffe628caf8 wpath=/local/domain/1/backend token=3/0: register slotnum=3
libxl: debug: libxl_device.c:1806:libxl_device_events_handler: ao
0xaaaaece52130: inprogress: poller=0xaaaaece52430, flags=i
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event epath=/local/domain/1/backend
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece51b90:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece51b90:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece4e7b0:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece4e7b0:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece4e990:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece4e990:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/frontend
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece4eaa0:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece4eaa0:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/frontend-id
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece4ebb0:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece4ebb0:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/online
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece52830:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_device.c:1714:backend_watch_callback: Domain 2:Added
domain to the list of active guests
libxl: debug: libxl_device.c:1569:add_device: Domain 2:Added device
/local/domain/1/backend/vif/2/0 to the list of active devices
libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch
w=0xaaaaece52a10 wpath=/local/domain/1/backend/vif/2/0/state token=2/1:
register slotnum=2
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/state
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece52d50:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/script
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece52f30:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece52f30:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/mac
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/bridge
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/handle
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/type
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-sg
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-gso-tcpv4
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-gso-tcpv6
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-ipv6-csum-offload
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-rx-copy
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-xdp-headroom
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-rx-flip
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-multicast-control
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-dynamic-multicast-control
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-split-event-channels
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/multi-queue-max-queues
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-ctrl-ring
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-sg
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-gso-tcpv4
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-gso-tcpv6
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-ipv6-csum-offload
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-rx-copy
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-xdp-headroom
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-rx-flip
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-multicast-control
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-dynamic-multicast-control
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-split-event-channels
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/multi-queue-max-queues
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/feature-ctrl-ring
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:2035:libxl__ao__destroy: ao 0xaaaaece53110:
destroy
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xffffe628caf8
wpath=/local/domain/1/backend token=3/0: event
epath=/local/domain/1/backend/vif/2/0/state
libxl: debug: libxl_event.c:2445:libxl__nested_ao_create: ao 0xaaaaece53110:
nested ao, parent 0xaaaaece52130
libxl: debug: libxl_event.c:750:watchfd_callback: watch w=0xaaaaece52a10
wpath=/local/domain/1/backend/vif/2/0/state token=2/1: event
epath=/local/domain/1/backend/vif/2/0/state
libxl: debug: libxl_event.c:1055:devstate_callback: backend
/local/domain/1/backend/vif/2/0/state wanted state 2 still waiting state 5

There's something wrong with the negotiation between the frontend and
the backend AFAICT. The backed switches to state 5 and 6 (Closed) so
the connection cannot be established.

Can you paste the output of `xenstore-ls -fp` from dom0 after `xl
devd` reports the timeout?

# xenstore-ls -fp
/tool = ""   (n0)
/tool/xenstored = ""   (n0)
/local = ""   (n0)
/local/domain = ""   (n0)
/local/domain/0 = ""   (n0)
/local/domain/0/control = ""   (n0)
/local/domain/0/control/feature-poweroff = "1"   (n0)
/local/domain/0/control/feature-reboot = "1"   (n0)
/local/domain/0/domid = "0"   (n0)
/local/domain/0/name = "Domain-0"   (n0)
/local/domain/0/device-model = ""   (n0)
/local/domain/0/device-model/0 = ""   (n0)
/local/domain/0/device-model/0/backends = ""   (n0)
/local/domain/0/device-model/0/backends/console = ""   (n0,n0)
/local/domain/0/device-model/0/backends/vkbd = ""   (n0,n0)
/local/domain/0/device-model/0/backends/9pfs = ""   (n0,n0)
/local/domain/0/device-model/0/backends/vfb = ""   (n0,n0)
/local/domain/0/device-model/0/backends/qnic = ""   (n0,n0)
/local/domain/0/device-model/0/state = "running"   (n0)
/local/domain/0/backend = ""   (n0)
/local/domain/0/backend/console = ""   (n0)
/local/domain/0/backend/console/1 = ""   (n0)
/local/domain/0/backend/console/1/0 = ""   (n0,r1)
/local/domain/0/backend/console/1/0/frontend = "/local/domain/1/console" (n0,r1)
/local/domain/0/backend/console/1/0/frontend-id = "1"   (n0,r1)
/local/domain/0/backend/console/1/0/online = "1"   (n0,r1)
/local/domain/0/backend/console/1/0/state = "1"   (n0,r1)
/local/domain/0/backend/console/1/0/protocol = "vt100"   (n0,r1)
/local/domain/0/backend/console/2 = ""   (n0)
/local/domain/0/backend/console/2/0 = ""   (n0,r2)
/local/domain/0/backend/console/2/0/frontend = "/local/domain/2/console" (n0,r2)
/local/domain/0/backend/console/2/0/frontend-id = "2"   (n0,r2)
/local/domain/0/backend/console/2/0/online = "1"   (n0,r2)
/local/domain/0/backend/console/2/0/state = "1"   (n0,r2)
/local/domain/0/backend/console/2/0/protocol = "vt100"   (n0,r2)
/local/domain/1 = ""   (n0,r1)
/local/domain/1/vm = "/vm/cd36b881-cd46-4de7-a59b-7d173198862e"   (n0,r1)
/local/domain/1/name = "guest0"   (n0,r1)
/local/domain/1/cpu = ""   (n0,r1)
/local/domain/1/cpu/0 = ""   (n0,r1)
/local/domain/1/cpu/0/availability = "online"   (n0,r1)
/local/domain/1/cpu/1 = ""   (n0,r1)
/local/domain/1/cpu/1/availability = "online"   (n0,r1)
/local/domain/1/memory = ""   (n0,r1)
/local/domain/1/memory/static-max = "1048576"   (n0,r1)
/local/domain/1/memory/target = "1048577"   (n0,r1)
/local/domain/1/memory/videoram = "-1"   (n0,r1)
/local/domain/1/device = ""   (n0,r1)
/local/domain/1/device/suspend = ""   (n0,r1)
/local/domain/1/device/suspend/event-channel = ""   (n1)
/local/domain/1/control = ""   (n0,r1)
/local/domain/1/control/shutdown = ""   (n1)
/local/domain/1/control/feature-poweroff = "1"   (n1)
/local/domain/1/control/feature-reboot = "1"   (n1)
/local/domain/1/control/feature-suspend = ""   (n1)
/local/domain/1/control/sysrq = ""   (n1)
/local/domain/1/control/platform-feature-multiprocessor-suspend = "1" (n0,r1)
/local/domain/1/control/platform-feature-xs_reset_watches = "1"   (n0,r1)
/local/domain/1/data = ""   (n1)
/local/domain/1/drivers = ""   (n1)
/local/domain/1/feature = ""   (n1)
/local/domain/1/attr = ""   (n1)
/local/domain/1/error = ""   (n1)
/local/domain/1/libxl = ""   (n1)
/local/domain/1/device-model = ""   (n1)
/local/domain/1/domid = "1"   (n0,r1)
/local/domain/1/store = ""   (n0,r1)
/local/domain/1/store/port = "1"   (n0,r1)
/local/domain/1/store/ring-ref = "233473"   (n0,r1)
/local/domain/1/console = ""   (n0,r1)
/local/domain/1/console/backend = "/local/domain/0/backend/console/1/0" (n0,r1)
/local/domain/1/console/backend-id = "0"   (n1,r0)
/local/domain/1/console/limit = "1048576"   (n0,r1)
/local/domain/1/console/type = "xenconsoled"   (n0,r1)
/local/domain/1/console/output = "pty"   (n0,r1)
/local/domain/1/console/tty = "/dev/pts/0"   (n0,r1)
/local/domain/1/console/port = "2"   (n0,r1)
/local/domain/1/console/ring-ref = "233472"   (n0,r1)
/local/domain/1/backend = ""   (n0,r1)
/local/domain/1/backend/vif = ""   (n0,r1)
/local/domain/1/backend/vif/2 = ""   (n0,r1)
/local/domain/1/backend/vif/2/0 = ""   (n1,r2)
/local/domain/1/backend/vif/2/0/frontend = "/local/domain/2/device/vif/0" (n1,r2)
/local/domain/1/backend/vif/2/0/frontend-id = "2"   (n1,r2)
/local/domain/1/backend/vif/2/0/online = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/state = "6"   (n1,r2)
/local/domain/1/backend/vif/2/0/script = "/etc/xen/scripts/vif-bridge" (n1,r2)
/local/domain/1/backend/vif/2/0/mac = "00:16:3e:07:df:91"   (n1,r2)
/local/domain/1/backend/vif/2/0/bridge = "xenbr1"   (n1,r2)
/local/domain/1/backend/vif/2/0/handle = "0"   (n1,r2)
/local/domain/1/backend/vif/2/0/type = "vif"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-sg = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-gso-tcpv4 = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-gso-tcpv6 = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-ipv6-csum-offload = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-rx-copy = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-xdp-headroom = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-rx-flip = "0"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-multicast-control = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-dynamic-multicast-control = "1" (n1,r2)
/local/domain/1/backend/vif/2/0/feature-split-event-channels = "1"   (n1,r2)
/local/domain/1/backend/vif/2/0/multi-queue-max-queues = "2"   (n1,r2)
/local/domain/1/backend/vif/2/0/feature-ctrl-ring = "1"   (n1,r2)
/local/domain/2 = ""   (n0,r2)
/local/domain/2/vm = "/vm/f6dca20a-54bb-43af-9a62-67c55cb75708"   (n0,r2)
/local/domain/2/name = "guest1"   (n0,r2)
/local/domain/2/cpu = ""   (n0,r2)
/local/domain/2/cpu/0 = ""   (n0,r2)
/local/domain/2/cpu/0/availability = "online"   (n0,r2)
/local/domain/2/cpu/1 = ""   (n0,r2)
/local/domain/2/cpu/1/availability = "online"   (n0,r2)
/local/domain/2/memory = ""   (n0,r2)
/local/domain/2/memory/static-max = "1048576"   (n0,r2)
/local/domain/2/memory/target = "1048577"   (n0,r2)
/local/domain/2/memory/videoram = "-1"   (n0,r2)
/local/domain/2/device = ""   (n0,r2)
/local/domain/2/device/suspend = ""   (n0,r2)
/local/domain/2/device/suspend/event-channel = ""   (n2)
/local/domain/2/device/vif = ""   (n0,r2)
/local/domain/2/device/vif/0 = ""   (n2,r1)
/local/domain/2/device/vif/0/backend = "/local/domain/1/backend/vif/2/0" (n2,r1)
/local/domain/2/device/vif/0/backend-id = "1"   (n2,r1)
/local/domain/2/device/vif/0/state = "6"   (n2,r1)
/local/domain/2/device/vif/0/handle = "0"   (n2,r1)
/local/domain/2/device/vif/0/mac = "00:16:3e:07:df:91"   (n2,r1)
/local/domain/2/device/vif/0/xdp-headroom = "0"   (n2,r1)
/local/domain/2/control = ""   (n0,r2)
/local/domain/2/control/shutdown = ""   (n2)
/local/domain/2/control/feature-poweroff = "1"   (n2)
/local/domain/2/control/feature-reboot = "1"   (n2)
/local/domain/2/control/feature-suspend = ""   (n2)
/local/domain/2/control/sysrq = ""   (n2)
/local/domain/2/control/platform-feature-multiprocessor-suspend = "1" (n0,r2)
/local/domain/2/control/platform-feature-xs_reset_watches = "1"   (n0,r2)
/local/domain/2/data = ""   (n2)
/local/domain/2/drivers = ""   (n2)
/local/domain/2/feature = ""   (n2)
/local/domain/2/attr = ""   (n2)
/local/domain/2/error = ""   (n2)
/local/domain/2/error/device = ""   (n2)
/local/domain/2/error/device/vif = ""   (n2)
/local/domain/2/error/device/vif/0 = ""   (n2)
/local/domain/2/error/device/vif/0/error = "1 allocating event channel" (n2)
/local/domain/2/domid = "2"   (n0,r2)
/local/domain/2/store = ""   (n0,r2)
/local/domain/2/store/port = "1"   (n0,r2)
/local/domain/2/store/ring-ref = "233473"   (n0,r2)
/local/domain/2/console = ""   (n0,r2)
/local/domain/2/console/backend = "/local/domain/0/backend/console/2/0" (n0,r2)
/local/domain/2/console/backend-id = "0"   (n2,r0)
/local/domain/2/console/limit = "1048576"   (n0,r2)
/local/domain/2/console/type = "xenconsoled"   (n0,r2)
/local/domain/2/console/output = "pty"   (n0,r2)
/local/domain/2/console/tty = "/dev/pts/3"   (n0,r2)
/local/domain/2/console/port = "2"   (n0,r2)
/local/domain/2/console/ring-ref = "233472"   (n0,r2)
/vm = ""   (n0)
/vm/cd36b881-cd46-4de7-a59b-7d173198862e = ""   (n0,r1)
/vm/cd36b881-cd46-4de7-a59b-7d173198862e/name = "guest0"   (n0,r1)
/vm/cd36b881-cd46-4de7-a59b-7d173198862e/uuid = "cd36b881-cd46-4de7-a59b-7d173198862e" (n0,r1) /vm/cd36b881-cd46-4de7-a59b-7d173198862e/start_time = "1646643480.69" (n0,r1)
/vm/f6dca20a-54bb-43af-9a62-67c55cb75708 = ""   (n0,r2)
/vm/f6dca20a-54bb-43af-9a62-67c55cb75708/name = "guest1"   (n0,r2)
/vm/f6dca20a-54bb-43af-9a62-67c55cb75708/uuid = "f6dca20a-54bb-43af-9a62-67c55cb75708" (n0,r2) /vm/f6dca20a-54bb-43af-9a62-67c55cb75708/start_time = "1646644038.80" (n0,r2)
/libxl = ""   (n0)
/libxl/1 = ""   (n0)
/libxl/1/device = ""   (n0)
/libxl/1/device/console = ""   (n0)
/libxl/1/device/console/0 = ""   (n0)
/libxl/1/device/console/0/frontend = "/local/domain/1/console"   (n0)
/libxl/1/device/console/0/backend = "/local/domain/0/backend/console/1/0" (n0)
/libxl/1/device/console/0/frontend-id = "1"   (n0)
/libxl/1/device/console/0/online = "1"   (n0)
/libxl/1/device/console/0/state = "1"   (n0)
/libxl/1/device/console/0/protocol = "vt100"   (n0)
/libxl/1/type = "pvh"   (n0)
/libxl/1/dm-version = "qemu_xen"   (n0)
/libxl/2 = ""   (n0)
/libxl/2/device = ""   (n0)
/libxl/2/device/console = ""   (n0)
/libxl/2/device/console/0 = ""   (n0)
/libxl/2/device/console/0/frontend = "/local/domain/2/console"   (n0)
/libxl/2/device/console/0/backend = "/local/domain/0/backend/console/2/0" (n0)
/libxl/2/device/console/0/frontend-id = "2"   (n0)
/libxl/2/device/console/0/online = "1"   (n0)
/libxl/2/device/console/0/state = "1"   (n0)
/libxl/2/device/console/0/protocol = "vt100"   (n0)
/libxl/2/device/vif = ""   (n0)
/libxl/2/device/vif/0 = ""   (n0)
/libxl/2/device/vif/0/frontend = "/local/domain/2/device/vif/0"   (n0)
/libxl/2/device/vif/0/backend = "/local/domain/1/backend/vif/2/0"   (n0)
/libxl/2/device/vif/0/frontend-id = "2"   (n0)
/libxl/2/device/vif/0/online = "1"   (n0)
/libxl/2/device/vif/0/state = "1"   (n0)
/libxl/2/device/vif/0/script = "/etc/xen/scripts/vif-bridge"   (n0)
/libxl/2/device/vif/0/mac = "00:16:3e:07:df:91"   (n0)
/libxl/2/device/vif/0/bridge = "xenbr1"   (n0)
/libxl/2/device/vif/0/handle = "0"   (n0)
/libxl/2/device/vif/0/type = "vif"   (n0)
/libxl/2/type = "pvh"   (n0)
/libxl/2/dm-version = "qemu_xen"   (n0)

What OS/versions are you using for the guest and the driver domain, do
you have any local modifications?

I'm using the same OS for everything: dom0 and guestX. It is petalinux 2021.2.

Regards, Roger.

Cheers,
Andrea



 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.