Re: [Xen-devel] [BUG] Assertion '(sp == 0) || (peoi[sp-1].vector < vector)' failed at irq.c:1163

[HÃkon Alstadheim <hakon@xxxxxxxxxxxxxxxxxx>]

Den 15. jan. 2016 12:05, skrev Andrew Cooper:
> On 15/01/16 10:58, Håkon Alstadheim wrote:
>> CPUINFO:
>> vendor_id    : GenuineIntel
>> cpu family    : 6
>> model        : 63
>> model name    : Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz
>>
>> # smbios-sys-info
>> Libsmbios version:      2.2.28
>> Product Name:           Z10PE-D8 WS
>> Vendor:                 ASUSTeK COMPUTER INC.
>> BIOS Version:           3101
>>
>>
>> I have been experiencing issues with domains with passed through PCIe
>> devices since I first installed xen. Then at version 4.5.x , I'm now
>> at 4.6.0 with gentoo patches. Crashes SEEM mostly related to this pci
>> pass through and interrupts (usb-cards, sound cards).
>>
>> Recently the system has been more stable, whether it is because I pass
>> through as few things as possible, or because of improvements in Xen I
>> do not know. I have also taken to building with debug, which leads to
>> more abrupt but less mysterious failures. Earlier (w/o debug and under
>> xen 4.5 ) stuff would just gradually stop working and end up in total
>> hang of everything. So, hey, things are improving :-b
> This isn't the first time we have seen this on Haswell processors. Do
> you have microcode loading set up?
>
> ~Andrew
>
Still happening with kernel-genkernel-x86_64-4.1.15-gentoo and updated
cpu microcode, using microcode from 20151106.
---cpuinfo:---
vendor_id    : GenuineIntel
cpu family    : 6
model        : 63
model name    : Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz
stepping    : 2
microcode    : 0x36
cpu MHz        : 2394.774
cache size    : 15360 KB
physical id    : 0
siblings    : 4
core id        : 1
cpu cores    : 2
apicid        : 3
initial apicid    : 3
fpu        : yes
fpu_exception    : yes
cpuid level    : 15
wp        : yes
flags        : fpu de tsc msr pae mce cx8 apic sep mca cmov pat clflush
acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc arch_perfmon
rep_good nopl nonstop_tsc eagerfpu pni pclmulqdq monitor est ssse3 fma
cx16 sse4_1 sse4_2 movbe popcnt tsc_deadline_timer aes xsave avx f16c
rdrand hypervisor lahf_lm abm ida arat epb pln pts dtherm fsgsbase bmi1
avx2 bmi2 erms xsaveopt cqm_llc cqm_occup_llc
bugs        :
bogomips    : 4789.54
clflush size    : 64
cache_alignment    : 64
address sizes    : 46 bits physical, 48 bits virtual
power management:
---
Xen version is :  4.6.0-r7 (gentoo ebuild)

(XEN) [2016-01-17 14:18:38] Assertion '(sp == 0) || (peoi[sp-1].vector <
vector)' failed at irq.c:1163
(XEN) [2016-01-17 14:18:38] ----[ Xen-4.6.0  x86_64  debug=y  Not
tainted ]----
(XEN) [2016-01-17 14:18:38] CPU:    15
(XEN) [2016-01-17 14:18:38] RIP:    e008:[<ffff82d08017017e>]
do_IRQ+0x3ca/0x63b
(XEN) [2016-01-17 14:18:38] RFLAGS: 0000000000010046   CONTEXT: hypervisor
(XEN) [2016-01-17 14:18:38] rax: 0000000000000001   rbx:
ffff830839c06b00   rcx: 0000000000000001
(XEN) [2016-01-17 14:18:38] rdx: ffff830839d8c480   rsi:
000000000000003c   rdi: 000000000000003c
(XEN) [2016-01-17 14:18:38] rbp: ffff83107e027dc8   rsp:
ffff83107e027d68   r8:  0000000000000001
(XEN) [2016-01-17 14:18:38] r9:  ffff8304d629e310   r10:
00000bbac3b76219   r11: 00002b744439456f
(XEN) [2016-01-17 14:18:38] r12: ffff830b12e89ef0   r13:
000000000000003c   r14: 0000000000006b00
(XEN) [2016-01-17 14:18:38] r15: 000000000000006b   cr0:
0000000080050033   cr4: 00000000001526e0
(XEN) [2016-01-17 14:18:38] cr3: 00000004d4065000   cr2: 00007fd130301000
(XEN) [2016-01-17 14:18:38] ds: 0000   es: 0000   fs: 0000   gs: 0000
ss: 0000   cs: e008
(XEN) [2016-01-17 14:18:38] Xen stack trace from rsp=ffff83107e027d68:
(XEN) [2016-01-17 14:18:38]    ffff831000000000 ffff830839c06b24
0000000000000000 0000006b8034a480
(XEN) [2016-01-17 14:18:38]    0000000fffc0000f ffff830839bf5010
ffff83107e027dc0 00000bbac362e3e4
(XEN) [2016-01-17 14:18:38]    ffff830839da2560 0000000000000004
0000000000000008 ffff830839da2620
(XEN) [2016-01-17 14:18:38]    00007cef81fd8207 ffff82d08023b132
ffff830839da2620 0000000000000008
(XEN) [2016-01-17 14:18:38]    0000000000000004 ffff830839da2560
ffff83107e027ef0 00000bbac362e3e4
(XEN) [2016-01-17 14:18:38]    00002b744439456f 00000bbac3b76219
ffff8304d629e310 0000000000000001
(XEN) [2016-01-17 14:18:38]    ffff830839d8c020 20c49ba5e353f7cf
ffff83107e020000 00000bbac3627b15
(XEN) [2016-01-17 14:18:38]    ffff830839da2590 0000003c00000000
ffff82d0801af0ba 000000000000e008
(XEN) [2016-01-17 14:18:38]    0000000000000202 ffff83107e027e80
0000000000000000 000000207dda4000
(XEN) [2016-01-17 14:18:38]    00000bbac35af3c1 ffff82d0801eba00
ffff83107e027f08 ffff82d080321800
(XEN) [2016-01-17 14:18:38]    0000000000000000 0000000000000000
00000294000001b6 ffffffff81a04000
(XEN) [2016-01-17 14:18:38]    ffff83107e020000 ffff83007dfe6000
00000000ffffffff ffff83083ffe7000
(XEN) [2016-01-17 14:18:38]    ffff8304d629e000 ffff83107e027f10
ffff82d0801607bc ffff82d08012c574
(XEN) [2016-01-17 14:18:38]    ffff83007dda4000 ffff83107e027dd8
ffffffff81a04000 ffffffff81a04000
(XEN) [2016-01-17 14:18:38]    ffffffff81a04000 0000000000000000
ffffffff81a03ed8 0000000000000000
(XEN) [2016-01-17 14:18:38]    0000000000000400 0000000000000380
0000000000000000 0000000000000000
(XEN) [2016-01-17 14:18:38]    0000000000000000 ffffffff81a2e700
ffff8803bf20da70 0000000000000000
(XEN) [2016-01-17 14:18:38]    0000000000000000 0000beef0000beef
ffffffff81038162 000000bf0000beef
(XEN) [2016-01-17 14:18:38]    0000000000000286 ffffffff81a03ed8
000000000000beef 000000000000beef
(XEN) [2016-01-17 14:18:38]    000000000000beef 000000000000beef
000000000000beef 000000000000000f
(XEN) [2016-01-17 14:18:38] Xen call trace:
(XEN) [2016-01-17 14:18:38]    [<ffff82d08017017e>] do_IRQ+0x3ca/0x63b
(XEN) [2016-01-17 14:18:38]    [<ffff82d08023b132>]
common_interrupt+0x62/0x70
(XEN) [2016-01-17 14:18:38]    [<ffff82d0801af0ba>] mwait_idle+0x2cb/0x315
(XEN) [2016-01-17 14:18:38]    [<ffff82d0801607bc>] idle_loop+0x51/0x6b
(XEN) [2016-01-17 14:18:38]
(XEN) [2016-01-17 14:18:38]
(XEN) [2016-01-17 14:18:38] ****************************************
(XEN) [2016-01-17 14:18:38] Panic on CPU 15:
(XEN) [2016-01-17 14:18:38] Assertion '(sp == 0) || (peoi[sp-1].vector <
vector)' failed at irq.c:1163
(XEN) [2016-01-17 14:18:38] ****************************************
(XEN) [2016-01-17 14:18:38]
(XEN) [2016-01-17 14:18:38] Reboot in five seconds...
--------
# xl info
host                   : gentoo
release                : 4.1.15-gentoo
version                : #1 SMP Sat Jan 16 14:20:23 CET 2016
machine                : x86_64
nr_cpus                : 24
max_cpu_id             : 23
nr_nodes               : 2
cores_per_socket       : 6
threads_per_core       : 2
cpu_mhz                : 2394
hw_caps                :
bfebfbff:2c100800:00000000:00007f00:77fefbff:00000000:00000021:000037ab
virt_caps              : hvm hvm_directio
total_memory           : 65379
free_memory            : 33063
sharing_freed_memory   : 0
sharing_used_memory    : 0
outstanding_claims     : 0
free_cpus              : 0
xen_major              : 4
xen_minor              : 6
xen_extra              : .0
xen_version            : 4.6.0
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          :
xen_commandline        : ssd-xen-lx-4.1.15-marker
console_timestamps=date loglvl=warn/warn guest_loglvl=warn/warn iommu=1
iommu_inclusive_mapping=1 com1=115200,8n1 console=com1 dom0_max_vcpus=4
dom0_vcpus_pin=1 dom0_mem=8G,max:8G cpufreq=xen,performance,verbose
tmem=1 sched_smt_power_savings=1 e820-verbose=1 core_parking=power
cc_compiler            : x86_64-pc-linux-gnu-gcc (Gentoo 4.9.3 p1.4,
pie-0.6.4) 4.9.3
cc_compile_by          :
cc_compile_domain      : alstadheim.priv.no
cc_compile_date        : Tue Jan 12 22:19:05 CET 2016
xend_config_format     : 4

Attachment: xen-serial.1.log
Description: Text Data

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel