[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] High CPU temp, suspend problem - xen 4.1.5-pre, linux 3.7.x



On 27.03.2013 10:03, Jan Beulich wrote:
>>>> On 27.03.13 at 09:52, "Jan Beulich" <JBeulich@xxxxxxxx> wrote:
>>>>> On 26.03.13 at 19:50, Andrew Cooper <andrew.cooper3@xxxxxxxxxx> wrote:
>>> So vector e9 doesn't appear to be programmed in anywhere.
>>
>> Quite obviously, as it's the 8259A vector for IRQ 9. The question
>> really is why an IRQ appears on that vector in the first place. The
>> 8259A resume code _should_ leave all IRQs masked on a fully
>> IO-APIC system (see my question raised yesterday).
> 
> So to put this in consumable form: Please log what i8259A_resume()
> writes to ports 21 and A1 (i.e. cached_21 and cached_A1), and also
> dump those ports' contents at the crash point (i.e. alongside the
> dump_irqs()).

I've noticed that not all messages are available on serial console, especially
nothing from inside of i8259A_resume(). So changed BUG to WARN and got some
additional lines.

Ports: 21:0xfb, A1:0xff (the same in i8259A_resume() as at crash point).

Part of
http://duch.mimuw.edu.pl/~marmarek/qubes/xen-4.1-failed-resume-dump-irqs3.log:
(XEN) Preparing system for ACPI S3 state.
(XEN) Disabling non-boot CPUs ...
(XEN) Broke affinity for irq 1
(XEN) Broke affinity for irq 12
(XEN) Broke affinity for irq 17
(XEN) [VT-D]intremap.c:552: remap_entry_to_msi_msg: index (65535) get an empty
entry!
(XEN) Broke affinity for irq 27
(XEN) Broke affinity for irq 1
(XEN) Broke affinity for irq 7
(XEN) Broke affinity for irq 9
(XEN) Broke affinity for irq 16
(XEN) Broke affinity for irq 20
(XEN) [VT-D]intremap.c:552: remap_entry_to_msi_msg: index (65535) get an empty
entry!
(XEN) Broke affinity for irq 32
(XEN) Broke affinity for irq 36
(XEN) Broke affinity for irq 1
(XEN) Broke affinity for irq 7
(XEN) Broke affinity for irq 20
(XEN) [VT-D]intremap.c:552: remap_entry_to_msi_msg: index (65535) get an empty
entry!
(XEN) Broke affinity for irq 28
(XEN) Broke affinity for irq 29
(XEN) Broke affinity for irq 30
(XEN) Broke affinity for irq 31
(XEN) Entering ACPI S3 state.
(XEN) i8259A_suspend: cached_21: 0xfb, cached_A1: 0xff
(XEN) i8259A_resume: cached_21: 0xfb, cached_A1: 0xff
(XEN) mce_intel.c:1162: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0
extended MCE MSR 0
(XEN) CPU0 CMCI LVT vector (0xf7) already installed
(XEN) CPU0: Thermal LVT vector (0xfa) already installed
(XEN) Finishing wakeup from ACPI S3 state.
(XEN) Enabling non-boot CPUs  ...
(XEN) Suppress EOI broadcast on CPU#1
(XEN) masked ExtINT on CPU#1
(XEN) Suppress EOI broadcast on CPU#2
(XEN) masked ExtINT on CPU#2
(XEN) Suppress EOI broadcast on CPU#3
(XEN) masked ExtINT on CPU#3
(XEN) *** IRQ BUG found ***
(XEN) CPU0 -Testing vector 233 from bitmap
44,49,57,64,68,72,76,80,84,88,96,100,108,112,120,122,144,152,154,160,168,192,194,200,208,211,218-219
(XEN) Guest interrupt information:
(XEN)    IRQ:   0 affinity:00000000,00000000,00000000,00000001 vec:f0
type=IO-APIC-edge    status=00000000 mapped, unbound
(XEN)    IRQ:   1 affinity:00000000,00000000,00000000,00000002 vec:db
type=IO-APIC-edge    status=00000050 in-flight=0 domain-list=0:  1(-S--),
(XEN)    IRQ:   2 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:e2
type=XT-PIC          status=00000000 mapped, unbound
(XEN)    IRQ:   3 affinity:00000000,00000000,00000000,00000001 vec:40
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   4 affinity:00000000,00000000,00000000,00000001 vec:f1
type=IO-APIC-edge    status=00000000 mapped, unbound
(XEN)    IRQ:   5 affinity:00000000,00000000,00000000,00000001 vec:48
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   6 affinity:00000000,00000000,00000000,00000001 vec:50
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:   7 affinity:00000000,00000000,00000000,00000004 vec:7a
type=IO-APIC-edge    status=00000050 in-flight=0 domain-list=0:  7(-S--),
(XEN)    IRQ:   8 affinity:00000000,00000000,00000000,00000001 vec:60
type=IO-APIC-edge    status=00000050 in-flight=0 domain-list=0:  8(-S--),
(XEN)    IRQ:   9 affinity:00000000,00000000,00000000,00000001 vec:64
type=IO-APIC-level   status=00000010 in-flight=0 domain-list=0:  9(-S--),
(XEN)    IRQ:  10 affinity:00000000,00000000,00000000,00000001 vec:70
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  11 affinity:00000000,00000000,00000000,00000001 vec:78
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  12 affinity:00000000,00000000,00000000,00000001 vec:4c
type=IO-APIC-edge    status=00000050 in-flight=0 domain-list=0: 12(-S--),
(XEN)    IRQ:  13 affinity:00000000,00000000,00000000,0000000f vec:90
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  14 affinity:00000000,00000000,00000000,00000001 vec:98
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  15 affinity:00000000,00000000,00000000,00000001 vec:a0
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  16 affinity:00000000,00000000,00000000,00000001 vec:6c
type=IO-APIC-level   status=00000050 in-flight=0 domain-list=0: 16(-S--),
(XEN)    IRQ:  17 affinity:00000000,00000000,00000000,00000001 vec:54
type=IO-APIC-level   status=00000050 in-flight=0 domain-list=0: 17(-S--),
(XEN)    IRQ:  18 affinity:00000000,00000000,00000000,00000008 vec:39
type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  19 affinity:00000000,00000000,00000000,0000000f vec:c8
type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  20 affinity:00000000,00000000,00000000,00000004 vec:da
type=IO-APIC-level   status=00000050 in-flight=0 domain-list=0: 20(-S--),
(XEN)    IRQ:  22 affinity:00000000,00000000,00000000,0000000f vec:9a
type=IO-APIC-level   status=00000002 mapped, unbound
(XEN)    IRQ:  23 affinity:00000000,00000000,00000000,0000000f vec:a8
type=IO-APIC-edge    status=00000002 mapped, unbound
(XEN)    IRQ:  24 affinity:00000000,00000000,00000000,00000001 vec:28
type=DMA_MSI         status=00000000 mapped, unbound
(XEN)    IRQ:  25 affinity:00000000,00000000,00000000,00000001 vec:30
type=DMA_MSI         status=00000000 mapped, unbound
(XEN)    IRQ:  26 affinity:00000000,00000000,00000000,00000004 vec:3c
type=PCI-MSI         status=00000002 mapped, unbound
(XEN)    IRQ:  27 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:9c
type=PCI-MSI         status=00000042 mapped, unbound
(XEN)    IRQ:  28 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:a4
type=PCI-MSI         status=00000042 mapped, unbound
(XEN)    IRQ:  29 affinity:ffffffff,ffffffff,ffffffff,ffffffff vec:ac
type=PCI-MSI         status=00000042 mapped, unbound
(XEN)    IRQ:  32 affinity:00000000,00000000,00000000,00000001 vec:74
type=PCI-MSI         status=00000050 in-flight=0 domain-list=0:273(-S--),
(XEN)    IRQ:  33 affinity:00000000,00000000,00000000,00000004 vec:8c
type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:272(PS--),
(XEN)    IRQ:  34 affinity:00000000,00000000,00000000,00000001 vec:94
type=PCI-MSI         status=00000010 in-flight=0 domain-list=0:271(-S--),
(XEN)    IRQ:  35 affinity:00000000,00000000,00000000,00000004 vec:d9
type=PCI-MSI         status=00000042 mapped, unbound
(XEN)    IRQ:  36 affinity:00000000,00000000,00000000,00000001 vec:7c
type=PCI-MSI         status=00000050 in-flight=0 domain-list=1: 54(-S--),
(XEN) IO-APIC interrupt information:
(XEN)     IRQ  0 Vec240:
(XEN)       Apic 0x00, Pin  2: vec=f0 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  1 Vec219:
(XEN)       Apic 0x00, Pin  1: vec=db delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  3 Vec 64:
(XEN)       Apic 0x00, Pin  3: vec=40 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  4 Vec241:
(XEN)       Apic 0x00, Pin  4: vec=f1 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  5 Vec 72:
(XEN)       Apic 0x00, Pin  5: vec=48 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  6 Vec 80:
(XEN)       Apic 0x00, Pin  6: vec=50 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  7 Vec122:
(XEN)       Apic 0x00, Pin  7: vec=7a delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  8 Vec 96:
(XEN)       Apic 0x00, Pin  8: vec=60 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ  9 Vec100:
(XEN)       Apic 0x00, Pin  9: vec=64 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 10 Vec112:
(XEN)       Apic 0x00, Pin 10: vec=70 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 11 Vec120:
(XEN)       Apic 0x00, Pin 11: vec=78 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 12 Vec 76:
(XEN)       Apic 0x00, Pin 12: vec=4c delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 13 Vec144:
(XEN)       Apic 0x00, Pin 13: vec=90 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=1 dest_id:0
(XEN)     IRQ 14 Vec152:
(XEN)       Apic 0x00, Pin 14: vec=98 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 15 Vec160:
(XEN)       Apic 0x00, Pin 15: vec=a0 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=0 dest_id:0
(XEN)     IRQ 16 Vec108:
(XEN)       Apic 0x00, Pin 16: vec=6c delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 17 Vec 84:
(XEN)       Apic 0x00, Pin 17: vec=54 delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 18 Vec 57:
(XEN)       Apic 0x00, Pin 18: vec=39 delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 19 Vec200:
(XEN)       Apic 0x00, Pin 19: vec=c8 delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 20 Vec218:
(XEN)       Apic 0x00, Pin 20: vec=da delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=0 dest_id:0
(XEN)     IRQ 22 Vec154:
(XEN)       Apic 0x00, Pin 22: vec=9a delivery=LoPri dest=L status=0
polarity=1 irr=0 trig=L mask=1 dest_id:0
(XEN)     IRQ 23 Vec168:
(XEN)       Apic 0x00, Pin 23: vec=a8 delivery=LoPri dest=L status=0
polarity=0 irr=0 trig=E mask=1 dest_id:0
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #2 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #2......
(XEN) .... register #00: 02000000
(XEN) .......    : physical APIC id: 02
(XEN) .......    : Delivery Type: 0
(XEN) .......    : LTS          : 0
(XEN) .... register #01: 00170020
(XEN) .......     : max redirection entries: 0017
(XEN) .......     : PRQ implemented: 0
(XEN) .......     : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN)  NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
(XEN)  00 000 00  1    0    0   0   0    0    0    00
(XEN)  01 000 00  0    0    0   0   0    1    1    DB
(XEN)  02 000 00  0    0    0   0   0    1    1    F0
(XEN)  03 000 00  0    0    0   0   0    1    1    40
(XEN)  04 000 00  0    0    0   0   0    1    1    F1
(XEN)  05 000 00  0    0    0   0   0    1    1    48
(XEN)  06 000 00  0    0    0   0   0    1    1    50
(XEN)  07 000 00  0    0    0   0   0    1    1    7A
(XEN)  08 000 00  0    0    0   0   0    1    1    60
(XEN)  09 000 00  0    1    0   0   0    1    1    64
(XEN)  0a 000 00  0    0    0   0   0    1    1    70
(XEN)  0b 000 00  0    0    0   0   0    1    1    78
(XEN)  0c 000 00  0    0    0   0   0    1    1    4C
(XEN)  0d 000 00  1    0    0   0   0    1    1    90
(XEN)  0e 000 00  0    0    0   0   0    1    1    98
(XEN)  0f 000 00  0    0    0   0   0    1    1    A0
(XEN)  10 000 00  0    1    0   1   0    1    1    6C
(XEN)  11 000 00  0    1    0   1   0    1    1    54
(XEN)  12 000 00  1    1    0   1   0    1    1    39
(XEN)  13 000 00  1    1    0   1   0    1    1    C8
(XEN)  14 000 00  0    1    0   1   0    1    1    DA
(XEN)  15 000 00  1    0    0   0   0    0    0    00
(XEN)  16 000 00  1    1    0   1   0    1    1    9A
(XEN)  17 000 00  1    0    0   0   0    1    1    A8
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ219 -> 0:1
(XEN) IRQ64 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ72 -> 0:5
(XEN) IRQ80 -> 0:6
(XEN) IRQ122 -> 0:7
(XEN) IRQ96 -> 0:8
(XEN) IRQ100 -> 0:9
(XEN) IRQ112 -> 0:10
(XEN) IRQ120 -> 0:11
(XEN) IRQ76 -> 0:12
(XEN) IRQ144 -> 0:13
(XEN) IRQ152 -> 0:14
(XEN) IRQ160 -> 0:15
(XEN) IRQ108 -> 0:16
(XEN) IRQ84 -> 0:17
(XEN) IRQ57 -> 0:18
(XEN) IRQ200 -> 0:19
(XEN) IRQ218 -> 0:20
(XEN) IRQ154 -> 0:22
(XEN) IRQ168 -> 0:23
(XEN) .................................... done.
(XEN) i8259: 21: 0xfb, A1: 0xff
(XEN) Xen WARN at io_apic.c:558
(XEN) ----[ Xen-4.1.5-rc1  x86_64  debug=y  Tainted:    C ]----
(XEN) CPU:    0
(XEN) RIP:    e008:[<ffff82c48015e341>] 
smp_irq_move_cleanup_interrupt+0x23c/0x2bc
(XEN) RFLAGS: 0000000000010086   CONTEXT: hypervisor
(XEN) rax: 0000000000000000   rbx: 00000000000000e9   rcx: 0000000000000000
(XEN) rdx: 0000000000000000   rsi: 000000000000000a   rdi: ffff82c4802592e0
(XEN) rbp: ffff82c48029fb58   rsp: ffff82c48029fb08   r8:  0000000000000004
(XEN) r9:  0000000000000001   r10: 00000000000000ff   r11: 0000000000000002
(XEN) r12: ffff830421080250   r13: ffff830421060534   r14: ffff82c48029ff18
(XEN) r15: ffff82c4802dd9e0   cr0: 000000008005003b   cr4: 00000000000026f0
(XEN) cr3: 000000037e7a8000   cr2: ffff880402070318
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
(XEN) Xen stack trace from rsp=ffff82c48029fb08:
(XEN)    0000000000000000 0000000000000008 ffff82c48029ff18 ffff82c4802dd9e0
(XEN)    ffff82c48029fb58 0000000000000004 0000000000000000 0000000080030014
(XEN)    0000000000000000 0000000000000000 00007d3b7fd60477 ffff82c48014de60
(XEN)    0000000000000000 0000000000000000 0000000080030014 0000000000000000
(XEN)    ffff82c48029fc18 0000000000000004 0000000000000246 0000000000000000
(XEN)    00000000ffffffff 00000000ffffffff 0000000000000000 0000000000000001
(XEN)    0000000000000cfc 0000000000000282 ffff82c48025a9c0 0000002000000000
(XEN)    ffff82c4801226c0 000000000000e008 0000000000000282 ffff82c48029fc18
(XEN)    000000000000e010 0000000000000282 ffff82c48029fc48 ffff82c480175950
(XEN)    0000000000000202 0000000000000006 0000000000000010 00000000e2200004
(XEN)    ffff82c48029fc68 ffff82c4802105dc ffff82c48029fc78 ffff82c480122614
(XEN)    ffff82c48029fcc8 ffff82c480160183 ffff82c48029fca8 ffff82c480175950
(XEN)    000082c4ffffffff 0000000000000003 ffff8301108fd1c0 ffff830421050ac0
(XEN)    ffff8301108fd1c0 0000000000000000 0000000000000000 0000000000000003
(XEN)    ffff82c48029fd58 ffff82c48016033a 000000000000002f 0000000000000082
(XEN)    000782c48029fd08 ffff82c48029fe10 0000006a00000008 ffff82c48029fe78
(XEN)    0000000300000068 0000000000000000 0000000000002000 ffff82c4ffffffff
(XEN)    ffff82c48029fe10 ffff82c48029fe78 ffff82c48029fe10 ffff830421050ac0
(XEN)    0000000000000000 000000000000001e ffff82c48029fdc8 ffff82c4801610ef
(XEN)    ffff82c48029fdb8 ffff82c480115ec5 0000000000000293 ffff83042100a1f8
(XEN) Xen call trace:
(XEN)    [<ffff82c48015e341>] smp_irq_move_cleanup_interrupt+0x23c/0x2bc
(XEN)    [<ffff82c48014de60>] irq_move_cleanup_interrupt+0x30/0x40
(XEN)    [<ffff82c4801226c0>] _spin_unlock_irqrestore+0x22/0x24
(XEN)    [<ffff82c480175950>] pci_conf_read+0xb0/0xc1
(XEN)    [<ffff82c4802105dc>] pci_conf_read32+0x7c/0x7e
(XEN)    [<ffff82c480160183>] read_pci_mem_bar+0x2b0/0x303
(XEN)    [<ffff82c48016033a>] msix_capability_init+0x164/0x5fa
(XEN)    [<ffff82c4801610ef>] pci_enable_msi+0x19b/0x49b
(XEN)    [<ffff82c4801643bd>] map_domain_pirq+0x281/0x3df
(XEN)    [<ffff82c4801765cb>] do_physdev_op+0xa2b/0x1508
(XEN)    [<ffff82c480209fa8>] syscall_enter+0xc8/0x122
(XEN)


-- 
Best Regards / Pozdrawiam,
Marek Marczykowski
Invisible Things Lab

Attachment: signature.asc
Description: OpenPGP digital signature

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.