[Top] [All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Crash in set_cpu_sibling_map() booting Xen 4.6.0 on Fusion

The problem is that the index of the socket_cpumask array is derived via cpu_to_socket() from the APIC ID of the processor in a given socket, but the size of the array is computed based on nr_sockets, which is not necessarily equal to the maximum APIC ID.

Sizing the socket_cpumask to MAX_APICS rather than nr_sockets seems safer, though a bit wasteful. I verified that this change fixes the boot crash with 4 or 8 CPUs on VMware Fusion.

--- a/xen/arch/x86/smpboot.c
+++ b/xen/arch/x86/smpboot.c
@@ -819,7 +819,7 @@ void __init smp_prepare_cpus(unsigned int max_cpus)

  Âset_nr_sockets();

- Â Âsocket_cpumask = xzalloc_array(cpumask_t *, nr_sockets);
+ Â Âsocket_cpumask = xzalloc_array(cpumask_t *, MAX_APICS);
  Âif ( socket_cpumask == NULL ||
     (socket_cpumask[cpu_to_socket(0)] = xzalloc(cpumask_t)) == NULL )
    Âpanic("No memory for socket CPU siblings map");


On Fri, Nov 20, 2015 at 10:53 AM, Ed Swierk <eswierk@xxxxxxxxxxxxxxxxxx> wrote:
I instrumented set_nr_sockets() and smp_store_cpu_info(), and re-ran with varying numbers of CPUs.

With 4 CPUs, nr_sockets=4, so smp_store_cpu_info() exceeds the bounds of the socket_cpumask array when socket=4 or 6.

Loading xen-4.6-amd64.gz... ok
Loading vmlinuz-3.14.51-grsec-dock... ok
Loading initrd.img-3.14.51-grsec-dock... ok
(XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (eswierk@xxxxxxxxxxxxxxxxxx) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov 20 10:07:47 PST 2015
(XEN) Bootloader: SYSLINUX 4.05 20140113
(XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
(XEN) Video information:
(XEN) ÂVGA is text mode 80x25, font 8x16
(XEN) Disc information:
(XEN) ÂFound 1 MBR signatures
(XEN) ÂFound 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) Â0000000000000000 - 000000000009f800 (usable)
(XEN) Â000000000009f800 - 00000000000a0000 (reserved)
(XEN) Â00000000000dc000 - 0000000000100000 (reserved)
(XEN) Â0000000000100000 - 00000000bfef0000 (usable)
(XEN) Â00000000bfef0000 - 00000000bfeff000 (ACPI data)
(XEN) Â00000000bfeff000 - 00000000bff00000 (ACPI NVS)
(XEN) Â00000000bff00000 - 00000000c0000000 (usable)
(XEN) Â00000000f0000000 - 00000000f8000000 (reserved)
(XEN) Â00000000fec00000 - 00000000fec10000 (reserved)
(XEN) Â00000000fee00000 - 00000000fee01000 (reserved)
(XEN) Â00000000fffe0000 - 0000000100000000 (reserved)
(XEN) Â0000000100000000 - 00000001c0000000 (usable)
(XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
(XEN) ACPI: XSDT BFEF030B, 0054 (r1 INTEL Â440BX Â Â 6040000 VMW Â 1324272)
(XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL Â440BX Â Â 6040000 PTL Â Â F4240)
(XEN) ACPI: DSDT BFEF05B1, E8C2 (r1 PTLTD ÂCustom  Â6040000 MSFT Â3000001)
(XEN) ACPI: FACS BFEFFFC0, 0040
(XEN) ACPI: BOOT BFEF0589, 0028 (r1 PTLTD Â$SBFTBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: APIC BFEF050F, 007A (r1 PTLTD Â APIC Â Â6040000 ÂLTP Â Â Â Â0)
(XEN) ACPI: MCFG BFEF04D3, 003C (r1 PTLTD Â$PCITBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: SRAT BFEF03C3, 0110 (r2 VMWARE MEMPLUG Â 6040000 VMW Â Â Â Â 1)
(XEN) ACPI: WAET BFEF039B, 0028 (r1 VMWARE VMW WAET Â6040000 VMW Â Â Â Â 1)
(XEN) System RAM: 6143MB (6291004kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-10000000
(XEN) SRAT: Node 0 PXM 0 10000000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
(XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000f6a80
(XEN) DMI present.
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1008
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
(XEN) ACPI: Â Â Â Â Â Â wakeup_vec[bfefffcc], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
(XEN) Processor #2 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
(XEN) Processor #4 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
(XEN) Processor #6 6:6 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode: ÂFlat. Using 1 I/O APICs
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) CPU0: No MCE banks present. Machine check support disabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2592.620 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
(XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) PCI: MCFG area at f0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) I/O virtualisation disabled
(XEN) smp_store_cpu_info id=0
(XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) set_nr_sockets nr_sockets=4 num_processors=4 disabled_cpus=0 cpus=1
(XEN) Getting VERSION: 50015
(XEN) Getting VERSION: 50015
(XEN) Getting ID: 0
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) ENABLING IO-APIC IRQs
(XEN) Â-> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN) ÂIO-APIC (apicid-pin) 1-0, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #1 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #1......
(XEN) .... register #00: 01000000
(XEN) ....... Â Â: physical APIC id: 01
(XEN) ....... Â Â: Delivery Type: 0
(XEN) ....... Â Â: LTS Â Â Â Â Â: 0
(XEN) .... register #01: 00170011
(XEN) ....... Â Â : max redirection entries: 0017
(XEN) ....... Â Â : PRQ implemented: 0
(XEN) ....... Â Â : IO APIC version: 0011
(XEN) .... register #02: 01000000
(XEN) ....... Â Â : arbitration: 01
(XEN) .... IRQ redirection table:
(XEN) ÂNR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: ÂÂ
(XEN) Â00 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â01 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â28
(XEN) Â02 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF0
(XEN) Â03 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â30
(XEN) Â04 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF1
(XEN) Â05 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â38
(XEN) Â06 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â40
(XEN) Â07 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â48
(XEN) Â08 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â50
(XEN) Â09 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â58
(XEN) Â0a 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â60
(XEN) Â0b 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â68
(XEN) Â0c 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â70
(XEN) Â0d 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â78
(XEN) Â0e 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â88
(XEN) Â0f 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â90
(XEN) Â10 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â11 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â12 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â13 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â14 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â15 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â16 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â17 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ48 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2592.9295 MHz.
(XEN) ..... host bus clock speed is 92.5953 MHz.
(XEN) ..... bus_scale = 0x5ed2
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Allocated console ring of 32 KiB.
(XEN) mwait-idle: MWAIT substates: 0x10
(XEN) mwait-idle: v0.4 model 0x46
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN) Â- APIC TPR shadow
(XEN) Â- Extended Page Tables (EPT)
(XEN) Â- Virtual-Processor Identifiers (VPID)
(XEN) Â- Virtual NMI
(XEN) Â- MSR direct-access bitmap
(XEN) Â- Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) not detected
(XEN) HVM: PVH mode not supported on this platform
(XEN) CPU 0 APIC 0 -> Node 0
(XEN) CPU 1 APIC 2 -> Node 0
(XEN) Booting processor 1/2 eip 8f000
(XEN) Initializing CPU#1
(XEN) masked ExtINT on CPU#1
(XEN) smp_store_cpu_info id=1
(XEN) CPU: Physical Processor ID: 2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU1: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=1 socket=2 socket_cpumask[socket]=0000000000000000
(XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 2 APIC 4 -> Node 0
(XEN) Booting processor 2/4 eip 8f000
(XEN) Initializing CPU#2
(XEN) masked ExtINT on CPU#2
(XEN) smp_store_cpu_info id=2
(XEN) CPU: Physical Processor ID: 4
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU2: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=2 socket=4 socket_cpumask[socket]=ffff8301bd8b5430
(XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 3 APIC 6 -> Node 0
(XEN) Booting processor 3/6 eip 8f000
(XEN) Initializing CPU#3
(XEN) masked ExtINT on CPU#3
(XEN) smp_store_cpu_info id=3
(XEN) CPU: Physical Processor ID: 6
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU3: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=3 socket=6 socket_cpumask[socket]=0000000000000001
(XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) ----[ Xen-4.6.1-pre Âx86_64 Âdebug=y ÂNot tainted ]----
(XEN) CPU: Â Â3
(XEN) RIP: Â Âe008:[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
(XEN) RFLAGS: 0000000000010097 Â CONTEXT: hypervisor
(XEN) rax: 0000000000000001 Â rbx: 0000000000000000 Â rcx: 000000313d58dc80
(XEN) rdx: 0000000000000006  rsi: 000000000000001e  rdi: 0000000000000003
(XEN) rbp: ffff8301bd87fee0 Â rsp: ffff8301bd87fea0 Â r8: Âffff8301bd87fea0
(XEN) r9: Â0000000000000000 Â r10: 0000000000000001 Â r11: 0000000000000001
(XEN) r12: 00000000000000c8 Â r13: 0000000000000003 Â r14: 0000000000000000
(XEN) r15: 0000000000000000  cr0: 000000008005003b  cr4: 00000000001526a0
(XEN) cr3: 00000000bfc9f000 Â cr2: 0000000000000001
(XEN) ds: 0000 Â es: 0000 Â fs: 0000 Â gs: 0000 Â ss: 0000 Â cs: e008
(XEN) Xen stack trace from rsp=ffff8301bd87fea0:
(XEN) Â Â0000000300000000 0000000000000003 ffff8301bd87fee0 0000000000000000
(XEN) Â Â00000000000000c8 0000000000000003 0000000000000000 0000000000000000
(XEN) Â Âffff8301bd87ff10 ffff82d080188fc3 0000000000000001 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000003 ffff8300bfffb000 000000313d58dc80 0000000000000000
(XEN) Xen call trace:
(XEN) Â Â[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
(XEN) Â Â[<ffff82d080188fc3>] start_secondary+0x1fb/0x256
(XEN)Â
(XEN) Pagetable walk from 0000000000000001:
(XEN) ÂL4[0x000] = 00000001bd8ec063 ffffffffffffffff
(XEN) ÂL3[0x000] = 00000001bd8eb063 ffffffffffffffff
(XEN) ÂL2[0x000] = 00000001bd8ea063 ffffffffffffffffÂ
(XEN) ÂL1[0x000] = 0000000000000000 ffffffffffffffff
(XEN)Â
(XEN) ****************************************
(XEN) Panic on CPU 3:
(XEN) FATAL PAGE FAULT
(XEN) [error_code=0002]
(XEN) Faulting linear address: 0000000000000001
(XEN) ****************************************
(XEN)Â
(XEN) Reboot in five seconds...

Similar issue with 8 CPUs.

Loading xen-4.6-amd64.gz... ok
Loading vmlinuz-3.14.51-grsec-dock... ok
Loading initrd.img-3.14.51-grsec-dock... ok
(XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (eswierk@xxxxxxxxxxxxxxxxxx) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov 20 10:07:47 PST 2015
(XEN) Bootloader: SYSLINUX 4.05 20140113
(XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
(XEN) Video information:
(XEN) ÂVGA is text mode 80x25, font 8x16
(XEN) Disc information:
(XEN) ÂFound 1 MBR signatures
(XEN) ÂFound 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) Â0000000000000000 - 000000000009f800 (usable)
(XEN) Â000000000009f800 - 00000000000a0000 (reserved)
(XEN) Â00000000000dc000 - 0000000000100000 (reserved)
(XEN) Â0000000000100000 - 00000000bfef0000 (usable)
(XEN) Â00000000bfef0000 - 00000000bfeff000 (ACPI data)
(XEN) Â00000000bfeff000 - 00000000bff00000 (ACPI NVS)
(XEN) Â00000000bff00000 - 00000000c0000000 (usable)
(XEN) Â00000000f0000000 - 00000000f8000000 (reserved)
(XEN) Â00000000fec00000 - 00000000fec10000 (reserved)
(XEN) Â00000000fee00000 - 00000000fee01000 (reserved)
(XEN) Â00000000fffe0000 - 0000000100000000 (reserved)
(XEN) Â0000000100000000 - 00000001c0000000 (usable)
(XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
(XEN) ACPI: XSDT BFEF00E7, 0054 (r1 INTEL Â440BX Â Â 6040000 VMW Â 1324272)
(XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL Â440BX Â Â 6040000 PTL Â Â F4240)
(XEN) ACPI: DSDT BFEF0405, EA6E (r1 PTLTD ÂCustom  Â6040000 MSFT Â3000001)
(XEN) ACPI: FACS BFEFFFC0, 0040
(XEN) ACPI: BOOT BFEF03DD, 0028 (r1 PTLTD Â$SBFTBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: APIC BFEF032B, 00B2 (r1 PTLTD Â APIC Â Â6040000 ÂLTP Â Â Â Â0)
(XEN) ACPI: MCFG BFEF02EF, 003C (r1 PTLTD Â$PCITBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: SRAT BFEF019F, 0150 (r2 VMWARE MEMPLUG Â 6040000 VMW Â Â Â Â 1)
(XEN) ACPI: WAET BFEF0177, 0028 (r1 VMWARE VMW WAET Â6040000 VMW Â Â Â Â 1)
(XEN) System RAM: 6143MB (6291004kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 08 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 0a -> Node 0
(XEN) SRAT: PXM 0 -> APIC 0c -> Node 0
(XEN) SRAT: PXM 0 -> APIC 0e -> Node 0
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-10000000
(XEN) SRAT: Node 0 PXM 0 10000000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
(XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000f6a80
(XEN) DMI present.
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1008
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
(XEN) ACPI: Â Â Â Â Â Â wakeup_vec[bfefffcc], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
(XEN) Processor #2 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
(XEN) Processor #4 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
(XEN) Processor #6 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
(XEN) Processor #8 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
(XEN) Processor #10 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
(XEN) Processor #12 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
(XEN) Processor #14 6:6 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode: ÂFlat. Using 1 I/O APICs
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) CPU0: No MCE banks present. Machine check support disabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2592.575 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
(XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) PCI: MCFG area at f0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) I/O virtualisation disabled
(XEN) smp_store_cpu_info id=0
(XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) set_nr_sockets nr_sockets=8 num_processors=8 disabled_cpus=0 cpus=1
(XEN) Getting VERSION: 50015
(XEN) Getting VERSION: 50015
(XEN) Getting ID: 0
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) ENABLING IO-APIC IRQs
(XEN) Â-> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN) ÂIO-APIC (apicid-pin) 1-0, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #1 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #1......
(XEN) .... register #00: 01000000
(XEN) ....... Â Â: physical APIC id: 01
(XEN) ....... Â Â: Delivery Type: 0
(XEN) ....... Â Â: LTS Â Â Â Â Â: 0
(XEN) .... register #01: 00170011
(XEN) ....... Â Â : max redirection entries: 0017
(XEN) ....... Â Â : PRQ implemented: 0
(XEN) ....... Â Â : IO APIC version: 0011
(XEN) .... register #02: 01000000
(XEN) ....... Â Â : arbitration: 01
(XEN) .... IRQ redirection table:
(XEN) ÂNR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: ÂÂ
(XEN) Â00 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â01 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â28
(XEN) Â02 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF0
(XEN) Â03 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â30
(XEN) Â04 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF1
(XEN) Â05 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â38
(XEN) Â06 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â40
(XEN) Â07 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â48
(XEN) Â08 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â50
(XEN) Â09 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â58
(XEN) Â0a 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â60
(XEN) Â0b 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â68
(XEN) Â0c 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â70
(XEN) Â0d 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â78
(XEN) Â0e 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â88
(XEN) Â0f 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â90
(XEN) Â10 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â11 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â12 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â13 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â14 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â15 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â16 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â17 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ48 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2592.9336 MHz.
(XEN) ..... host bus clock speed is 92.6030 MHz.
(XEN) ..... bus_scale = 0x5ed5
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Allocated console ring of 64 KiB.
(XEN) mwait-idle: MWAIT substates: 0x10
(XEN) mwait-idle: v0.4 model 0x46
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN) Â- APIC TPR shadow
(XEN) Â- Extended Page Tables (EPT)
(XEN) Â- Virtual-Processor Identifiers (VPID)
(XEN) Â- Virtual NMI
(XEN) Â- MSR direct-access bitmap
(XEN) Â- Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) not detected
(XEN) HVM: PVH mode not supported on this platform
(XEN) CPU 0 APIC 0 -> Node 0
(XEN) CPU 1 APIC 2 -> Node 0
(XEN) Booting processor 1/2 eip 8f000
(XEN) Initializing CPU#1
(XEN) masked ExtINT on CPU#1
(XEN) smp_store_cpu_info id=1
(XEN) CPU: Physical Processor ID: 2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU1: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=1 socket=2 socket_cpumask[socket]=0000000000000000
(XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 2 APIC 4 -> Node 0
(XEN) Booting processor 2/4 eip 8f000
(XEN) Initializing CPU#2
(XEN) masked ExtINT on CPU#2
(XEN) smp_store_cpu_info id=2
(XEN) CPU: Physical Processor ID: 4
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU2: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=2 socket=4 socket_cpumask[socket]=0000000000000000
(XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 3 APIC 6 -> Node 0
(XEN) Booting processor 3/6 eip 8f000
(XEN) Initializing CPU#3
(XEN) masked ExtINT on CPU#3
(XEN) smp_store_cpu_info id=3
(XEN) CPU: Physical Processor ID: 6
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU3: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=3 socket=6 socket_cpumask[socket]=0000000000000000
(XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 4 APIC 8 -> Node 0
(XEN) Booting processor 4/8 eip 8f000
(XEN) Initializing CPU#4
(XEN) masked ExtINT on CPU#4
(XEN) smp_store_cpu_info id=4
(XEN) CPU: Physical Processor ID: 8
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU4: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=4 socket=8 socket_cpumask[socket]=ffff8301bd865430
(XEN) CPU4: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 5 APIC 10 -> Node 0
(XEN) Booting processor 5/10 eip 8f000
(XEN) Initializing CPU#5
(XEN) masked ExtINT on CPU#5
(XEN) smp_store_cpu_info id=5
(XEN) CPU: Physical Processor ID: 10
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU5: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=5 socket=10 socket_cpumask[socket]=0000000000000001
(XEN) CPU5: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) ----[ Xen-4.6.1-pre Âx86_64 Âdebug=y ÂNot tainted ]----
(XEN) CPU: Â Â5
(XEN) RIP: Â Âe008:[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
(XEN) RFLAGS: 0000000000010093 Â CONTEXT: hypervisor
(XEN) rax: 0000000000000001 Â rbx: 0000000000000000 Â rcx: 000000313d571c80
(XEN) rdx: 000000000000000a  rsi: 0000000000000026  rdi: 0000000000000005
(XEN) rbp: ffff8301bd8a7ee0 Â rsp: ffff8301bd8a7ea0 Â r8: Âffff8301bd8a7ea0
(XEN) r9: Â0000000000000000 Â r10: 0000000000000001 Â r11: 0000000000000001
(XEN) r12: 00000000000000c8 Â r13: 0000000000000005 Â r14: 0000000000000000
(XEN) r15: 0000000000000000  cr0: 000000008005003b  cr4: 00000000001526a0
(XEN) cr3: 00000000bfc9f000 Â cr2: 0000000000000001
(XEN) ds: 0000 Â es: 0000 Â fs: 0000 Â gs: 0000 Â ss: 0000 Â cs: e008
(XEN) Xen stack trace from rsp=ffff8301bd8a7ea0:
(XEN) Â Â0000000500000000 0000000000000005 ffff8301bd8a7ee0 0000000000000000
(XEN) Â Â00000000000000c8 0000000000000005 0000000000000000 0000000000000000
(XEN) Â Âffff8301bd8a7f10 ffff82d080188fc3 0000000000000001 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000000 0000000000000000 0000000000000000 0000000000000000
(XEN) Â Â0000000000000005 ffff8300bfff9000 000000313d571c80 0000000000000000
(XEN) Xen call trace:
(XEN) Â Â[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
(XEN) Â Â[<ffff82d080188fc3>] start_secondary+0x1fb/0x256
(XEN)Â
(XEN) Pagetable walk from 0000000000000001:
(XEN) ÂL4[0x000] = 00000001bd8ec063 ffffffffffffffff
(XEN) ÂL3[0x000] = 00000001bd8eb063 ffffffffffffffff
(XEN) ÂL2[0x000] = 00000001bd8ea063 ffffffffffffffffÂ
(XEN) ÂL1[0x000] = 0000000000000000 ffffffffffffffff
(XEN)Â
(XEN) ****************************************
(XEN) Panic on CPU 5:
(XEN) FATAL PAGE FAULT
(XEN) [error_code=0002]
(XEN) Faulting linear address: 0000000000000001
(XEN) ****************************************
(XEN)Â
(XEN) Reboot in five seconds...
(XEN) Resetting with ACPI MEMORY or I/O RESET_REG.

With 3 CPUs the situation is completely different. nr_sockets=1, but socket is always 0 in smp_store_cpu_info().

Loading xen-4.6-amd64.gz... ok
Loading vmlinuz-3.14.51-grsec-dock... ok
Loading initrd.img-3.14.51-grsec-dock... ok
(XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (eswierk@xxxxxxxxxxxxxxxxxx) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov 20 10:07:47 PST 2015
(XEN) Bootloader: SYSLINUX 4.05 20140113
(XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
(XEN) Video information:
(XEN) ÂVGA is text mode 80x25, font 8x16
(XEN) Disc information:
(XEN) ÂFound 1 MBR signatures
(XEN) ÂFound 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) Â0000000000000000 - 000000000009f800 (usable)
(XEN) Â000000000009f800 - 00000000000a0000 (reserved)
(XEN) Â00000000000dc000 - 0000000000100000 (reserved)
(XEN) Â0000000000100000 - 00000000bfef0000 (usable)
(XEN) Â00000000bfef0000 - 00000000bfeff000 (ACPI data)
(XEN) Â00000000bfeff000 - 00000000bff00000 (ACPI NVS)
(XEN) Â00000000bff00000 - 00000000c0000000 (usable)
(XEN) Â00000000f0000000 - 00000000f8000000 (reserved)
(XEN) Â00000000fec00000 - 00000000fec10000 (reserved)
(XEN) Â00000000fee00000 - 00000000fee01000 (reserved)
(XEN) Â00000000fffe0000 - 0000000100000000 (reserved)
(XEN) Â0000000100000000 - 00000001c0000000 (usable)
(XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
(XEN) ACPI: XSDT BFEF0396, 0054 (r1 INTEL Â440BX Â Â 6040000 VMW Â 1324272)
(XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL Â440BX Â Â 6040000 PTL Â Â F4240)
(XEN) ACPI: DSDT BFEF061E, E855 (r1 PTLTD ÂCustom  Â6040000 MSFT Â3000001)
(XEN) ACPI: FACS BFEFFFC0, 0040
(XEN) ACPI: BOOT BFEF05F6, 0028 (r1 PTLTD Â$SBFTBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: APIC BFEF058A, 006C (r1 PTLTD Â APIC Â Â6040000 ÂLTP Â Â Â Â0)
(XEN) ACPI: MCFG BFEF054E, 003C (r1 PTLTD Â$PCITBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: SRAT BFEF044E, 0100 (r2 VMWARE MEMPLUG Â 6040000 VMW Â Â Â Â 1)
(XEN) ACPI: WAET BFEF0426, 0028 (r1 VMWARE VMW WAET Â6040000 VMW Â Â Â Â 1)
(XEN) System RAM: 6143MB (6291004kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-10000000
(XEN) SRAT: Node 0 PXM 0 10000000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
(XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000f6a80
(XEN) DMI present.
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1008
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
(XEN) ACPI: Â Â Â Â Â Â wakeup_vec[bfefffcc], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XEN) Processor #1 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 6:6 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x03] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 3, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode: ÂFlat. Using 1 I/O APICs
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 3 CPUs (0 hotplug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) IRQ limits: 24 GSI, 568 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) CPU0: No MCE banks present. Machine check support disabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2592.635 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
(XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) PCI: MCFG area at f0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) I/O virtualisation disabled
(XEN) smp_store_cpu_info id=0
(XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) set_nr_sockets nr_sockets=1 num_processors=3 disabled_cpus=0 cpus=3
(XEN) Getting VERSION: 50015
(XEN) Getting VERSION: 50015
(XEN) Getting ID: 0
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) ENABLING IO-APIC IRQs
(XEN) Â-> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN) ÂIO-APIC (apicid-pin) 3-0, 3-16, 3-17, 3-18, 3-19, 3-20, 3-21, 3-22, 3-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #3 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #3......
(XEN) .... register #00: 03000000
(XEN) ....... Â Â: physical APIC id: 03
(XEN) ....... Â Â: Delivery Type: 0
(XEN) ....... Â Â: LTS Â Â Â Â Â: 0
(XEN) .... register #01: 00170011
(XEN) ....... Â Â : max redirection entries: 0017
(XEN) ....... Â Â : PRQ implemented: 0
(XEN) ....... Â Â : IO APIC version: 0011
(XEN) .... register #02: 03000000
(XEN) ....... Â Â : arbitration: 03
(XEN) .... IRQ redirection table:
(XEN) ÂNR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: ÂÂ
(XEN) Â00 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â01 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â28
(XEN) Â02 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF0
(XEN) Â03 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â30
(XEN) Â04 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF1
(XEN) Â05 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â38
(XEN) Â06 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â40
(XEN) Â07 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â48
(XEN) Â08 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â50
(XEN) Â09 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â58
(XEN) Â0a 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â60
(XEN) Â0b 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â68
(XEN) Â0c 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â70
(XEN) Â0d 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â78
(XEN) Â0e 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â88
(XEN) Â0f 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â90
(XEN) Â10 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â11 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â12 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â13 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â14 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â15 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â16 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â17 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ48 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2592.9209 MHz.
(XEN) ..... host bus clock speed is 92.5952 MHz.
(XEN) ..... bus_scale = 0x5ed2
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Allocated console ring of 32 KiB.
(XEN) mwait-idle: MWAIT substates: 0x10
(XEN) mwait-idle: v0.4 model 0x46
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN) Â- APIC TPR shadow
(XEN) Â- Extended Page Tables (EPT)
(XEN) Â- Virtual-Processor Identifiers (VPID)
(XEN) Â- Virtual NMI
(XEN) Â- MSR direct-access bitmap
(XEN) Â- Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) not detected
(XEN) HVM: PVH mode not supported on this platform
(XEN) CPU 0 APIC 0 -> Node 0
(XEN) CPU 1 APIC 1 -> Node 0
(XEN) Booting processor 1/1 eip 8f000
(XEN) Initializing CPU#1
(XEN) masked ExtINT on CPU#1
(XEN) smp_store_cpu_info id=1
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 1
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU1: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=1 socket=0 socket_cpumask[socket]=ffff8301bd8e5460
(XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 2 APIC 2 -> Node 0
(XEN) Booting processor 2/2 eip 8f000
(XEN) Initializing CPU#2
(XEN) masked ExtINT on CPU#2
(XEN) smp_store_cpu_info id=2
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU2: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=2 socket=0 socket_cpumask[socket]=ffff8301bd8e5460
(XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) Brought up 3 CPUs
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) Dom0 has maximum 408 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0x68f6d8
(XEN) elf_parse_binary: phdr: paddr=0x1690000 memsz=0x409000
(XEN) elf_parse_binary: phdr: paddr=0x1a99000 memsz=0x32c120
(XEN) elf_parse_binary: phdr: paddr=0x1dc6000 memsz=0x1000
(XEN) elf_parse_binary: phdr: paddr=0x1dc7000 memsz=0x1d13c0
(XEN) elf_parse_binary: phdr: paddr=0x1f99000 memsz=0x53000
(XEN) elf_parse_binary: phdr: paddr=0x1fec000 memsz=0x1250
(XEN) elf_parse_binary: phdr: paddr=0x1fee000 memsz=0x1012000
(XEN) elf_parse_binary: memory: 0x1000000 -> 0x3000000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff81f991f0
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000
(XEN) elf_xen_parse_note: FEATURES = "!writable_page_tables|pae_pgdir_above_4gb"
(XEN) elf_xen_parse_note: SUPPORTED_FEATURES = 0x801
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)   virt_base    Â= 0xffffffff80000000
(XEN) Â Â elf_paddr_offset = 0x0
(XEN)   virt_offset   Â= 0xffffffff80000000
(XEN)   virt_kstart   Â= 0xffffffff81000000
(XEN)   virt_kend    Â= 0xffffffff83000000
(XEN)   virt_entry    = 0xffffffff81f991f0
(XEN)   p2m_base     = 0xffffffffffffffff
(XEN) ÂXen Âkernel: 64-bit, lsb, compat32
(XEN) ÂDom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x3000000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) ÂDom0 alloc.: Â 00000001b4000000->00000001b8000000 (504532 pages to be allocated)
(XEN) ÂInit. ramdisk: 00000001bf2d4000->00000001bffff800
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) ÂLoaded kernel: ffffffff81000000->ffffffff83000000
(XEN) ÂInit. ramdisk: ffffffff83000000->ffffffff83d2b800
(XEN) ÂPhys-Mach map: ffffffff83d2c000->ffffffff8412c000
(XEN) ÂStart info: Â Âffffffff8412c000->ffffffff8412c4b4
(XEN) ÂPage tables: Â ffffffff8412d000->ffffffff84152000
(XEN) ÂBoot stack: Â Âffffffff84152000->ffffffff84153000
(XEN) ÂTOTAL: Â Â Â Â ffffffff80000000->ffffffff84400000
(XEN) ÂENTRY ADDRESS: ffffffff81f991f0
(XEN) Dom0 has maximum 3 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff8168f6d8
(XEN) elf_load_binary: phdr 1 at 0xffffffff81690000 -> 0xffffffff81a99000
(XEN) elf_load_binary: phdr 2 at 0xffffffff81a99000 -> 0xffffffff81dc5120
(XEN) elf_load_binary: phdr 3 at 0xffffffff81dc6000 -> 0xffffffff81dc7000
(XEN) elf_load_binary: phdr 4 at 0xffffffff81dc7000 -> 0xffffffff81f983c0
(XEN) elf_load_binary: phdr 5 at 0xffffffff81f99000 -> 0xffffffff81fec000
(XEN) elf_load_binary: phdr 6 at 0xffffffff81fec000 -> 0xffffffff81fed250
(XEN) elf_load_binary: phdr 7 at 0xffffffff81fee000 -> 0xffffffff820ce000
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 308kB init memory.
mapping kernel into physical memory
about to get started...

Similarly with 6 CPUs,Ânr_sockets=2, and socket is always 0 or 1 in smp_store_cpu_info().

Loading xen-4.6-amd64.gz... ok
Loading vmlinuz-3.14.51-grsec-dock... ok
Loading initrd.img-3.14.51-grsec-dock... ok
(XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (eswierk@xxxxxxxxxxxxxxxxxx) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov 20 10:07:47 PST 2015
(XEN) Bootloader: SYSLINUX 4.05 20140113
(XEN) Command line: console=com1,vga com1=115200 no-bootscrub dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
(XEN) Video information:
(XEN) ÂVGA is text mode 80x25, font 8x16
(XEN) Disc information:
(XEN) ÂFound 1 MBR signatures
(XEN) ÂFound 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) Â0000000000000000 - 000000000009f800 (usable)
(XEN) Â000000000009f800 - 00000000000a0000 (reserved)
(XEN) Â00000000000dc000 - 0000000000100000 (reserved)
(XEN) Â0000000000100000 - 00000000bfef0000 (usable)
(XEN) Â00000000bfef0000 - 00000000bfeff000 (ACPI data)
(XEN) Â00000000bfeff000 - 00000000bff00000 (ACPI NVS)
(XEN) Â00000000bff00000 - 00000000c0000000 (usable)
(XEN) Â00000000f0000000 - 00000000f8000000 (reserved)
(XEN) Â00000000fec00000 - 00000000fec10000 (reserved)
(XEN) Â00000000fee00000 - 00000000fee01000 (reserved)
(XEN) Â00000000fffe0000 - 0000000100000000 (reserved)
(XEN) Â0000000100000000 - 00000001c0000000 (usable)
(XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
(XEN) ACPI: XSDT BFEF01F9, 0054 (r1 INTEL Â440BX Â Â 6040000 VMW Â 1324272)
(XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL Â440BX Â Â 6040000 PTL Â Â F4240)
(XEN) ACPI: DSDT BFEF04DB, E998 (r1 PTLTD ÂCustom  Â6040000 MSFT Â3000001)
(XEN) ACPI: FACS BFEFFFC0, 0040
(XEN) ACPI: BOOT BFEF04B3, 0028 (r1 PTLTD Â$SBFTBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: APIC BFEF041D, 0096 (r1 PTLTD Â APIC Â Â6040000 ÂLTP Â Â Â Â0)
(XEN) ACPI: MCFG BFEF03E1, 003C (r1 PTLTD Â$PCITBL$ Â6040000 ÂLTP Â Â Â Â1)
(XEN) ACPI: SRAT BFEF02B1, 0130 (r2 VMWARE MEMPLUG Â 6040000 VMW Â Â Â Â 1)
(XEN) ACPI: WAET BFEF0289, 0028 (r1 VMWARE VMW WAET Â6040000 VMW Â Â Â Â 1)
(XEN) System RAM: 6143MB (6291004kB)
(XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 05 -> Node 0
(XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
(XEN) SRAT: Node 0 PXM 0 0-a0000
(XEN) SRAT: Node 0 PXM 0 100000-10000000
(XEN) SRAT: Node 0 PXM 0 10000000-c0000000
(XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
(XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
(XEN) NUMA: Using 8 for the hash shift.
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000f6a80
(XEN) DMI present.
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x1008
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
(XEN) ACPI: Â Â Â Â Â Â wakeup_vec[bfefffcc], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Processor #0 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XEN) Processor #1 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) Processor #2 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) Processor #4 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x05] enabled)
(XEN) Processor #5 6:6 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x06] enabled)
(XEN) Processor #6 6:6 APIC version 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x03] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 3, version 17, address 0xfec00000, GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) Enabling APIC mode: ÂFlat. Using 1 I/O APICs
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 6 CPUs (0 hotplug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) IRQ limits: 24 GSI, 1144 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_supports_eim.
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) CPU0: No MCE banks present. Machine check support disabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2592.566 MHz processor.
(XEN) Initing memory sharing.
(XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
(XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
(XEN) PCI: MCFG area at f0000000 reserved in E820
(XEN) PCI: Using MCFG for segment 0000 bus 00-7f
(XEN) I/O virtualisation disabled
(XEN) smp_store_cpu_info id=0
(XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) set_nr_sockets nr_sockets=2 num_processors=6 disabled_cpus=0 cpus=3
(XEN) Getting VERSION: 50015
(XEN) Getting VERSION: 50015
(XEN) Getting ID: 0
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) ENABLING IO-APIC IRQs
(XEN) Â-> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN) ÂIO-APIC (apicid-pin) 3-0, 3-16, 3-17, 3-18, 3-19, 3-20, 3-21, 3-22, 3-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #3 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #3......
(XEN) .... register #00: 03000000
(XEN) ....... Â Â: physical APIC id: 03
(XEN) ....... Â Â: Delivery Type: 0
(XEN) ....... Â Â: LTS Â Â Â Â Â: 0
(XEN) .... register #01: 00170011
(XEN) ....... Â Â : max redirection entries: 0017
(XEN) ....... Â Â : PRQ implemented: 0
(XEN) ....... Â Â : IO APIC version: 0011
(XEN) .... register #02: 03000000
(XEN) ....... Â Â : arbitration: 03
(XEN) .... IRQ redirection table:
(XEN) ÂNR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect: ÂÂ
(XEN) Â00 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â01 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â28
(XEN) Â02 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF0
(XEN) Â03 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â30
(XEN) Â04 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â ÂF1
(XEN) Â05 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â38
(XEN) Â06 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â40
(XEN) Â07 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â48
(XEN) Â08 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â50
(XEN) Â09 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â58
(XEN) Â0a 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â60
(XEN) Â0b 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â68
(XEN) Â0c 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â70
(XEN) Â0d 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â78
(XEN) Â0e 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â88
(XEN) Â0f 001 01 Â0 Â Â0 Â Â0 Â 0 Â 0 Â Â1 Â Â1 Â Â90
(XEN) Â10 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â11 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â12 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â13 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â14 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â15 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â16 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Â17 000 00 Â1 Â Â0 Â Â0 Â 0 Â 0 Â Â0 Â Â0 Â Â00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ48 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2592.9460 MHz.
(XEN) ..... host bus clock speed is 92.5859 MHz.
(XEN) ..... bus_scale = 0x5ed0
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Allocated console ring of 64 KiB.
(XEN) mwait-idle: MWAIT substates: 0x10
(XEN) mwait-idle: v0.4 model 0x46
(XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
(XEN) VMX: Supported advanced features:
(XEN) Â- APIC TPR shadow
(XEN) Â- Extended Page Tables (EPT)
(XEN) Â- Virtual-Processor Identifiers (VPID)
(XEN) Â- Virtual NMI
(XEN) Â- MSR direct-access bitmap
(XEN) Â- Unrestricted Guest
(XEN) HVM: ASIDs enabled.
(XEN) HVM: VMX enabled
(XEN) HVM: Hardware Assisted Paging (HAP) not detected
(XEN) HVM: PVH mode not supported on this platform
(XEN) CPU 0 APIC 0 -> Node 0
(XEN) CPU 1 APIC 1 -> Node 0
(XEN) Booting processor 1/1 eip 8f000
(XEN) Initializing CPU#1
(XEN) masked ExtINT on CPU#1
(XEN) smp_store_cpu_info id=1
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 1
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU1: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=1 socket=0 socket_cpumask[socket]=ffff8301bd84d460
(XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 2 APIC 2 -> Node 0
(XEN) Booting processor 2/2 eip 8f000
(XEN) Initializing CPU#2
(XEN) masked ExtINT on CPU#2
(XEN) smp_store_cpu_info id=2
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU2: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=2 socket=0 socket_cpumask[socket]=ffff8301bd84d460
(XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 3 APIC 4 -> Node 0
(XEN) Booting processor 3/4 eip 8f000
(XEN) Initializing CPU#3
(XEN) masked ExtINT on CPU#3
(XEN) smp_store_cpu_info id=3
(XEN) CPU: Physical Processor ID: 1
(XEN) CPU: Processor Core ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU3: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=3 socket=1 socket_cpumask[socket]=0000000000000000
(XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 4 APIC 5 -> Node 0
(XEN) Booting processor 4/5 eip 8f000
(XEN) Initializing CPU#4
(XEN) masked ExtINT on CPU#4
(XEN) smp_store_cpu_info id=4
(XEN) CPU: Physical Processor ID: 1
(XEN) CPU: Processor Core ID: 1
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU4: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=4 socket=1 socket_cpumask[socket]=ffff8301bd84df90
(XEN) CPU4: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) CPU 5 APIC 6 -> Node 0
(XEN) Booting processor 5/6 eip 8f000
(XEN) Initializing CPU#5
(XEN) masked ExtINT on CPU#5
(XEN) smp_store_cpu_info id=5
(XEN) CPU: Physical Processor ID: 1
(XEN) CPU: Processor Core ID: 2
(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
(XEN) CPU: L2 cache: 256K
(XEN) CPU: L3 cache: 6144K
(XEN) CPU5: No MCE banks present. Machine check support disabled
(XEN) smp_store_cpu_info id=5 socket=1 socket_cpumask[socket]=ffff8301bd84df90
(XEN) CPU5: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
(XEN) Brought up 6 CPUs
(XEN) ACPI sleep modes: S3
(XEN) VPMU: disabled
(XEN) Dom0 has maximum 600 PIRQs
(XEN) NX (Execute Disable) protection active
(XEN) *** LOADING DOMAIN 0 ***
(XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0x68f6d8
(XEN) elf_parse_binary: phdr: paddr=0x1690000 memsz=0x409000
(XEN) elf_parse_binary: phdr: paddr=0x1a99000 memsz=0x32c120
(XEN) elf_parse_binary: phdr: paddr=0x1dc6000 memsz=0x1000
(XEN) elf_parse_binary: phdr: paddr=0x1dc7000 memsz=0x1d13c0
(XEN) elf_parse_binary: phdr: paddr=0x1f99000 memsz=0x53000
(XEN) elf_parse_binary: phdr: paddr=0x1fec000 memsz=0x1250
(XEN) elf_parse_binary: phdr: paddr=0x1fee000 memsz=0x1012000
(XEN) elf_parse_binary: memory: 0x1000000 -> 0x3000000
(XEN) elf_xen_parse_note: GUEST_OS = "linux"
(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
(XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
(XEN) elf_xen_parse_note: ENTRY = 0xffffffff81f991f0
(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000
(XEN) elf_xen_parse_note: FEATURES = "!writable_page_tables|pae_pgdir_above_4gb"
(XEN) elf_xen_parse_note: SUPPORTED_FEATURES = 0x801
(XEN) elf_xen_parse_note: PAE_MODE = "yes"
(XEN) elf_xen_parse_note: LOADER = "generic"
(XEN) elf_xen_parse_note: unknown xen elf note (0xd)
(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
(XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
(XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
(XEN) elf_xen_addr_calc_check: addresses:
(XEN)   virt_base    Â= 0xffffffff80000000
(XEN) Â Â elf_paddr_offset = 0x0
(XEN)   virt_offset   Â= 0xffffffff80000000
(XEN)   virt_kstart   Â= 0xffffffff81000000
(XEN)   virt_kend    Â= 0xffffffff83000000
(XEN)   virt_entry    = 0xffffffff81f991f0
(XEN)   p2m_base     = 0xffffffffffffffff
(XEN) ÂXen Âkernel: 64-bit, lsb, compat32
(XEN) ÂDom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x3000000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) ÂDom0 alloc.: Â 00000001b4000000->00000001b8000000 (504532 pages to be allocated)
(XEN) ÂInit. ramdisk: 00000001bf2d4000->00000001bffff800
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) ÂLoaded kernel: ffffffff81000000->ffffffff83000000
(XEN) ÂInit. ramdisk: ffffffff83000000->ffffffff83d2b800
(XEN) ÂPhys-Mach map: ffffffff83d2c000->ffffffff8412c000
(XEN) ÂStart info: Â Âffffffff8412c000->ffffffff8412c4b4
(XEN) ÂPage tables: Â ffffffff8412d000->ffffffff84152000
(XEN) ÂBoot stack: Â Âffffffff84152000->ffffffff84153000
(XEN) ÂTOTAL: Â Â Â Â ffffffff80000000->ffffffff84400000
(XEN) ÂENTRY ADDRESS: ffffffff81f991f0
(XEN) Dom0 has maximum 6 VCPUs
(XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff8168f6d8
(XEN) elf_load_binary: phdr 1 at 0xffffffff81690000 -> 0xffffffff81a99000
(XEN) elf_load_binary: phdr 2 at 0xffffffff81a99000 -> 0xffffffff81dc5120
(XEN) elf_load_binary: phdr 3 at 0xffffffff81dc6000 -> 0xffffffff81dc7000
(XEN) elf_load_binary: phdr 4 at 0xffffffff81dc7000 -> 0xffffffff81f983c0
(XEN) elf_load_binary: phdr 5 at 0xffffffff81f99000 -> 0xffffffff81fec000
(XEN) elf_load_binary: phdr 6 at 0xffffffff81fec000 -> 0xffffffff81fed250
(XEN) elf_load_binary: phdr 7 at 0xffffffff81fee000 -> 0xffffffff820ce000
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 308kB init memory.
mapping kernel into physical memory
about to get started...

So it looks like for power-of-2 CPUs, Fusion is providing a separate socket per CPU, numbered 0, 2, 4, ...

For multiple-of-3 CPUs, Fusion is providing a socket for every 3 CPUs, numbered 0, 1, ...

--Ed


On Fri, Nov 20, 2015 at 2:25 AM, Jan Beulich <JBeulich@xxxxxxxx> wrote:
>>> On 20.11.15 at 02:22, <eswierk@xxxxxxxxxxxxxxxxxx> wrote:
> (XEN) ----[ Xen-4.6.1-pre x86_64 debug=n Not tainted ]----
> (XEN) CPU:Â Â 3
> (XEN) RIP:Â Â e008:[<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330
> (XEN) RFLAGS: 0000000000010006Â ÂCONTEXT: hypervisor
> (XEN) rax: 0000000000000001Â Ârbx: 0000000000000000Â Ârcx: 000000313d5b4080
> (XEN) rdx: 0000000000000006Â Ârsi: 0000000000000000Â Ârdi: 0000000000000003
> (XEN) rbp: 0000000000000300Â Ârsp: ffff8301bd87fe90Â Âr8:Â ffff8301bd878000
> (XEN) r9:Â 000000313d5b4080Â Âr10: 0000000000000001Â Âr11: 0000000000000001
> (XEN) r12: ffff82d0802fd500Â Âr13: 0000000000000000Â Âr14: 0000000000000000
> (XEN) r15: 0000000000000003 Âcr0: 000000008005003b Âcr4: 00000000001526a0
> (XEN) cr3: 00000000bfc75000Â Âcr2: 0000000000000001
> (XEN) ds: 0000Â Âes: 0000Â Âfs: 0000Â Âgs: 0000Â Âss: 0000Â Âcs: e008
> (XEN) Xen stack trace from rsp=ffff8301bd87fe90:
> (XEN)Â Â 00000003802fd800 0000000000000018 0000000000000000 0000010000000000
> (XEN)Â Â ffff82d0802fd800 0000000000000000 00000000000000c8 0000000000000003
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 ffff82d0801834dc
> (XEN)Â Â 0000000000000000 0000000000000001 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> (XEN)Â Â 0000000000000000 0000000000000000 0000000000000003 ffff8300bfafc000
> (XEN)Â Â 000000313d5b4080 0000000000000000
> (XEN) Xen call trace:
> (XEN)Â Â [<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330
> (XEN)Â Â [<ffff82d0801834dc>] start_secondary+0x1bc/0x250
> (XEN)
> (XEN) Pagetable walk from 0000000000000001:
> (XEN)Â L4[0x000] = 00000001bd8f0063 ffffffffffffffff
> (XEN)Â L3[0x000] = 00000001bd8ef063 ffffffffffffffff
> (XEN)Â L2[0x000] = 00000001bd8ee063 ffffffffffffffff
> (XEN)Â L1[0x000] = 0000000000000000 ffffffffffffffff
> (XEN)
> (XEN) ****************************************
> (XEN) Panic on CPU 3:
> (XEN) FATAL PAGE FAULT
> (XEN) [error_code=0002]
> (XEN) Faulting linear address: 0000000000000001
> (XEN) ****************************************
> (XEN)
> (XEN) Reboot in five seconds...
>
> set_cpu_sibling_map+0x3f is the second cpumask_set_cpu() call in
> set_cpu_sibling_map():
> http://xenbits.xen.org/gitweb/?p=xen.git;a=blob;f=xen/arch/x86/smpboot.c;h=0
> 94699286f4f6962942024ec8b2b24c7b7996cc0;hb=78833c04250416f1870c458309d3ac0e5c
> f915fd#l261

I suppose cpu_to_socket(cpu) returns a value for which the
socket_cpumask[] entry didn't get set up yet. But to prove that,
we'd need to see the disassembly around the code location
above, to be able to associate register values with variables.

If that's the case, then I'd further guess that the CPUID
information provided by Fusion isn't exactly as one would expect
on real hardware. Whether we need to fix something, or can
work around a quirk of theirs depends on the exact nature of
the issue. Instrumenting code populating socket_cpumask[]
would be a good first step.

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel

 

©2013 Xen Project, A Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation.
Xen Project is a trademark of The Linux Foundation.

Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.