Re: [Xen-devel] PVH dom0 construction timeout

[Andrew Cooper <andrew.cooper3@xxxxxxxxxx>]

On 02/03/2020 12:19, Roger Pau Monné wrote:
> On Mon, Mar 02, 2020 at 11:45:26AM +0000, Andrew Cooper wrote:
>> On 28/02/2020 21:08, Andrew Cooper wrote:
>>> It turns out that PVH dom0 construction doesn't work so well on a
>>> 2-socket Rome system...
>> With the softirq fix in place, here are the differences in construction
>> between PV and PVH along with timestamps.
>>
>> (XEN) [   30.856178] NX (Execute Disable) protection active
>> (XEN) [   30.906155] *** Building a PV Dom0 ***
>> (XEN) [   31.153853] ELF: phdr: paddr=0x1000000 memsz=0xeef000
>>
>> (XEN) [   27.588081] NX (Execute Disable) protection active
>> (XEN) [   27.633081] *** Building a PVH Dom0 ***
>> (XEN) [   33.524345] Dom0 memory allocation stats:
>> (XEN) [   33.568697] order  0 allocations: 2
>> (XEN) [   33.612341] order  1 allocations: 1
>> (XEN) [   33.655544] order  2 allocations: 5
>> (XEN) [   33.698344] order  3 allocations: 5
>> (XEN) [   33.740650] order  4 allocations: 2
>> (XEN) [   33.782736] order  5 allocations: 5
>> (XEN) [   33.824295] order  6 allocations: 4
>> (XEN) [   33.865423] order  7 allocations: 4
>> (XEN) [   33.906237] order  8 allocations: 4
>> (XEN) [   33.946560] order  9 allocations: 4
>> (XEN) [   33.986465] order 10 allocations: 4
>> (XEN) [   34.025925] order 11 allocations: 6
>> (XEN) [   34.065089] order 12 allocations: 5
>> (XEN) [   34.103750] order 13 allocations: 5
>> (XEN) [   34.142221] order 14 allocations: 3
>> (XEN) [   34.180064] order 15 allocations: 2
>> (XEN) [   34.217557] order 16 allocations: 3
>> (XEN) [   34.255105] order 17 allocations: 3
>> (XEN) [   34.292610] order 18 allocations: 5
>> (XEN) [   34.539002] Unable to copy initrd to guest
>> (XEN) [   34.576732] Failed to load Dom0 kernel
>> (XEN) [   34.618554]
>> (XEN) [   34.656905] ****************************************
>> (XEN) [   34.698851] Panic on CPU 0:
>> (XEN) [   34.737640] Could not set up DOM0 guest OS
>> (XEN) [   34.777939] ****************************************
>>
>> i.e. PVH doesn't even complete correctly, and takes 6 seconds as opposed
>> to PV's 0.2s
> Hm, I guess PVH dom0 construction needs to be more clever about initrd
> placement, right now it's just copied after the kernel, without any
> check on whether there's enough space.

Correct.

(XEN) [   34.150042] Unable to copy initrd to guest
(XEN) [   34.186891] load address: 302c000 initrd size: 12ac916 rc 2
(XEN) [   34.224415]  [0000000000000000, 000000000009ffff] (usable)
(XEN) [   34.262722]  [00000000000a0000, 00000000000fffff] (reserved)
(XEN) [   34.300587]  [0000000000100000, 0000000003ffffff] (usable)
(XEN) [   34.338095]  [0000000004000000, 0000000004041fff] (ACPI NVS)

The initrd overlaps into this NVS region.

(XEN) [   34.375640]  [0000000004042000, 0000000076cfffff] (usable)
(XEN) [   34.413183]  [0000000076d00000, 0000000076ffffff] (reserved)
(XEN) [   34.450883]  [0000000077000000, 00000000a6e7cfff] (usable)
(XEN) [   34.488777]  [00000000a6e7d000, 00000000a97b7fff] (reserved)
(XEN) [   34.526778]  [00000000a97b8000, 00000000a99e3fff] (usable)
(XEN) [   34.564801]  [00000000a99e4000, 00000000a9e9ffff] (ACPI NVS)
(XEN) [   34.603098]  [00000000a9ea0000, 00000000aa7f3fff] (reserved)
(XEN) [   34.641739]  [00000000aa7f4000, 00000000abffffff] (usable)
(XEN) [   34.680609]  [00000000ac000000, 00000000afffffff] (reserved)
(XEN) [   34.719820]  [00000000b2200000, 00000000b41fffff] (reserved)
(XEN) [   34.759288]  [00000000b8800000, 00000000ba7fffff] (reserved)
(XEN) [   34.798923]  [00000000f2200000, 00000000f41fffff] (reserved)
(XEN) [   34.838674]  [00000000f8c00000, 00000000fabfffff] (reserved)
(XEN) [   34.878809]  [00000000fe000000, 00000000ffffffff] (reserved)
(XEN) [   34.918972]  [0000000100000000, 0000000257aecfff] (usable)
(XEN) [   34.959120]  [0000000257aed000, 000000204effffff] (unusable)
(XEN) [   34.999413]  [000000204f000000, 000000204fffffff] (reserved)
(XEN) [   35.039708]  [0000002050000000, 000000404fbfffff] (unusable)
(XEN) [   35.080142]  [000000404fc00000, 000000404fffffff] (reserved)
(XEN) [   35.120721]  [0000010000000000, 00000100201fffff] (reserved)
(XEN) [   35.160901]  [000001dfa0000000, 000001dfc01fffff] (reserved)
(XEN) [   35.200730]  [000002bf40000000, 000002bf601fffff] (reserved)
(XEN) [   35.240184]  [0000039ee0000000, 0000039f001fffff] (reserved)
(XEN) [   35.279301]  [0000047e80000000, 0000047ea01fffff] (reserved)
(XEN) [   35.318087]  [0000055e20000000, 0000055e401fffff] (reserved)
(XEN) [   35.356586]  [0000063dc0000000, 0000063de01fffff] (reserved)
(XEN) [   35.395183]  [0000071d60000000, 0000071d801fffff] (reserved)
(XEN) [   35.433919] Failed to load Dom0 kernel

~Andrew

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel