Re: [Xen-users] xen, pvops & nvidia graphics

[Jørn Odberg <jorn.odberg@xxxxxxxxx>]

Full xm dmesg output:

 __  __            _____ _  _    ____  
 \ \/ /___ _ __   |___ /| || |  |___ \ 
  \  // _ \ '_ \    |_ \| || |_   __) |
  /  \  __/ | | |  ___) |__   _| / __/ 
 /_/\_\___|_| |_| |____(_) |_|(_)_____|
                                       
(XEN) Xen version 3.4.2 (root@) (gcc version 4.3.4 (Gentoo 4.3.4 p1.0, pie-10.1.5) ) Fri Jan 15 10:45:24 CET 2010
(XEN) Latest ChangeSet: unavailable
(XEN) Command line: iommu=1 vtd=1
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 2 MBR signatures
(XEN)  Found 2 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009cc00 (usable)
(XEN)  000000000009cc00 - 00000000000a0000 (reserved)
(XEN)  00000000000e4000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 00000000bff70000 (usable)
(XEN)  00000000bff70000 - 00000000bff7e000 (ACPI data)
(XEN)  00000000bff7e000 - 00000000bffd0000 (ACPI NVS)
(XEN)  00000000bffd0000 - 00000000c0000000 (reserved)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000ffe00000 - 0000000100000000 (reserved)
(XEN)  0000000100000000 - 0000000140000000 (usable)
(XEN) System RAM: 4095MB (4193328kB)
(XEN) ACPI: RSDP 000FB280, 0014 (r0 ACPIAM)
(XEN) ACPI: RSDT BFF70000, 0044 (r1 A_M_I_ OEMRSDT   5000922 MSFT       97)
(XEN) ACPI: FACP BFF70200, 0084 (r2 A_M_I_ OEMFACP   5000922 MSFT       97)
(XEN) ACPI: DSDT BFF70440, 9EBF (r1  A1039 A1039001        1 INTL 20060113)
(XEN) ACPI: FACS BFF7E000, 0040
(XEN) ACPI: APIC BFF70390, 006C (r1 A_M_I_ OEMAPIC   5000922 MSFT       97)
(XEN) ACPI: MCFG BFF70400, 003C (r1 A_M_I_ OEMMCFG   5000922 MSFT       97)
(XEN) ACPI: OEMB BFF7E040, 0089 (r1 A_M_I_ AMI_OEM   5000922 MSFT       97)
(XEN) ACPI: HPET BFF7A300, 0038 (r1 A_M_I_ OEMHPET   5000922 MSFT       97)
(XEN) ACPI: OSFR BFF7A340, 00B0 (r1 A_M_I_ OEMOSFR   5000922 MSFT       97)
(XEN) ACPI: TCPA BFF7A3F0, 0032 (r1 A_M_I_ TBLOEMID        1 MSFT       97)
(XEN) ACPI: SSDT BFF91A70, 0A7C (r1 DpgPmm    CpuPm       12 INTL 20060113)
(XEN) Domain heap initialised
(XEN) Processor #0 7:7 APIC version 20
(XEN) Processor #1 7:7 APIC version 20
(XEN) Processor #2 7:7 APIC version 20
(XEN) Processor #3 7:7 APIC version 20
(XEN) IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) XSM Framework v1.0.0 initialized
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 2666.422 MHz processor.
(XEN) VMX: Supported advanced features:
(XEN)  - APIC MMIO access virtualisation
(XEN)  - APIC TPR shadow
(XEN)  - Virtual NMI
(XEN)  - MSR direct-access bitmap
(XEN) HVM: VMX enabled
(XEN) CPU0: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
(XEN) Booting processor 1/1 eip 8c000
(XEN) CPU1: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
(XEN) Booting processor 2/2 eip 8c000
(XEN) CPU2: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
(XEN) Booting processor 3/3 eip 8c000
(XEN) CPU3: Intel(R) Core(TM)2 Quad CPU    Q9400  @ 2.66GHz stepping 0a
(XEN) Total of 4 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) checking TSC synchronization across 4 CPUs: passed.
(XEN) Platform timer is 14.318MHz HPET
(XEN) Brought up 4 CPUs
(XEN) I/O virtualisation disabled
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 64-bit, lsb, compat32
(XEN)  Dom0 kernel: 64-bit, lsb, paddr 0x200000 -> 0x7e6000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000013b000000->000000013c000000 (996433 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: ffffffff80200000->ffffffff807e6000
(XEN)  Init. ramdisk: ffffffff807e6000->ffffffff807e6000
(XEN)  Phys-Mach map: ffffea0000000000->ffffea00007a2288
(XEN)  Start info:    ffffffff807e6000->ffffffff807e64b4
(XEN)  Page tables:   ffffffff807e7000->ffffffff807f0000
(XEN)  Boot stack:    ffffffff807f0000->ffffffff807f1000
(XEN)  TOTAL:         ffffffff80000000->ffffffff80c00000
(XEN)  ENTRY ADDRESS: ffffffff80200000
(XEN) Dom0 has maximum 4 VCPUs
(XEN) Scrubbing Free RAM: .done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 136kB init memory.
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 0 initialization completed
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 1 initialization completed
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 2 initialization completed
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 3 initialization completed



In the BIOS I could only find "Intel(R) Virtualization Tech     - Enabled" , but no setting for VT-d... damn... DAMN! Does that mean I'm screwed?!? I bought this motherboard and cpu just to do Xen.

Motherboard: ASUS P5Q Premium, P45, Socket-775.
CPU: Intel Core 2 Quad Q9400. (Has "Intel Virtualization Technology")

I was under the impression the Intel P45 chipset had "VT-d" ? ... :\


Am I screwed, or is it only me who screws something up? ;)


// Jørn

On Tue, Jan 19, 2010 at 9:35 PM, Pasi Kärkkäinen <pasik@xxxxxx> wrote:

On Tue, Jan 19, 2010 at 09:31:27PM +0100, Jørn Odberg wrote:
>    Hello, and thanks for the reply.
>
>    I've added this to my grub (it may be redundant, but I got different
>    advices, so I added them all;):
>
>    title Xen / Gentoo Linux 2.6.31-xen-r10 IOMMU
>    root (hd0,0)
>    kernel /boot/xen.gz iommu=1 vtd=1
>    module /boot/vmlinuz-2.6.31-xen-r10 root=/dev/md2 pciback.permissive

Oh, it looks like you're not using pv_ops dom0 kernel, but gentoo kernel with
xenlinux patches from opensuse.

Then you can forget my xen-pciback comment.

>    xen-pciback.hide=(01:00.0)(08:00.0)(09:00.0)
>    pciback.hide=(01:00.0)(08:00.0)(09:00.0) guestdev=01:00.0,08:00.0,09:00.0
>    reassign_resources console=tty0
>
>    And I have installed Xen 3.4.2-r1.
>
>    xm dmesg , shows:
>    (XEN) Command line: iommu=1 vtd=1
>    (XEN) VMX: Supported advanced features:

>    (XEN)Â  - APIC MMIO access virtualisation
>    (XEN)Â  - APIC TPR shadow
>    (XEN)Â  - Virtual NMI
>    (XEN)Â  - MSR direct-access bitmap

>    (XEN) HVM: VMX enabled
>    (XEN) I/O virtualisation disabled
>

Please paste the full "xm dmesg", that doesn't show why it's disabled in Xen hypervisor.

Did you enable VT-d in BIOS?

-- Pasi

>    // JÞrn
>
>    On Tue, Jan 19, 2010 at 7:19 PM, Pasi KÀrkkÀinen <[1]pasik@xxxxxx>
>    wrote:
>
>      On Tue, Jan 19, 2010 at 02:49:52PM +0100, JÞrn Odberg wrote:
>      > Â  Â Hello.
>      >
>      > Â  Â I have this exact same problem myself.
>      >
>      > Â  Â (I have four onboard gigabit network cards, pci 05:00.0, 06:00.0,
>      07:00.0
>      > Â  Â and 08:00.0)
>      > Â  Â I tried using pciback.hide=(06:00.0)(07:00.0) . And in dom0, I

>      now get:
>      >
>
>      In the recent pv_ops dom0 kernels pciback module is now called
>      xen-pciback,
>      so you need to change that to xen-pciback.hide.
>
>      -- Pasi

>      > Â  Â xen ~ # ifconfig eth1
>      > Â  Â eth1: error fetching interface information: Device not found
>      >
>      > Â  Â And the same for eth2. So it apparently got "hidden", or
>      detached.
>      >
>      > Â  Â But the command "xm pci-list-assignable-devices" doesn't return
>      anything.
>      > Â  Â And when trying "xm pci-detach", I get the same error as you
>      (Cannot
>      > Â  Â detach when pci platform does not exist). Even though I've
>      compiled in all
>      > Â  Â the support I can think of in the kernel.
>      >
>      > Â  Â Running:
>      > Â  Â Gentoo 2.6.31-xen-r10
>      > Â  Â xen-3.4.2-r1
>      >
>      > Â  Â // JÃ*ÅŸrn
>      >
>      > Â  Â On Mon, Dec 21, 2009 at 10:22 PM, Kai Wohlfahrt
>      <[1][2]kjw53@xxxxxxxxx>
>      > Â  Â wrote:
>      >
>      > Â  Â  Â Still no luck with that. My grub entry looks like so:
>      >
>      > Â  Â  Â  Â  Â menuentry "Xen-Unstable / Kubuntu 9.10 kernel 2.6.31.6
>      pvops" {
>      >
>      > Â  Â  Â  Â  Â insmod ext2
>      >
>      > Â  Â  Â  Â  Â set root=(hd0,1)
>      >
>      > Â  Â  Â  Â  Â multiboot (hd0,1)/boot/xen.gz dom0_mem=1048M iommu=force
>      >
>      > Â  Â  Â  Â  Â module (hd0,1)/boot/vmlinuz-2.6.31.6-xen

>      xen-pciback.hide=(01:00.0)
>      >

>      > Â  Â  Â  Â  Â module (hd0,1)/boot/initrd.img-2.6.31.6-xen
>      >
>      > Â  Â  Â  Â  Â }
>      >
>      > Â  Â  Â but my lspci still looks the same (i.e. it still has the line:
>      01:00.0
>      > Â  Â  Â VGA compatible controller: nVidia Corporation G96 [GeForce GT
>      130M] (rev
>      > Â  Â  Â a1)).
>      > Â  Â  Â Using xm pci-detach still gives the same error as well (Error:
>      Cannot
>      > Â  Â  Â detach when pci platform does not exist)
>      > Â  Â  Â Kai
>      > Â  Â  Â _______________________________________________
>      > Â  Â  Â Xen-users mailing list
>      > Â  Â  Â [2][3]Xen-users@xxxxxxxxxxxxxxxxxxx
>      > Â  Â  Â [3][4]http://lists.xensource.com/xen-users
>      >
>      > References
>      >
>      > Â  Â Visible links
>      > Â  Â 1. mailto:[5]kjw53@xxxxxxxxx
>      > Â  Â 2. mailto:[6]Xen-users@xxxxxxxxxxxxxxxxxxx
>      > Â  Â 3. [7]http://lists.xensource.com/xen-users
>      > _______________________________________________
>      > Xen-users mailing list
>      > [8]Xen-users@xxxxxxxxxxxxxxxxxxx
>      > [9]http://lists.xensource.com/xen-users
>
>      _______________________________________________
>      Xen-users mailing list
>      [10]Xen-users@xxxxxxxxxxxxxxxxxxx
>      [11]http://lists.xensource.com/xen-users
>
> References
>
>    Visible links
>    1. mailto:pasik@xxxxxx

>    2. mailto:kjw53@xxxxxxxxx
>    3. mailto:Xen-users@xxxxxxxxxxxxxxxxxxx

>    4. http://lists.xensource.com/xen-users

>    5. mailto:kjw53@xxxxxxxxx
>    6. mailto:Xen-users@xxxxxxxxxxxxxxxxxxx

>    7. http://lists.xensource.com/xen-users

>    8. mailto:Xen-users@xxxxxxxxxxxxxxxxxxx

>    9. http://lists.xensource.com/xen-users
>   10. mailto:Xen-users@xxxxxxxxxxxxxxxxxxx
>   11. http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users