WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

RE: [Xen-devel] RE: Unknown pciback.hide boot option in lastestchangeset

To: "Cui, Dexuan" <dexuan.cui@xxxxxxxxx>, "Mitov, Stefan" <stefan.mitov@xxxxxxxxxxx>, "Handfest, Werner" <werner.handfest@xxxxxxxxxxx>, "Han, Weidong" <weidong.han@xxxxxxxxx>
Subject: RE: [Xen-devel] RE: Unknown pciback.hide boot option in lastestchangeset 18242
From: "Li, Haicheng" <haicheng.li@xxxxxxxxx>
Date: Wed, 6 Aug 2008 22:39:02 +0800
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx, Keir Fraser <keir.fraser@xxxxxxxxxxxxx>
Delivery-date: Wed, 06 Aug 2008 07:39:43 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <FE7BBCFBB500984A9A7922EBC95F516E01865160@xxxxxxxxxxxxxxxxxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <4BFA8211BA1C364EA81C6F533E2E00D2023E8F19@xxxxxxxxxxxxxxxxxxxxxxxxxx><0122C7C995D32147B66BF4F440D301630174AEE1@xxxxxxxxxxxxxxxxxxxxxxxxxxxx><FE7BBCFBB500984A9A7922EBC95F516E017FAE77@xxxxxxxxxxxxxxxxxxxxxxxxxxxx><4BFA8211BA1C364EA81C6F533E2E00D202437C5C@xxxxxxxxxxxxxxxxxxxxxxxxxx><FE7BBCFBB500984A9A7922EBC95F516E01864A46@xxxxxxxxxxxxxxxxxxxxxxxxxxxx><4BFA8211BA1C364EA81C6F533E2E00D202464861@xxxxxxxxxxxxxxxxxxxxxxxxxx> <FE7BBCFBB500984A9A7922EBC95F516E01865160@xxxxxxxxxxxxxxxxxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
Thread-index: AcjyP162Iwlc7r+LRn+qSl9julzT+QAalEMAAANXShABCCSkAAADvz3wAC8tS7AAAe+6UAAJmp5w
Thread-topic: [Xen-devel] RE: Unknown pciback.hide boot option in lastestchangeset 18242

besides, make sure pciback is built into your dom0 kernel not just built as a module.
 
-- haicheng
 


From: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Cui, Dexuan
Sent: 2008年8月6日 18:04
To: Mitov, Stefan; Handfest, Werner; Han, Weidong
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx; Keir Fraser
Subject: [Xen-devel] RE: Unknown pciback.hide boot option in lastestchangeset 18242

I can't reproduce the issue in my side.
It's really weird... Looks the setting is ok. (Please ensure the devices 0f:00.0 and 80:00.0 do exist in your platform)
Maybe you can try finding the recently workable changeset and locate which c/s caused the issue?
 
-- Dexuan


From: Mitov, Stefan [mailto:stefan.mitov@xxxxxxxxxxx]
Sent: 2008年8月6日 17:19
To: Cui, Dexuan; Handfest, Werner; Han, Weidong
Cc: Keir Fraser; xen-devel@xxxxxxxxxxxxxxxxxxx
Subject: Unknown pciback.hide boot option in lastest changeset 18242

Hi Dexuan,
 
the pci error was because of single quotation marks. I realy didn't saw them. After fix the marks, i was able to start the domain.
Now there is another issue on the latest Xen 4.0.0-rc3 with changeset 18242. The boot option pciback.hide is unknonw anymore. Did you change something in the configuration and assigning of VT-d in the latest changeset?
 
Here is the log output which i get:

Kernel command line: root=/dev/sda2 ro splash=silent showopts console=tty0 console=ttyS0,115200,8n1 pciback.hide=(0f:00.00)(80:00.0) apic=debug

Unknown boot option `pciback.hide=(0f:00.00)(80:00.0)': ignoring

Exactly same configuration worked fine before i checked out the latest changeset. I attached the whole log from the serial console.

Mit freundlichen Grüßen / Best Regards

Stefan Mitov

Siemens AG
Healthcare Sector 
MED CO CHS CS
Mozartstr. 57
91052 Erlangen, Germany
Tel.: +49 (9131) 84-722433
Fax: +49 (9131) 84-2978
stefan.mitov@xxxxxxxxxxx

Siemens Aktiengesellschaft: Vorsitzender des Aufsichtsrats: Gerhard Cromme; Vorstand: Peter Löscher, Vorsitzender; Johannes Feldmayer, Heinrich Hiesinger, Joe Kaeser, Rudi Lamprecht, Eduardo Montes, Jürgen Radomski, Erich R. Reinhardt, Hermann Requardt, Uriel J. Sharef, Klaus Wucherer; Sitz der Gesellschaft: Berlin und München; Registergericht: Berlin Charlottenburg, HRB 12300, München, HRB 6684; WEEE-Reg.-Nr. DE 23691322

 


Von: Cui, Dexuan [mailto:dexuan.cui@xxxxxxxxx]
Gesendet: Dienstag, 5. August 2008 12:41
An: Mitov, Stefan; Han, Weidong; Keir Fraser; xen-devel@xxxxxxxxxxxxxxxxxxx
Cc: Azem, Gassan; Handfest, Werner
Betreff: RE: [Xen-devel] RE: DMA Write Page Fault by using vt-d with Xen 3.3,changeset 18164

"Error: pci: PCI Backend does not own device 0000:0f:00."  -- this looks like a mis-configuration issue.
 
I notice in Boot_5.8_xen_3.3.TXT, you use
pciback.hide=('0f:00.00').
 
Can you use
pciback.hide=(0f:00.00)
instead (namely, remove the 2 single quotation marks)?
 

-- Dexuan


From: Mitov, Stefan [mailto:stefan.mitov@xxxxxxxxxxx]
Sent: 2008年8月5日 17:09
To: Cui, Dexuan; Han, Weidong; Keir Fraser; xen-devel@xxxxxxxxxxxxxxxxxxx
Cc: Azem, Gassan; Handfest, Werner
Subject: AW: [Xen-devel] RE: DMA Write Page Fault by using vt-d with Xen 3.3,changeset 18164

Hi folks,
 
i'm sorry that i reply a little bit late but i had many things to do. So, i found what was the reason for the write page fault. I used a SATA hard disk, which was connected to the SAS controller on the mainboard. You can see the description of the SAS controller in the both lspci* files,which i added to the mail. It stays behind a PCIe to PCI/x bridge and this can be the problem. After i repluged the SATA cable in the right SATA controler and i turned off the SAS controller in the BIOS, i get the write page fault no more.
Now i'm using the latest xen 3.3 with changeset 18233. I'm trying to hide the BroadCom PCIe network adapter, but dom0 is not able to unbind it and i get the message:
 

Error: pci: PCI Backend does not own device 0000:0f:00.0

See the pciback.hide kernel command-line parameter or

bind your slot/device to the PCI backend using sysfs

I also added my grub configuration and the serial console output. How do you thing, what can be the reason for this ussue

Mit freundlichen Grüßen / Best Regards

Stefan Mitov

Siemens AG
Healthcare Sector 
MED CO CHS CS
Mozartstr. 57
91052 Erlangen, Germany
Tel.: +49 (9131) 84-722433
Fax: +49 (9131) 84-2978
stefan.mitov@xxxxxxxxxxx

Siemens Aktiengesellschaft: Vorsitzender des Aufsichtsrats: Gerhard Cromme; Vorstand: Peter Löscher, Vorsitzender; Johannes Feldmayer, Heinrich Hiesinger, Joe Kaeser, Rudi Lamprecht, Eduardo Montes, Jürgen Radomski, Erich R. Reinhardt, Hermann Requardt, Uriel J. Sharef, Klaus Wucherer; Sitz der Gesellschaft: Berlin und München; Registergericht: Berlin Charlottenburg, HRB 12300, München, HRB 6684; WEEE-Reg.-Nr. DE 23691322

 


Von: Cui, Dexuan [mailto:dexuan.cui@xxxxxxxxx]
Gesendet: Donnerstag, 31. Juli 2008 04:50
An: Han, Weidong; Mitov, Stefan; Keir Fraser
Cc: Azem, Gassan; xen-devel@xxxxxxxxxxxxxxxxxxx; Handfest, Werner
Betreff: RE: [Xen-devel] RE: DMA Write Page Fault by using vt-d with Xen 3.3,changeset 18164

Hi Stefan,
Can you try the latest xen-unstable tree (changeset 18178: 21dd1fdb73d8)?   Changeset 18173: b9edc4627944 might fix the issue you meet with.
And please attach the log files of "lspci -tv" and "lspci -xxxx -vvv".
BTW, for xen 3.3, do you notice the issue recently? Can you find the recent workable c/s in 3.3 on your platform?

Thanks,
-- Dexuan


From: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-devel-bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Han, Weidong
Sent: 2008年7月31日 10:16
To: Mitov, Stefan; Keir Fraser
Cc: Azem, Gassan; xen-devel@xxxxxxxxxxxxxxxxxxx; Handfest, Werner
Subject: [Xen-devel] RE: DMA Write Page Fault by using vt-d with Xen 3.3,changeset 18164

Hi Stefan,
 
The page fault (REASON 2) indicates the present (P) field of context entry is clear. That means it didn't map context for the device (11:06.0). However, there is "(XEN) PCI add device 11:06.0" in the log, it should map context for the device. Can you add a check in intel_iommu_add_device() to see whether map context for device (11:06.0)?
 
In our several testing platforms, we didn't meet this issue. Can you attach the output of lspci -v?
 
Did you run Xen 3.2.1 on the latest BIOS? If Xen 3.2.1 can work on the same environment, it may be related to dom0 add/remove device hypercall mechanism.
 
Randy (Weidong)


From: Mitov, Stefan [mailto:stefan.mitov@xxxxxxxxxxx]
Sent: 2008年7月30日 20:26
To: Han, Weidong; Keir Fraser
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx; Handfest, Werner; Azem, Gassan
Subject: DMA Write Page Fault by using vt-d with Xen 3.3, changeset 18164

Hi all,
 
i'm using the unstable version of Xen 3.3, changeset 18164. I'm trying to do some performance measurements of network adapters. Without enabling vt-d features on my HP xw8600 i have no problems to start dom0 and some domU. But when i set the parameter "iommu=1" i can not boot even the dom0. It occurs a Primary Pending Fault by DMA Write request. I'm using the latest BIOS version (01.24 Rev.a) of the HP machine. Previously i used vt-d on the same architecture with Xen 3.2.1 and it worked very fine. I've added a log output from the serial console.
Some suggestions from you?
 

(XEN) Xen version 3.3.0-rc2-pre (root@) (gcc version 4.1.2 20061115 (prerelease) (Debian 4.1.1-21)) Wed Jul 30 13:24:27 CEST 2008

(XEN) Latest ChangeSet: Tue Jul 29 13:27:29 2008 +0100 18164:b0ee5e8613e9

(XEN) Command line: iommu=1 com1=115200,8n1 console=com1 apic_verbosity=debug vga numa=on xenheap_megabytes=64 noreboot dom0_mem=min:512M,max:2048M,1024M loglvl=all guest_loglvl=all

(XEN) Video information:

(XEN) VGA is text mode 80x25, font 8x16

(XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds

(XEN) EDID info not retrieved because no DDC retrieval method detected

(XEN) Disc information:

(XEN) Found 1 MBR signatures

(XEN) Found 1 EDD information structures

(XEN) Xen-e820 RAM map:

(XEN) 0000000000000000 - 000000000009ec00 (usable)

(XEN) 000000000009ec00 - 00000000000a0000 (reserved)

(XEN) 00000000000e8000 - 0000000000100000 (reserved)

(XEN) 0000000000100000 - 00000000cffc2840 (usable)

(XEN) 00000000cffc2840 - 00000000d0000000 (reserved)

(XEN) 00000000e0000000 - 00000000f0000000 (reserved)

(XEN) 00000000fec00000 - 0000000100000000 (reserved)

(XEN) 0000000100000000 - 0000000130000000 (usable)

(XEN) System RAM: 4095MB (4193664kB)

(XEN) ACPI: RSDP 000E9810, 0024 (r2 HPQOEM)

(XEN) ACPI: XSDT CFFC52EC, 006C (r1 HPQOEM SLIC-WKS 20080701 0)

(XEN) ACPI: FACP CFFC5494, 00F4 (r3 HPQOEM SEABURG 1 0)

(XEN) ACPI Error (tbfadt-0455): 32/64X address mismatch in "Gpe0Block": [0000F828] [000000000001F030], using 64X [20070126]

(XEN) ACPI: DSDT CFFC5A7A, 26A4 (r1 HPQOEM DSDT 1 MSFT 100000E)

(XEN) ACPI: FACS CFFC5200, 0040

(XEN) ACPI: SSDT CFFC811E, 701D (r1 HPQOEM PROJECT 1 MSFT 100000E)

(XEN) ACPI: APIC CFFC5588, 00D4 (r1 HPQOEM SEABURG 1 0)

(XEN) ACPI: ASF! CFFC565C, 006A (r32 HPQOEM SEABURG 1 0)

(XEN) ACPI: MCFG CFFC585E, 003C (r1 HPQOEM SEABURG 1 0)

(XEN) ACPI: SLIC CFFC589A, 0176 (r1 HPQOEM SLIC-WKS 1 0)

(XEN) ACPI: HPET CFFC5A10, 0038 (r1 HPQOEM SEABURG 1 0)

(XEN) ACPI: TCPA CFFC5A48, 0032 (r1 HPQOEM SEABURG 1 0)

(XEN) ACPI: DMAR CFFC56C6, 0120 (r1 HPQOEM SEABURG 1 0)

(XEN) No NUMA configuration found

(XEN) Faking a node at 0000000000000000-0000000130000000

(XEN) Xen heap: 9MB (9640kB)

(XEN) Domain heap initialised

(XEN) found SMP MP-table at 000fe700

(XEN) DMI 2.5 present.

(XEN) Using APIC driver default

(XEN) ACPI: PM-Timer IO Port: 0xf808

(XEN) ACPI: ACPI SLEEP INFO: pm1x_cnt[f804,460], pm1x_evt[f800,0]

(XEN) ACPI: wakeup_vec[cffc520c], vec_size[20]

(XEN) ACPI: Local APIC address 0xfee00000

(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)

(XEN) Processor #0 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)

(XEN) Processor #4 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)

(XEN) Processor #2 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)

(XEN) Processor #6 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x01] enabled)

(XEN) Processor #1 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)

(XEN) Processor #5 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x03] enabled)

(XEN) Processor #3 7:7 APIC version 20

(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)

(XEN) Processor #7 7:7 APIC version 20

(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])

(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])

(XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])

(XEN) IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23

(XEN) ACPI: IOAPIC (id[0x02] address[0xfec89000] gsi_base[24])

(XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec89000, GSI 24-47

(XEN) ACPI: IOAPIC (id[0x03] address[0xfec88000] gsi_base[48])

(XEN) IOAPIC[2]: apic_id 3, version 32, address 0xfec88000, GSI 48-71

(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

(XEN) ACPI: IRQ0 used by override.

(XEN) ACPI: IRQ2 used by override.

(XEN) ACPI: IRQ9 used by override.

(XEN) Enabling APIC mode: Flat. Using 3 I/O APICs

(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000

(XEN) [VT-D]dmar.c:435: Host address width 36

(XEN) [VT-D]dmar.c:444: found ACPI_DMAR_DRHD

(XEN) [VT-D]dmar.c:317: dmaru->address = fe710000

(XEN) [VT-D]dmar.c:252: found bridge: bdf = 0:1.0 sec = 80 sub = 80

(XEN) [VT-D]dmar.c:444: found ACPI_DMAR_DRHD

(XEN) [VT-D]dmar.c:317: dmaru->address = fe712000

(XEN) [VT-D]dmar.c:252: found bridge: bdf = 0:3.0 sec = a0 sub = a0

(XEN) [VT-D]dmar.c:444: found ACPI_DMAR_DRHD

(XEN) [VT-D]dmar.c:317: dmaru->address = fe714000

(XEN) [VT-D]dmar.c:252: found bridge: bdf = 0:5.0 sec = 60 sub = 60

(XEN) [VT-D]dmar.c:444: found ACPI_DMAR_DRHD

(XEN) [VT-D]dmar.c:317: dmaru->address = fe719000

(XEN) [VT-D]dmar.c:252: found bridge: bdf = 0:9.0 sec = 10 sub = 40

(XEN) [VT-D]dmar.c:444: found ACPI_DMAR_DRHD

(XEN) [VT-D]dmar.c:317: dmaru->address = fe718000

(XEN) [VT-D]dmar.c:326: found INCLUDE_ALL

(XEN) [VT-D]dmar.c:448: found ACPI_DMAR_RMRR

(XEN) [VT-D]dmar.c:266: found endpoint: bdf = 0:1d.0

(XEN) [VT-D]dmar.c:448: found ACPI_DMAR_RMRR

(XEN) [VT-D]dmar.c:266: found endpoint: bdf = 0:1d.1

(XEN) [VT-D]dmar.c:448: found ACPI_DMAR_RMRR

(XEN) [VT-D]dmar.c:266: found endpoint: bdf = 0:1d.2

(XEN) [VT-D]dmar.c:448: found ACPI_DMAR_RMRR

(XEN) [VT-D]dmar.c:266: found endpoint: bdf = 0:1d.3

(XEN) Intel VT-d has been enabled

(XEN) Using ACPI (MADT) for SMP configuration information

(XEN) mapped APIC to fffdf000 (fee00000)

(XEN) mapped IOAPIC to fffde000 (fec00000)

(XEN) mapped IOAPIC to fffdd000 (fec89000)

(XEN) mapped IOAPIC to fffdc000 (fec88000)

(XEN) Using scheduler: SMP Credit Scheduler (credit)

(XEN) Initializing CPU#0

(XEN) Detected 2833.483 MHz processor.

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 0

(XEN) CPU: Processor Core ID: 0

(XEN) HVM: VMX enabled

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#0.

(XEN) CPU0: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Getting VERSION: 50014

(XEN) Getting VERSION: 50014

(XEN) Getting ID: 0

(XEN) Getting LVT0: 1700

(XEN) Getting LVT1: 400

(XEN) enabled ExtINT on CPU#0

(XEN) Booting processor 1/4 eip 8c000

(XEN) Initializing CPU#1

(XEN) masked ExtINT on CPU#1

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 1

(XEN) CPU: Processor Core ID: 0

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#1.

(XEN) CPU1: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 2/2 eip 8c000

(XEN) Initializing CPU#2

(XEN) masked ExtINT on CPU#2

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 0

(XEN) CPU: Processor Core ID: 2

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#2.

(XEN) CPU2: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 3/6 eip 8c000

(XEN) Initializing CPU#3

(XEN) masked ExtINT on CPU#3

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 1

(XEN) CPU: Processor Core ID: 2

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#3.

(XEN) CPU3: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 4/1 eip 8c000

(XEN) Initializing CPU#4

(XEN) masked ExtINT on CPU#4

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 0

(XEN) CPU: Processor Core ID: 1

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#4.

(XEN) CPU4: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 5/5 eip 8c000

(XEN) Initializing CPU#5

(XEN) masked ExtINT on CPU#5

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 1

(XEN) CPU: Processor Core ID: 1

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#5.

(XEN) CPU5: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 6/3 eip 8c000

(XEN) Initializing CPU#6

(XEN) masked ExtINT on CPU#6

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 0

(XEN) CPU: Processor Core ID: 3

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#6.

(XEN) CPU6: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Booting processor 7/7 eip 8c000

(XEN) Initializing CPU#7

(XEN) masked ExtINT on CPU#7

(XEN) CPU: L1 I cache: 32K, L1 D cache: 32K

(XEN) CPU: L2 cache: 6144K

(XEN) CPU: Physical Processor ID: 1

(XEN) CPU: Processor Core ID: 3

(XEN) Intel machine check architecture supported.

(XEN) Intel machine check reporting enabled on CPU#7.

(XEN) CPU7: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06

(XEN) Total of 8 processors activated.

(XEN) ENABLING IO-APIC IRQs

(XEN) -> Using new ACK method

(XEN) init IO_APIC IRQs

(XEN) IO-APIC (apicid-pin) 1-0, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22, 1-23, 2-0, 2-1, 2-2, 2-3, 2-4, 2-5, 2-6, 2-7, 2-8, 2-9, 2-10, 2-11, 2-12, 2-13, 2-14, 2-15, 2-16, 2-17, 2-18, 2-19, 2-20, 2-21, 2-22, 2-23, 3-0, 3-1, 3-2, 3-3, 3-4, 3-5, 3-6, 3-7, 3-8, 3-9, 3-10, 3-11, 3-12, 3-13, 3-14, 3-15, 3-16, 3-17, 3-18, 3-19, 3-20, 3-21, 3-22, 3-23 not connected.

(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1

(XEN) number of MP IRQ sources: 15.

(XEN) number of IO-APIC #1 registers: 24.

(XEN) number of IO-APIC #2 registers: 24.

(XEN) number of IO-APIC #3 registers: 24.

(XEN) testing the IO APIC.......................

(XEN) IO APIC #1......

(XEN) .... register #00: 01000000

(XEN) ....... : physical APIC id: 01

(XEN) ....... : Delivery Type: 0

(XEN) ....... : LTS : 0

(XEN) .... register #01: 00170020

(XEN) ....... : max redirection entries: 0017

(XEN) ....... : PRQ implemented: 0

(XEN) ....... : IO APIC version: 0020

(XEN) .... IRQ redirection table:

(XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:

(XEN) 00 031 01 1 0 0 0 0 0 2 CA

(XEN) 01 001 01 0 0 0 0 0 1 1 28

(XEN) 02 001 01 0 0 0 0 0 1 1 F0

(XEN) 03 001 01 0 0 0 0 0 1 1 30

(XEN) 04 001 01 0 0 0 0 0 1 1 F1

(XEN) 05 001 01 0 0 0 0 0 1 1 38

(XEN) 06 001 01 0 0 0 0 0 1 1 40

(XEN) 07 001 01 0 0 0 0 0 1 1 48

(XEN) 08 001 01 0 0 0 0 0 1 1 50

(XEN) 09 001 01 1 1 0 0 0 1 1 58

(XEN) 0a 001 01 0 0 0 0 0 1 1 60

(XEN) 0b 001 01 0 0 0 0 0 1 1 68

(XEN) 0c 001 01 0 0 0 0 0 1 1 70

(XEN) 0d 001 01 0 0 0 0 0 1 1 78

(XEN) 0e 001 01 0 0 0 0 0 1 1 88

(XEN) 0f 001 01 0 0 0 0 0 1 1 90

(XEN) 10 000 00 1 0 0 0 0 0 0 00

(XEN) 11 000 00 1 0 0 0 0 0 0 00

(XEN) 12 000 00 1 0 0 0 0 0 0 00

(XEN) 13 000 00 1 0 0 0 0 0 0 00

(XEN) 14 071 01 1 0 0 0 0 0 2 8B

(XEN) 15 000 00 1 0 0 0 0 0 0 00

(XEN) 16 000 00 1 0 0 0 0 0 0 00

(XEN) 17 000 00 1 0 0 0 0 0 0 00

(XEN) IO APIC #2......

(XEN) .... register #00: 02000000

(XEN) ....... : physical APIC id: 02

(XEN) ....... : Delivery Type: 0

(XEN) ....... : LTS : 0

(XEN) .... register #01: 00170020

(XEN) ....... : max redirection entries: 0017

(XEN) ....... : PRQ implemented: 0

(XEN) ....... : IO APIC version: 0020

(XEN) .... register #02: 00000000

(XEN) ....... : arbitration: 00

(XEN) .... register #03: 00000001

(XEN) ....... : Boot DT : 1

(XEN) .... IRQ redirection table:

(XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:

(XEN) 00 000 00 1 0 0 0 0 0 0 00

(XEN) 01 000 00 1 0 0 0 0 0 0 00

(XEN) 02 000 00 1 0 0 0 0 0 0 00

(XEN) 03 000 00 1 0 0 0 0 0 0 00

(XEN) 04 000 00 1 0 0 0 0 0 0 00

(XEN) 05 000 00 1 0 0 0 0 0 0 00

(XEN) 06 000 00 1 0 0 0 0 0 0 00

(XEN) 07 000 00 1 0 0 0 0 0 0 00

(XEN) 08 000 00 1 0 0 0 0 0 0 00

(XEN) 09 000 00 1 0 0 0 0 0 0 00

(XEN) 0a 000 00 1 0 0 0 0 0 0 00

(XEN) 0b 000 00 1 0 0 0 0 0 0 00

(XEN) 0c 000 00 1 0 0 0 0 0 0 00

(XEN) 0d 000 00 1 0 0 0 0 0 0 00

(XEN) 0e 000 00 1 0 0 0 0 0 0 00

(XEN) 0f 000 00 1 0 0 0 0 0 0 00

(XEN) 10 000 00 1 0 0 0 0 0 0 00

(XEN) 11 000 00 1 0 0 0 0 0 0 00

(XEN) 12 000 00 1 0 0 0 0 0 0 00

(XEN) 13 000 00 1 0 0 0 0 0 0 00

(XEN) 14 000 00 1 0 0 0 0 0 0 00

(XEN) 15 000 00 1 0 0 0 0 0 0 00

(XEN) 16 000 00 1 0 0 0 0 0 0 00

(XEN) 17 000 00 1 0 0 0 0 0 0 00

(XEN) IO APIC #3......

(XEN) .... register #00: 03000000

(XEN) ....... : physical APIC id: 03

(XEN) ....... : Delivery Type: 0

(XEN) ....... : LTS : 0

(XEN) .... register #01: 00178020

(XEN) ....... : max redirection entries: 0017

(XEN) ....... : PRQ implemented: 1

(XEN) ....... : IO APIC version: 0020

(XEN) .... register #02: 03000000

(XEN) ....... : arbitration: 03

(XEN) .... register #03: 00000001

(XEN) ....... : Boot DT : 1

(XEN) .... IRQ redirection table:

(XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:

(XEN) 00 000 00 1 0 0 0 0 0 0 00

(XEN) 01 000 00 1 0 0 0 0 0 0 00

(XEN) 02 000 00 1 0 0 0 0 0 0 00

(XEN) 03 000 00 1 0 0 0 0 0 0 00

(XEN) 04 000 00 1 0 0 0 0 0 0 00

(XEN) 05 000 00 1 0 0 0 0 0 0 00

(XEN) 06 000 00 1 0 0 0 0 0 0 00

(XEN) 07 000 00 1 0 0 0 0 0 0 00

(XEN) 08 000 00 1 0 0 0 0 0 0 00

(XEN) 09 000 00 1 0 0 0 0 0 0 00

(XEN) 0a 000 00 1 0 0 0 0 0 0 00

(XEN) 0b 000 00 1 0 0 0 0 0 0 00

(XEN) 0c 000 00 1 0 0 0 0 0 0 00

(XEN) 0d 000 00 1 0 0 0 0 0 0 00

(XEN) 0e 000 00 1 0 0 0 0 0 0 00

(XEN) 0f 000 00 1 0 0 0 0 0 0 00

(XEN) 10 000 00 1 0 0 0 0 0 0 00

(XEN) 11 000 00 1 0 0 0 0 0 0 00

(XEN) 12 000 00 1 0 0 0 0 0 0 00

(XEN) 13 000 00 1 0 0 0 0 0 0 00

(XEN) 14 000 00 1 0 0 0 0 0 0 00

(XEN) 15 000 00 1 0 0 0 0 0 0 00

(XEN) 16 000 00 1 0 0 0 0 0 0 00

(XEN) 17 000 00 1 0 0 0 0 0 0 00

(XEN) Using vector-based indexing

(XEN) IRQ to pin mappings:

(XEN) IRQ240 -> 0:2

(XEN) IRQ40 -> 0:1

(XEN) IRQ48 -> 0:3

(XEN) IRQ241 -> 0:4

(XEN) IRQ56 -> 0:5

(XEN) IRQ64 -> 0:6

(XEN) IRQ72 -> 0:7

(XEN) IRQ80 -> 0:8

(XEN) IRQ88 -> 0:9

(XEN) IRQ96 -> 0:10

(XEN) IRQ104 -> 0:11

(XEN) IRQ112 -> 0:12

(XEN) IRQ120 -> 0:13

(XEN) IRQ136 -> 0:14

(XEN) IRQ144 -> 0:15

(XEN) .................................... done.

(XEN) Using local APIC timer interrupts.

(XEN) calibrating APIC timer ...

(XEN) ..... CPU clock speed is 2833.4260 MHz.

(XEN) ..... host bus clock speed is 333.3441 MHz.

(XEN) ..... bus_scale = 0x00015572

(XEN) checking TSC synchronization across 8 CPUs: passed.

(XEN) Platform timer is 14.318MHz HPET

(XEN) Brought up 8 CPUs

(XEN) [VT-D]iommu.c:1709: Queued Invalidation hardware not found

(XEN) [VT-D]iommu.c:1709: Queued Invalidation hardware not found

(XEN) [VT-D]iommu.c:1709: Queued Invalidation hardware not found

(XEN) [VT-D]iommu.c:1709: Queued Invalidation hardware not found

(XEN) [VT-D]iommu.c:1709: Queued Invalidation hardware not found

(XEN) [VT-D]iommu.c:1717: Interrupt Remapping hardware not found

(XEN) [VT-D]iommu.c:1717: Interrupt Remapping hardware not found

(XEN) [VT-D]iommu.c:1717: Interrupt Remapping hardware not found

(XEN) [VT-D]iommu.c:1717: Interrupt Remapping hardware not found

(XEN) [VT-D]iommu.c:1717: Interrupt Remapping hardware not found

(XEN) I/O virtualisation enabled

(XEN) I/O virtualisation for PV guests disabled

(XEN) ACPI sleep modes: S3

(XEN) MCA: Machine check polling timer started.

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCIe: bdf = 0:0.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:10.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:10.1

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:10.2

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:10.3

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:10.4

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:11.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:15.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:15.1

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:16.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:16.1

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCIe: bdf = 0:1b.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1d.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1d.1

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1d.2

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1d.3

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1d.7

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1f.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1f.1

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 0:1f.2

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.0

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.0 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.1

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.1 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.2

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.2 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.3

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.3 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.4

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.4 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.5

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.5 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.6

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.6 -> 0:1e.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 1:5.7

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 1:5.7 -> 0:1e.0

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCIe: bdf = e:0.0

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCIe: bdf = f:0.0

(XEN) [VT-D]iommu.c:1259:d32767 domain_context_mapping:PCI: bdf = 11:6.0

(XEN) [VT-D]iommu.c:1272:d32767 domain_context_mapping:map: bdf = 11:6.0 -> 10:0.3

(XEN) [VT-D]iommu.c:1252:d32767 domain_context_mapping:PCIe: bdf = 60:0.0

(XEN) [VT-D]iommu.c:664: iommu_enable_translation: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:664: iommu_enable_translation: iommu->reg = fff77000

(XEN) [VT-D]iommu.c:664: iommu_enable_translation: iommu->reg = fff76000

(XEN) [VT-D]iommu.c:664: iommu_enable_translation: iommu->reg = fff75000

(XEN) [VT-D]iommu.c:664: iommu_enable_translation: iommu->reg = fff74000

(XEN) *** LOADING DOMAIN 0 ***

(XEN) elf_parse_binary: phdr: paddr=0xc0100000 memsz=0x262438

(XEN) elf_parse_binary: phdr: paddr=0xc0363000 memsz=0x1055fc

(XEN) elf_parse_binary: memory: 0xc0100000 -> 0xc04685fc

(XEN) elf_xen_parse_note: GUEST_OS = "linux"

(XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"

(XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"

(XEN) elf_xen_parse_note: VIRT_BASE = 0xc0000000

(XEN) elf_xen_parse_note: PADDR_OFFSET = 0xc0000000

(XEN) elf_xen_parse_note: ENTRY = 0xc0100000

(XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xc0101000

(XEN) elf_xen_parse_note: HV_START_LOW = 0xf5800000

(XEN) elf_xen_parse_note: FEATURES = "writable_page_tables|writable_descriptor_tables|auto_translated_physmap|pae_pgdir_above_4gb|supervisor_mode_kernel"

(XEN) elf_xen_parse_note: PAE_MODE = "yes"

(XEN) elf_xen_parse_note: unknown xen elf note (0xd)

(XEN) elf_xen_parse_note: LOADER = "generic"

(XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1

(XEN) elf_xen_parse: using notes from SHT_NOTE section

(XEN) elf_xen_addr_calc_check: addresses:

(XEN) virt_base = 0xc0000000

(XEN) elf_paddr_offset = 0xc0000000

(XEN) virt_offset = 0x0

(XEN) virt_kstart = 0xc0100000

(XEN) virt_kend = 0xc04685fc

(XEN) virt_entry = 0xc0100000

(XEN) Xen kernel: 32-bit, PAE, lsb

(XEN) Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0100000 -> 0xc04685fc

(XEN) PHYSICAL MEMORY ARRANGEMENT:

(XEN) Dom0 alloc.: 000000003c000000->000000003e000000 (253952 pages to be allocated)

(XEN) VIRTUAL MEMORY ARRANGEMENT:

(XEN) Loaded kernel: c0100000->c04685fc

(XEN) Init. ramdisk: c0469000->c1070e00

(XEN) Phys-Mach map: c1071000->c1171000

(XEN) Start info: c1171000->c1171474

(XEN) Page tables: c1172000->c1181000

(XEN) Boot stack: c1181000->c1182000

(XEN) TOTAL: c0000000->c1400000

(XEN) ENTRY ADDRESS: c0100000

(XEN) Dom0 has maximum 8 VCPUs

(XEN) elf_load_binary: phdr 0 at 0xc0100000 -> 0xc0362438

(XEN) elf_load_binary: phdr 1 at 0xc0363000 -> 0xc03fc9e4

(XEN) Scrubbing Free RAM: ..............................done.

(XEN) Xen trace buffers: disabled

(XEN) Std. Loglevel: All

(XEN) Guest Loglevel: All

(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)

(XEN) Freed 96kB init memory.

Linux version 2.6.18.8-xen (root@debian) (gcc version 4.1.2 20061115 (prerelease) (Debian 4.1.1-21)) #2 SMP Wed Jul 30 15:07:12 CEST 2008

BIOS-provided physical RAM map:

Xen: 0000000000000000 - 0000000040800000 (usable)

304MB HIGHMEM available.

727MB LOWMEM available.

NX (Execute Disable) protection: active

found SMP MP-table at 000fe700

DMI 2.5 present.

>>> ERROR: Invalid checksum

ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)

ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)

ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)

ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)

ACPI: LAPIC (acpi_id[0x05] lapic_id[0x01] enabled)

ACPI: LAPIC (acpi_id[0x06] lapic_id[0x05] enabled)

ACPI: LAPIC (acpi_id[0x07] lapic_id[0x03] enabled)

ACPI: LAPIC (acpi_id[0x08] lapic_id[0x07] enabled)

ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])

ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])

IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23

ACPI: IOAPIC (id[0x02] address[0xfec89000] gsi_base[24])

IOAPIC[1]: apic_id 2, version 32, address 0xfec89000, GSI 24-47

ACPI: IOAPIC (id[0x03] address[0xfec88000] gsi_base[48])

IOAPIC[2]: apic_id 3, version 32, address 0xfec88000, GSI 48-71

ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

Enabling APIC mode: Flat. Using 3 I/O APICs

Using ACPI (MADT) for SMP configuration information

Allocating PCI resources starting at d1000000 (gap: d0000000:10000000)

Detected 2833.676 MHz processor.

Built 1 zonelists. Total pages: 264192

Kernel command line: root=/dev/sda2 ro splash=silent showopts console=tty0 console=ttyS0,115200,8n1 pciback.hide=('0f:0.0')

Enabling fast FPU save and restore... done.

Enabling unmasked SIMD FPU exception support... done.

Initializing CPU#0

PID hash table entries: 4096 (order: 12, 16384 bytes)

Xen reported: 2833.432 MHz processor.

Console: colour VGA+ 80x25

Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)

Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)

Software IO TLB enabled:

Aperture: 64 megabytes

Kernel range: c1b45000 - c5b45000

Address size: 27 bits

vmalloc area: ee000000-f51fe000, maxmem 2d7fe000

Memory: 954152k/1056768k available (2104k kernel code, 93664k reserved, 728k data, 196k init, 311304k highmem)

Checking if this processor honours the WP bit even in supervisor mode... Ok.

Calibrating delay using timer specific routine.. 5668.36 BogoMIPS (lpj=28341813)

Security Framework v1.0.0 initialized

Capability LSM initialized

Mount-cache hash table entries: 512

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

Checking 'hlt' instruction... OK.

SMP alternatives: switching to UP code

ACPI: Core revision 20060707

ENABLING IO-APIC IRQs

SMP alternatives: switching to SMP code

Initializing CPU#1

Initializing CPU#2

Initializing CPU#3

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

Initializing CPU#4

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

Initializing CPU#5

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

Initializing CPU#6

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

Brought up 8 CPUs

Initializing CPU#7

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 6144K

migration_cost=11520

checking if image is initramfs... it is

Freeing initrd memory: 12319k freed

NET: Registered protocol family 16

ACPI: bus type pci registered

PCI: Using MMCONFIG

Setting up standard PCI resources

ACPI: Interpreter enabled

ACPI: Using IOAPIC for interrupt routing

ACPI: PCI Root Bridge [PCI0] (0000:00)

ACPI: Assume root bridge [\_SB_.PCI0] bus is 0

PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1

PCI: Transparent bridge - 0000:00:1e.0

ACPI: PCI Interrupt Link [LNKA] (IRQs *3 4 5 6 7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKD] (IRQs *3 4 5 6 7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.

ACPI: PCI Interrupt Link [LNKF] (IRQs *3 4 5 6 7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 7 10 11 14 15)

ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled.

Linux Plug and Play Support v0.97 (c) Adam Belay

pnp: PnP ACPI init

(XEN) io_apic.c:2228:

(XEN) ioapic_guest_write: apic=0, pin=4, old_irq=4, new_irq=4

(XEN) ioapic_guest_write: old_entry=000009f1, new_entry=000109f1

(XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ!

pnp: PnP ACPI: found 18 devices

xen_mem: Initialising balloon driver.

PCI: Using ACPI for IRQ routing

PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report

pnp: 00:0d: ioport range 0x4d0-0x4d1 has been reserved

pnp: 00:0e: ioport range 0x400-0x41f has been reserved

pnp: 00:0e: ioport range 0x420-0x43f has been reserved

pnp: 00:0e: ioport range 0x440-0x45f has been reserved

pnp: 00:0e: ioport range 0x460-0x47f could not be reserved

pnp: 00:0e: ioport range 0x480-0x48f has been reserved

pnp: 00:0e: ioport range 0x490-0x49f has been reserved

pnp: 00:0e: ioport range 0xf800-0xf81f could not be reserved

pnp: 00:0e: ioport range 0xf820-0xf83f has been reserved

pciback: Error parsing pci_devs_to_hide at "('0f:0.0')"

PCI: Bridge: 0000:00:01.0

IO window: disabled.

MEM window: disabled.

PREFETCH window: disabled.

PCI: Bridge: 0000:00:03.0

IO window: disabled.

MEM window: disabled.

PREFETCH window: disabled.

PCI: Failed to allocate mem resource #6:20000@e0000000 for 0000:60:00.0

PCI: Bridge: 0000:00:05.0

IO window: 1000-1fff

MEM window: f0000000-f1ffffff

PREFETCH window: d0000000-dfffffff

PCI: Bridge: 0000:1e:00.0

IO window: disabled.

MEM window: disabled.

PREFETCH window: disabled.

PCI: Bridge: 0000:1e:01.0

IO window: disabled.

MEM window: disabled.

PREFETCH window: disabled.

PCI: Bridge: 0000:10:00.0

IO window: disabled.

MEM window: disabled.

PREFETCH window: disabled.

PCI: Bridge: 0000:10:00.3

IO window: 2000-2fff

MEM window: f2000000-f20fffff

PREFETCH window: f2600000-f27fffff

PCI: Bridge: 0000:00:09.0

IO window: 2000-2fff

MEM window: f2000000-f21fffff

PREFETCH window: f2600000-f27fffff

PCI: Bridge: 0000:00:1c.0

IO window: disabled.

MEM window: f2300000-f23fffff

PREFETCH window: disabled.

PCI: Bridge: 0000:00:1c.1

IO window: disabled.

MEM window: f2200000-f22fffff

PREFETCH window: disabled.

PCI: Bridge: 0000:00:1e.0

IO window: disabled.

MEM window: f2400000-f24fffff

PREFETCH window: disabled.

ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 24 (level, low) -> IRQ 16

ACPI: PCI Interrupt 0000:00:03.0[A] -> GSI 26 (level, low) -> IRQ 17

ACPI: PCI Interrupt 0000:00:05.0[A] -> GSI 28 (level, low) -> IRQ 18

ACPI: PCI Interrupt 0000:00:09.0[A] -> GSI 32 (level, low) -> IRQ 19

ACPI: PCI Interrupt 0000:10:00.0[A] -> GSI 32 (level, low) -> IRQ 19

ACPI: PCI Interrupt 0000:1e:00.0[A] -> GSI 32 (level, low) -> IRQ 19

ACPI: PCI Interrupt 0000:1e:01.0[A] -> GSI 46 (level, low) -> IRQ 20

ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 21

ACPI: PCI Interrupt 0000:00:1c.1[B] -> GSI 17 (level, low) -> IRQ 22

NET: Registered protocol family 2

IP route cache hash table entries: 32768 (order: 5, 131072 bytes)

TCP established hash table entries: 131072 (order: 8, 1048576 bytes)

TCP bind hash table entries: 65536 (order: 7, 524288 bytes)

TCP: Hash tables configured (established 131072 bind 65536)

TCP reno registered

IA-32 Microcode Update Driver: v1.14a-xen <tigran@xxxxxxxxxxx>

audit: initializing netlink socket (disabled)

audit(1217426482.084:1): initialized

highmem bounce pool size: 64 pages

VFS: Disk quotas dquot_6.5.1

Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)

Initializing Cryptographic API

io scheduler noop registered

io scheduler anticipatory registered

io scheduler deadline registered

io scheduler cfq registered (default)

Floppy drive(s): fd0 is 1.44M

floppy0: Unable to grab DMA2 for the floppy driver

FDC 0 is a post-1991 82077

RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize

loop: loaded (max 8 devices)

Xen virtual console successfully installed as xvc0

Event-channel device installed.

netfront: Initialising virtual ethernet driver.

Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2

ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx

(XEN) PCI add device 00:1f.1

(XEN) PCI remove device 00:1f.1

(XEN) PCI add device 00:1f.2

(XEN) PCI remove device 00:1f.2

PNP: PS/2 Controller [PNP0303:KBD,PNP0f0e:PS2M] at 0x60,0x64 irq 1,12

serio: i8042 AUX port at 0x60,0x64 irq 12

serio: i8042 KBD port at 0x60,0x64 irq 1

mice: PS/2 mouse device common for all mice

md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27

md: bitmap version 4.39

NET: Registered protocol family 1

NET: Registered protocol family 17

(XEN) platform_hypercall.c:183: Domain 0 says that IO-APIC REGSEL is good

Using IPI No-Shortcut mode

ACPI: (supports S0 S3 S4 S5)

BIOS EDD facility v0.16 2004-Jun-25, 1 devices found

Freeing unused kernel memory: 196k freed

input: AT Translated Set 2 keyboard as /class/input/input0

vga16fb: mapped to 0xf55b6000

fb0: VGA16 VGA frame buffer device

ACPI (exconfig-0455): Dynamic SSDT Load - OemId [HPQOEM] OemTableId [ CPU_TM2] [20060707]

ACPI: Processor [CPU0] (supports 8 throttling states)

ACPI: Processor [CPU1] (supports 8 throttling states)

ACPI: Processor [CPU2] (supports 8 throttling states)

ACPI: Processor [CPU3] (supports 8 throttling states)

ACPI: Processor [CPU4] (supports 8 throttling states)

ACPI: Processor [CPU5] (supports 8 throttling states)

ACPI: Processor [CPU6] (supports 8 throttling states)

ACPI: Processor [CPU7] (supports 8 throttling states)

usbcore: registered new driver usbfs

usbcore: registered new driver hub

USB Universal Host Controller Interface driver v3.0

(XEN) PCI add device 00:1d.0

ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 21

uhci_hcd 0000:00:1d.0: UHCI Host Controller

uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1

uhci_hcd 0000:00:1d.0: irq 21, io base 0x00003000

usb usb1: configuration #1 chosen from 1 choice

hub 1-0:1.0: USB hub found

hub 1-0:1.0: 2 ports detected

SCSI subsystem initialized

Fusion MPT base driver 3.04.01

Copyright (c) 1999-2005 LSI Logic Corporation

Fusion MPT SAS Host driver 3.04.01

(XEN) PCI add device 00:1d.1

ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 23

uhci_hcd 0000:00:1d.1: UHCI Host Controller

uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2

uhci_hcd 0000:00:1d.1: irq 23, io base 0x00003020

usb usb2: configuration #1 chosen from 1 choice

hub 2-0:1.0: USB hub found

hub 2-0:1.0: 2 ports detected

input: ImExPS/2 Generic Explorer Mouse as /class/input/input1

(XEN) PCI add device 00:1d.2

ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 24

uhci_hcd 0000:00:1d.2: UHCI Host Controller

uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 3

uhci_hcd 0000:00:1d.2: irq 24, io base 0x00003040

usb usb3: configuration #1 chosen from 1 choice

hub 3-0:1.0: USB hub found

hub 3-0:1.0: 2 ports detected

(XEN) PCI add device 00:1d.3

ACPI: PCI Interrupt 0000:00:1d.3[D] -> GSI 22 (level, low) -> IRQ 25

uhci_hcd 0000:00:1d.3: UHCI Host Controller

uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 4

uhci_hcd 0000:00:1d.3: irq 25, io base 0x00003060

usb usb4: configuration #1 chosen from 1 choice

hub 4-0:1.0: USB hub found

hub 4-0:1.0: 2 ports detected

(XEN) [VT-D]iommu.c:1259:d0 domain_context_mapping:PCI: bdf = 0:1f.2

(XEN) PCI add device 00:1f.2

ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]

ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 19 (level, low) -> IRQ 23

ata1: SATA max UDMA/133 cmd 0x30D0 ctl 0x30EA bmdma 0x30B0 irq 23

ata2: SATA max UDMA/133 cmd 0x30D8 ctl 0x30EE bmdma 0x30B8 irq 23

scsi0 : ata_piix

ata1.00: ATAPI, max UDMA/100

ata1.00: configured for UDMA/100

scsi1 : ata_piix

ATA: abnormal status 0x7F on port 0x30DF

Vendor: ASUS Model: DVD-E616A3T Rev: BP08

Type: CD-ROM ANSI SCSI revision: 05

(XEN) PCI add device 00:1d.7

ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 16 (level, low) -> IRQ 21

ehci_hcd 0000:00:1d.7: EHCI Host Controller

ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 5

ehci_hcd 0000:00:1d.7: debug port 1

ehci_hcd 0000:00:1d.7: irq 21, io mem 0xf2504000

ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004

usb usb5: configuration #1 chosen from 1 choice

hub 5-0:1.0: USB hub found

hub 5-0:1.0: 8 ports detected

(XEN) [VT-D]iommu.c:1259:d0 domain_context_mapping:PCI: bdf = 0:1f.1

(XEN) PCI add device 00:1f.1

ESB2: IDE controller at PCI slot 0000:00:1f.1

ACPI: PCI Interrupt 0000:00:1f.1[A] -> GSI 17 (level, low) -> IRQ 22

ESB2: chipset revision 9

ESB2: not 100% native mode: will probe irqs later

ide0: BM-DMA at 0x30a0-0x30a7, BIOS settings: hda:pio, hdb:pio

(XEN) PCI add device 01:05.0

ACPI: PCI Interrupt 0000:01:05.0[A] -> GSI 19 (level, low) -> IRQ 23

ohci1394: fw-host0: OHCI-1394 1.1 (PCI): IRQ=[23] MMIO=[f2404000-f24047ff] Max Packet=[2048] IR/IT contexts=[4/8]

(XEN) PCI add device 0e:00.0

tg3.c:v3.65 (August 07, 2006)

ACPI: PCI Interrupt 0000:0e:00.0[A] -> GSI 16 (level, low) -> IRQ 21

eth0: Tigon3 [partno(BCM95755) rev a002 PHY(5755)] (PCI Express) 10/100/1000BaseT Ethernet 00:1c:c4:88:0c:98

eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]

eth0: dma_rwctrl[76180000] dma_mask[64-bit]

(XEN) PCI add device 0f:00.0

ACPI: PCI Interrupt 0000:0f:00.0[A] -> GSI 17 (level, low) -> IRQ 22

eth1: Tigon3 [partno(BCM95755) rev a002 PHY(5755)] (PCI Express) 10/100/1000BaseT Ethernet 00:1c:c4:88:0c:97

eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] Split[0] WireSpeed[1] TSOcap[1]

eth1: dma_rwctrl[76180000] dma_mask[64-bit]

(XEN) PCI add device 11:06.0

ACPI: PCI Interrupt 0000:11:06.0[A] -> GSI 62 (level, low) -> IRQ 26

mptbase: Initiating ioc0 bringup

udev: renamed network interface eth0 to eth17

udev: renamed network interface eth1 to eth19

ioc0: SAS1068: Capabilities={Initiator}

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

mptbase: Initiating ioc0 recovery

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

BUG: soft lockup detected on CPU#0!

[<c0151479>] softlockup_tick+0x99/0xe0

[<c01098ca>] timer_interrupt+0x30a/0x6e0

[<c01306cc>] run_timer_softirq+0x9c/0x1f0

[<c01517f3>] handle_IRQ_event+0x33/0xb0

[<c0151913>] __do_IRQ+0xa3/0x120

[<c010779f>] do_IRQ+0x3f/0xa0

[<c024e265>] evtchn_do_upcall+0xc5/0x1e0

[<c0105c0d>] hypervisor_callback+0x3d/0x45

[<c0108d5b>] raw_safe_halt+0x9b/0x110

[<c01047a9>] xen_idle+0x29/0x60

[<c01036e1>] cpu_idle+0x71/0xd0

[<c03cc843>] start_kernel+0x3a3/0x470

[<c03cc230>] unknown_bootoption+0x0/0x270

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

mptbase: Initiating ioc0 recovery

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

BUG: soft lockup detected on CPU#0!

[<c0151479>] softlockup_tick+0x99/0xe0

[<c01098ca>] timer_interrupt+0x30a/0x6e0

[<c0130100>] lock_timer_base+0x20/0x50

[<c027f7b0>] i8042_timer_func+0x0/0x10

[<c0130244>] __mod_timer+0xa4/0xd0

[<c0130100>] lock_timer_base+0x20/0x50

[<c01306cc>] run_timer_softirq+0x9c/0x1f0

[<c01517f3>] handle_IRQ_event+0x33/0xb0

[<c0151913>] __do_IRQ+0xa3/0x120

[<c010779f>] do_IRQ+0x3f/0xa0

[<c024e265>] evtchn_do_upcall+0xc5/0x1e0

[<c0105c0d>] hypervisor_callback+0x3d/0x45

[<c0108d5b>] raw_safe_halt+0x9b/0x110

[<c01047a9>] xen_idle+0x29/0x60

[<c01036e1>] cpu_idle+0x71/0xd0

[<c03cc843>] start_kernel+0x3a3/0x470

[<c03cc230>] unknown_bootoption+0x0/0x270

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

scsi2 : ioc0: LSISAS1068, FwRev=01160100h, Ports=1, MaxQ=286, IRQ=26

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

mptbase: Initiating ioc0 recovery

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

BUG: soft lockup detected on CPU#0!

[<c0151479>] softlockup_tick+0x99/0xe0

[<c01098ca>] timer_interrupt+0x30a/0x6e0

[<c011d629>] __wake_up_common+0x39/0x70

[<c0130100>] lock_timer_base+0x20/0x50

[<c01306cc>] run_timer_softirq+0x9c/0x1f0

[<c01517f3>] handle_IRQ_event+0x33/0xb0

[<c0151913>] __do_IRQ+0xa3/0x120

[<c010779f>] do_IRQ+0x3f/0xa0

[<c024e265>] evtchn_do_upcall+0xc5/0x1e0

[<c0105c0d>] hypervisor_callback+0x3d/0x45

[<c0108d5b>] raw_safe_halt+0x9b/0x110

[<c01047a9>] xen_idle+0x29/0x60

[<c01036e1>] cpu_idle+0x71/0xd0

[<c03cc843>] start_kernel+0x3a3/0x470

[<c03cc230>] unknown_bootoption+0x0/0x270

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

mptbase: mpt_reply: WARNING - ioc0: Invalid cb_idx (0)!

mptbase: Initiating ioc0 recovery

(XEN) [VT-D]iommu.c:766: iommu_page_fault: iommu->reg = fff78000

(XEN) [VT-D]iommu.c:738: iommu_fault_status: Primary Pending Fault

(XEN) [VT-D]iommu.c:720: iommu_fault:DMA Write: 11:6.0 addr 119680000 REASON 2 iommu->reg = fff78000

BUG: soft lockup detected on CPU#0!

[<c0151479>] softlockup_tick+0x99/0xe0

[<c01098ca>] timer_interrupt+0x30a/0x6e0

[<c0105c0d>] hypervisor_callback+0x3d/0x45

[<c01306cc>] run_timer_softirq+0x9c/0x1f0

[<c01517f3>] handle_IRQ_event+0x33/0xb0

[<c0151913>] __do_IRQ+0xa3/0x120

[<c010779f>] do_IRQ+0x3f/0x

Mit freundlichen GrьЯen / Best Regards

Stefan Mitov

Siemens AG
Healthcare Sector 
MED CO CHS CS
Mozartstr. 57
91052 Erlangen, Germany
Tel.: +49 (9131) 84-722433
Fax: +49 (9131) 84-2978
stefan.mitov@xxxxxxxxxxx

Siemens Aktiengesellschaft: Vorsitzender des Aufsichtsrats: Gerhard Cromme; Vorstand: Peter Lцscher, Vorsitzender; Johannes Feldmayer, Heinrich Hiesinger, Joe Kaeser, Rudi Lamprecht, Eduardo Montes, Jьrgen Radomski, Erich R. Reinhardt, Hermann Requardt, Uriel J. Sharef, Klaus Wucherer; Sitz der Gesellschaft: Berlin und Mьnchen; Registergericht: Berlin Charlottenburg, HRB 12300, Mьnchen, HRB 6684; WEEE-Reg.-Nr. DE 23691322

 
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel
<Prev in Thread] Current Thread [Next in Thread>