WARNING - OLD ARCHIVES

This is an archived copy of the Xen.org mailing list, which we have preserved to ensure that existing links to archives are not broken. The live archive, which contains the latest emails, can be found at http://lists.xen.org/
   
 
 
Xen 
 
Home Products Support Community News
 
   
 

xen-devel

Re: [Xen-devel] Nasty messages when doing IO in dom0

To: Keir Fraser <keir.fraser@xxxxxxxxxxxxx>
Subject: Re: [Xen-devel] Nasty messages when doing IO in dom0
From: Jeremy Fitzhardinge <jeremy@xxxxxxxx>
Date: Tue, 08 Jun 2010 10:49:36 -0700
Cc: Xen-devel <xen-devel@xxxxxxxxxxxxxxxxxxx>, Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>, Daniel Stodden <Daniel.Stodden@xxxxxxxxxx>
Delivery-date: Tue, 08 Jun 2010 10:50:28 -0700
Envelope-to: www-data@xxxxxxxxxxxxxxxxxxx
In-reply-to: <C8344093.1718E%keir.fraser@xxxxxxxxxxxxx>
List-help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-id: Xen developer discussion <xen-devel.lists.xensource.com>
List-post: <mailto:xen-devel@lists.xensource.com>
List-subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
List-unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>, <mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
References: <C8344093.1718E%keir.fraser@xxxxxxxxxxxxx>
Sender: xen-devel-bounces@xxxxxxxxxxxxxxxxxxx
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.9) Gecko/20100430 Fedora/3.0.4-2.fc12 Lightning/1.0b2pre Thunderbird/3.0.4
On 06/08/2010 10:46 AM, Keir Fraser wrote:
> On 08/06/2010 18:28, "Jeremy Fitzhardinge" <jeremy@xxxxxxxx> wrote:
>
>   
>> I was doing some heavy IO in dom0 (moving around some lvm pvs), and I
>> started getting awful messages on the xen console (below for
>> posterity).  There's nothing particularly blktap-ish about the
>> symptoms.   But it has been a long time since I've seen this kind of
>> thing, and blktap is the main thing doing heroic stuff with page mapping.
>>     
> The immediate cause is a leaked writable mapping of a page which eventually
> got recycled as a top-level page directory. A train wreck then inevitably
> follows. Obvious question is: who leaked the mapping? :-)
>   

Yep.   And I'm wondering if the complaint from sata is a separate
symptom or related.  But once a device is set up and mapped, it doesn't
play with memory mappings any more.

There are quite a few pfn/mfns mentioned, so its clearly something that
happened more than once (or once to multiple pages).

    J

>  -- Keir
>
>   
>> I wonder if there could be a problem with having dom0 accessing directly
>> the same devices that guests are accessing via blktap or something?  In
>> particular, the lvm operation is happening from within the kernel, so it
>> may have a slightly unusual access path.  In general it has all been
>> pretty stable, so I'm reaching for unusual things.
>>
>> There are also some sata errors in there as well, which is a bit
>> worrying.  The device itself seems perfectly solid when accessing it
>> from a stock kernel running native, so it looks like something
>> Xen-related.  But I'm not sure if its the same issue or not.
>>
>> This is on a kernel which hadn't yet got your most recent set of
>> patches.  Could this be something they would have fixed?
>>
>> Thanks,
>>     J
>>
>> [root@lilith ~]#  sde: sde1
>> ata6.00: exception Emask 0x10 SAct 0x4 SErr 0x400100 action 0x6 frozen
>> ata6.00: irq_stat 0x08000000, interface fatal error
>> ata6: SError: { UnrecovData Handshk }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:10:3f:e5:07/00:00:00:00:00/40 tag 2 ncq 65536 out
>>          res 40/00:10:3f:e5:07/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6: hard resetting link
>> ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>> ata6.00: configured for UDMA/133
>> ata6: EH complete
>> ata6.00: exception Emask 0x10 SAct 0x1 SErr 0x400100 action 0x6 frozen
>> ata6.00: irq_stat 0x08000000, interface fatal error
>> ata6: SError: { UnrecovData Handshk }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:00:3f:c4:15/00:00:00:00:00/40 tag 0 ncq 65536 out
>>          res 40/00:00:3f:c4:15/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6: hard resetting link
>> ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>> ata6.00: configured for UDMA/133
>> ata6: EH complete
>> ata6.00: exception Emask 0x10 SAct 0xe SErr 0x400100 action 0x6 frozen
>> ata6.00: irq_stat 0x08000000, interface fatal error
>> ata6: SError: { UnrecovData Handshk }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:08:bf:92:19/00:00:00:00:00/40 tag 1 ncq 65536 out
>>          res 40/00:18:bf:93:19/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:10:3f:93:19/00:00:00:00:00/40 tag 2 ncq 65536 out
>>          res 40/00:18:bf:93:19/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:18:bf:93:19/00:00:00:00:00/40 tag 3 ncq 65536 out
>>          res 40/00:18:bf:93:19/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6: hard resetting link
>> ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
>> ata6.00: configured for UDMA/133
>> ata6: EH complete
>> ata6: limiting SATA link speed to 1.5 Gbps
>> ata6.00: exception Emask 0x10 SAct 0x2 SErr 0x400100 action 0x6 frozen
>> ata6.00: irq_stat 0x08000000, interface fatal error
>> ata6: SError: { UnrecovData Handshk }
>> ata6.00: failed command: WRITE FPDMA QUEUED
>> ata6.00: cmd 61/80:08:3f:d5:19/00:00:00:00:00/40 tag 1 ncq 65536 out
>>          res 40/00:08:3f:d5:19/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
>> ata6.00: status: { DRDY }
>> ata6: hard resetting link
>> ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
>> ata6.00: configured for UDMA/133
>> ata6: EH complete
>>
>> [... later ...]
>>
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2939:d0 Error while pinning mfn 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>>
>> Broadcast message from jeremy@xxxxxxxxxxxxxxx
>>         (/dev/pts/3) at 17:26 ...
>>
>> The system is going down for reboot NOW!
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> Disabling monthly Smolt update: [  OK  ]
>> Shutting down Avahi daemon: (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001
>> != exp 4000000000000000) for mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> dbus-daemon[3202]: segfault at 1c ip 00007f160be579a0 sp 00007fff958ea088
>> error 6 in dbus-daemon[7f160be28000+51000]
>> Process 3202(dbus-daemon) has RLIMIT_CORE set to 0
>> Aborting core
>> [  OK  ]
>> Stopping atd: [  OK  ]
>> usb 1-1.2: unlink qh8-0601/ffff8800be626bc0 start 3 [1/2 us]
>> Shutting down console mouse services: gpm[3014]: segfault at 82466e ip
>> 000000000040f000 sp 00007fff805ec060 error 6 in gpm[400000+16000]
>> Process 3014(gpm) has RLIMIT_CORE set to 0
>> Aborting core
>> [  OK  ]
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> Stopping abrt daemon: [  OK  ]
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 3400000000000001 != exp 7000000000000000) 
>> for
>> mfn 179799 (pfn 84432)
>> (XEN) mm.c:880:d0 Error getting mfn 179799 (pfn 84432) from L1 entry
>> 8000000179799063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for
>> mfn 14ba5b (pfn 56970)
>> (XEN) mm.c:880:d0 Error getting mfn 14ba5b (pfn 56970) from L1 entry
>> 800000014ba5b063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 23253b (pfn bd290)
>> (XEN) mm.c:880:d0 Error getting mfn 23253b (pfn bd290) from L1 entry
>> 800000023253b063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 229be4 (pfn b47e7)
>> (XEN) mm.c:880:d0 Error getting mfn 229be4 (pfn b47e7) from L1 entry
>> 8000000229be4063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 176ae2 (pfn 818e9)
>> (XEN) mm.c:880:d0 Error getting mfn 176ae2 (pfn 818e9) from L1 entry
>> 8000000176ae2063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 168d23 (pfn 73aa8)
>> (XEN) mm.c:880:d0 Error getting mfn 168d23 (pfn 73aa8) from L1 entry
>> 8000000168d23063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 16c363 (pfn 77068)
>> (XEN) mm.c:880:d0 Error getting mfn 16c363 (pfn 77068) from L1 entry
>> 800000016c363063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 15563d (pfn 6058e)
>> (XEN) mm.c:880:d0 Error getting mfn 15563d (pfn 6058e) from L1 entry
>> 800000015563d063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 1b1537 (pfn 3c594)
>> (XEN) mm.c:880:d0 Error getting mfn 1b1537 (pfn 3c594) from L1 entry
>> 80000001b1537063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 228965 (pfn b3666)
>> (XEN) mm.c:880:d0 Error getting mfn 228965 (pfn b3666) from L1 entry
>> 8000000228965063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 222181 (pfn ace4a)
>> (XEN) mm.c:880:d0 Error getting mfn 222181 (pfn ace4a) from L1 entry
>> 8000000222181063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 21e4ef (pfn a92dc)
>> (XEN) mm.c:880:d0 Error getting mfn 21e4ef (pfn a92dc) from L1 entry
>> 800000021e4ef063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 230701 (pfn bb4ca)
>> (XEN) mm.c:880:d0 Error getting mfn 230701 (pfn bb4ca) from L1 entry
>> 8000000230701063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 17eee7 (pfn 89ce4)
>> (XEN) mm.c:880:d0 Error getting mfn 17eee7 (pfn 89ce4) from L1 entry
>> 800000017eee7063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 16b3f3 (pfn 75fd8)
>> (XEN) mm.c:880:d0 Error getting mfn 16b3f3 (pfn 75fd8) from L1 entry
>> 800000016b3f3063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 1635f3 (pfn 6e1d8)
>> (XEN) mm.c:880:d0 Error getting mfn 1635f3 (pfn 6e1d8) from L1 entry
>> 80000001635f3063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 18ee49 (pfn 19e82)
>> (XEN) mm.c:880:d0 Error getting mfn 18ee49 (pfn 19e82) from L1 entry
>> 800000018ee49063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 17c457 (pfn 87374)
>> (XEN) mm.c:880:d0 Error getting mfn 17c457 (pfn 87374) from L1 entry
>> 800000017c457063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for
>> mfn 1900d7 (pfn 1aff4)
>> (XEN) mm.c:880:d0 Error getting mfn 1900d7 (pfn 1aff4) from L1 entry
>> 80000001900d7063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 18fdb7 (pfn 1ad14)
>> (XEN) mm.c:880:d0 Error getting mfn 18fdb7 (pfn 1ad14) from L1 entry
>> 800000018fdb7063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 4400000000000001 != exp 7000000000000000) 
>> for
>> mfn 1a6457 (pfn 31474)
>> (XEN) mm.c:880:d0 Error getting mfn 1a6457 (pfn 31474) from L1 entry
>> 80000001a6457063 for l1e_owner=0, pg_owner=0
>> BUG: unable to handle kernel paging request at ffff880056970010
>> IP: [<ffffffff8100f3f5>] xen_set_pmd+0x49/0x86
>> PGD 1002067 PUD 2e2067 PMD 397067 PTE 8010000056970065
>> Oops: 0003 [#1] PREEMPT SMP
>> last sysfs file: /sys/devices/system/cpu/cpu3/cache/index2/shared_cpu_map
>> CPU 3
>> Modules linked in: bridge stp llc xt_physdev nf_conntrack_netbios_ns xt_state
>> dm_multipath usblp e1000e thermal xts gf128mul cryptd aes_x86_64 dm_crypt
>> dm_snapshot dm_zero dm_mirror dm_region_hash dm_log raid10 ahci [last
>> unloaded: microcode]
>> Pid: 22155, comm: dbus-daemon Not tainted 2.6.32.15 #32 X8SIL
>> RIP: e030:[<ffffffff8100f3f5>]  [<ffffffff8100f3f5>] xen_set_pmd+0x49/0x86
>> RSP: e02b:ffff88007f3ebd08  EFLAGS: 00010246
>> RAX: 0000000000000000 RBX: ffff880056970010 RCX: 0000000000000024
>> RDX: ffffea0000000000 RSI: 0000000000000000 RDI: ffff880056970010
>> RBP: ffff88007f3ebd28 R08: 00007fff20e17000 R09: ffff88001ed32ef8
>> R10: ffff8800031826b0 R11: 0000000000000000 R12: 00007feb4285d000
>> R13: ffff8800031826b0 R14: 00007feb40400000 R15: ffff8800314747f8
>> FS:  00007feb424247c0(0000) GS:ffff880003174000(0000) knlGS:0000000000000000
>> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: ffff880056970010 CR3: 0000000001001000 CR4: 0000000000002660
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process dbus-daemon (pid: 22155, threadinfo ffff88007f3ea000, task
>> ffff880025722000)
>> Stack:
>>  00007fff20e17000 0000000000000000 00007feb40408000 00007feb40600000
>> <0> ffff88007f3ebde8 ffffffff810b8a5d ffff8800031826b0 ffff88001ed32ef8
>> <0> dead000000100100 00007f8000000000 00007fff00000000 00007feb4285cfff
>> Call Trace:
>>  [<ffffffff810b8a5d>] free_pgd_range+0x3aa/0x3f5
>>  [<ffffffff810b8b4c>] free_pgtables+0xa4/0xc8
>>  [<ffffffff810ba598>] exit_mmap+0x129/0x1ac
>>  [<ffffffff810414a8>] mmput+0x3e/0xe5
>>  [<ffffffff810455eb>] exit_mm+0x100/0x10b
>>  [<ffffffff81047097>] do_exit+0x1fa/0x6d8
>>  [<ffffffff814972e8>] ? lockdep_sys_exit_thunk+0x35/0x67
>>  [<ffffffff810475e8>] do_group_exit+0x73/0x9c
>>  [<ffffffff81047623>] sys_exit_group+0x12/0x16
>>  [<ffffffff81013b82>] system_call_fastpath+0x16/0x1b
>> Code: 00 00 00 31 c0 48 89 d7 c6 05 c3 fd 85 00 00 f3 ab ff 05 07 fd 85 00 48
>> 89 75 e8 48 89 df e8 75 dd ff ff 48 8b 75 e8 84 c0 75 05 <48> 89 33 eb 31 80
>> 3d 9b fd 85 00 00 74 1a 48 c7 c2 d0 f0 86 81
>> RIP  [<ffffffff8100f3f5>] xen_set_pmd+0x49/0x86
>>  RSP <ffff88007f3ebd08>
>> CR2: ffff880056970010
>> ---[ end trace c5f9fdc66655c17b ]---
>> Fixing recursive fault but reboot is needed!
>> BUG: scheduling while atomic: dbus-daemon/22155/0x00000002
>> INFO: lockdep is turned off.
>> Modules linked in: bridge stp llc xt_physdev nf_conntrack_netbios_ns xt_state
>> dm_multipath usblp e1000e thermal xts gf128mul cryptd aes_x86_64 dm_crypt
>> dm_snapshot dm_zero dm_mirror dm_region_hash dm_log raid10 ahci [last
>> unloaded: microcode]
>> irq event stamp: 0
>> hardirqs last  enabled at (0): [<(null)>] (null)
>> hardirqs last disabled at (0): [<ffffffff8104221b>] copy_process+0x5ae/0x13fb
>> softirqs last  enabled at (0): [<ffffffff8104221b>] copy_process+0x5ae/0x13fb
>> softirqs last disabled at (0): [<(null)>] (null)
>> Pid: 22155, comm: dbus-daemon Tainted: G      D    2.6.32.15 #32
>> Call Trace:
>>  [<ffffffff81065930>] ? print_irqtrace_events+0xd0/0xd4
>>  [<ffffffff8103b837>] __schedule_bug+0x72/0x77
>>  [<ffffffff81494756>] schedule+0xd8/0x885
>>  [<ffffffff810446ce>] ? vprintk+0x39c/0x3f6
>>  [<ffffffff81010142>] ? check_events+0x12/0x20
>>  [<ffffffff8105be65>] ? up+0xf/0x39
>>  [<ffffffff81046f60>] do_exit+0xc3/0x6d8
>>  [<ffffffff81010142>] ? check_events+0x12/0x20
>>  [<ffffffff81498e7a>] oops_end+0xbf/0xc7
>>  [<ffffffff8102ee00>] no_context+0x1ee/0x1fd
>>  [<ffffffff8102ef95>] __bad_area_nosemaphore+0x186/0x1a9
>>  [<ffffffff8100c9f5>] ? __raw_callee_save_xen_pmd_val+0x11/0x1e
>>  [<ffffffff8102efc6>] bad_area_nosemaphore+0xe/0x10
>>  [<ffffffff8149a5d6>] do_page_fault+0x23d/0x389
>>  [<ffffffff814981d5>] page_fault+0x25/0x30
>>  [<ffffffff8100f3f5>] ? xen_set_pmd+0x49/0x86
>>  [<ffffffff8100f3ed>] ? xen_set_pmd+0x41/0x86
>>  [<ffffffff810b8a5d>] free_pgd_range+0x3aa/0x3f5
>>  [<ffffffff810b8b4c>] free_pgtables+0xa4/0xc8
>>  [<ffffffff810ba598>] exit_mmap+0x129/0x1ac
>>  [<ffffffff810414a8>] mmput+0x3e/0xe5
>>  [<ffffffff810455eb>] exit_mm+0x100/0x10b
>>  [<ffffffff81047097>] do_exit+0x1fa/0x6d8
>>  [<ffffffff814972e8>] ? lockdep_sys_exit_thunk+0x35/0x67
>>  [<ffffffff810475e8>] do_group_exit+0x73/0x9c
>>  [<ffffffff81047623>] sys_exit_group+0x12/0x16
>>  [<ffffffff81013b82>] system_call_fastpath+0x16/0x1b
>>
>> Shutting down AppleTalk services:
>>   Stopping afpd:[  OK  ]
>>   Stopping cnid_metad:[  OK  ]
>>
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> Shutting down NMB services: (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001
>> != exp 4000000000000000) for mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> [  OK  ]
>> Shutting down SMB services: (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001
>> != exp 4000000000000000) for mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> [  OK  ]
>> Stopping crond: [  OK  ]
>> Stopping acpi daemon: (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != 
>> exp
>> 4000000000000000) for mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> [  OK  ]
>> Stopping HAL daemon: [  OK  ]
>> Shutting down ntpd: [  OK  ]
>> Stopping PC/SC smart card daemon (pcscd): (XEN) mm.c:2367:d0 Bad type (saw
>> 7400000000000001 != exp 4000000000000000) for mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> [  OK  ]
>> Stopping NFS statd: [  OK  ]
>> Killing mdmonitor: [  OK  ]
>> Stopping system message bus: [  OK  ]
>> (XEN) mm.c:2367:d0 Bad type (saw 7400000000000001 != exp 4000000000000000) 
>> for
>> mfn 184699 (pfn f632)
>> (XEN) mm.c:2706:d0 Error while installing new baseptr 184699
>> (XEN) mm.c:2367:d0 Bad type (saw 3400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22b552 (pfn b6279)
>> (XEN) mm.c:880:d0 Error getting mfn 22b552 (pfn b6279) from L1 entry
>> 800000022b552063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22b4c3 (pfn b6308)
>> (XEN) mm.c:880:d0 Error getting mfn 22b4c3 (pfn b6308) from L1 entry
>> 800000022b4c3063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22f630 (pfn ba59b)
>> (XEN) mm.c:880:d0 Error getting mfn 22f630 (pfn ba59b) from L1 entry
>> 800000022f630063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 227c21 (pfn b2baa)
>> (XEN) mm.c:880:d0 Error getting mfn 227c21 (pfn b2baa) from L1 entry
>> 8000000227c21063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 23097f (pfn bb64c)
>> (XEN) mm.c:880:d0 Error getting mfn 23097f (pfn bb64c) from L1 entry
>> 800000023097f063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22b553 (pfn b6278)
>> (XEN) mm.c:880:d0 Error getting mfn 22b553 (pfn b6278) from L1 entry
>> 800000022b553063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22577b (pfn b0450)
>> (XEN) mm.c:880:d0 Error getting mfn 22577b (pfn b0450) from L1 entry
>> 800000022577b063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22e062 (pfn b8f69)
>> (XEN) mm.c:880:d0 Error getting mfn 22e062 (pfn b8f69) from L1 entry
>> 800000022e062063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22de32 (pfn b8d99)
>> (XEN) mm.c:880:d0 Error getting mfn 22de32 (pfn b8d99) from L1 entry
>> 800000022de32063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22de33 (pfn b8d98)
>> (XEN) mm.c:880:d0 Error getting mfn 22de33 (pfn b8d98) from L1 entry
>> 800000022de33063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22b36e (pfn b605d)
>> (XEN) mm.c:880:d0 Error getting mfn 22b36e (pfn b605d) from L1 entry
>> 800000022b36e063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22de44 (pfn b8d87)
>> (XEN) mm.c:880:d0 Error getting mfn 22de44 (pfn b8d87) from L1 entry
>> 800000022de44063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 232ca0 (pfn bdb2b)
>> (XEN) mm.c:880:d0 Error getting mfn 232ca0 (pfn bdb2b) from L1 entry
>> 8000000232ca0063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 227c22 (pfn b2ba9)
>> (XEN) mm.c:880:d0 Error getting mfn 227c22 (pfn b2ba9) from L1 entry
>> 8000000227c22063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22592f (pfn b069c)
>> (XEN) mm.c:880:d0 Error getting mfn 22592f (pfn b069c) from L1 entry
>> 800000022592f063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 227c23 (pfn b2ba8)
>> (XEN) mm.c:880:d0 Error getting mfn 227c23 (pfn b2ba8) from L1 entry
>> 8000000227c23063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 225644 (pfn b0587)
>> (XEN) mm.c:880:d0 Error getting mfn 225644 (pfn b0587) from L1 entry
>> 8000000225644063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 225645 (pfn b0586)
>> (XEN) mm.c:880:d0 Error getting mfn 225645 (pfn b0586) from L1 entry
>> 8000000225645063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22ade0 (pfn b59eb)
>> (XEN) mm.c:880:d0 Error getting mfn 22ade0 (pfn b59eb) from L1 entry
>> 800000022ade0063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for
>> mfn 22ade1 (pfn b59ea)
>> (XEN) mm.c:880:d0 Error getting mfn 22ade1 (pfn b59ea) from L1 entry 
>> 800000022ade1063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 225646 (pfn b0585)
>> (XEN) mm.c:880:d0 Error getting mfn 225646 (pfn b0585) from L1 entry 
>> 8000000225646063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 225647 (pfn b0584)
>> (XEN) mm.c:880:d0 Error getting mfn 225647 (pfn b0584) from L1 entry 
>> 8000000225647063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b550 (pfn b627b)
>> (XEN) mm.c:880:d0 Error getting mfn 22b550 (pfn b627b) from L1 entry 
>> 800000022b550063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b551 (pfn b627a)
>> (XEN) mm.c:880:d0 Error getting mfn 22b551 (pfn b627a) from L1 entry 
>> 800000022b551063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230c86 (pfn bbb45)
>> (XEN) mm.c:880:d0 Error getting mfn 230c86 (pfn bbb45) from L1 entry 
>> 8000000230c86063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2306a2 (pfn bb529)
>> (XEN) mm.c:880:d0 Error getting mfn 2306a2 (pfn bb529) from L1 entry 
>> 80000002306a2063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22ade2 (pfn b59e9)
>> (XEN) mm.c:880:d0 Error getting mfn 22ade2 (pfn b59e9) from L1 entry 
>> 800000022ade2063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22ade3 (pfn b59e8)
>> (XEN) mm.c:880:d0 Error getting mfn 22ade3 (pfn b59e8) from L1 entry 
>> 800000022ade3063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22ad69 (pfn b5a62)
>> (XEN) mm.c:880:d0 Error getting mfn 22ad69 (pfn b5a62) from L1 entry 
>> 800000022ad69063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 231f2e (pfn bcc9d)
>> (XEN) mm.c:880:d0 Error getting mfn 231f2e (pfn bcc9d) from L1 entry 
>> 8000000231f2e063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de30 (pfn b8d9b)
>> (XEN) mm.c:880:d0 Error getting mfn 22de30 (pfn b8d9b) from L1 entry 
>> 800000022de30063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de31 (pfn b8d9a)
>> (XEN) mm.c:880:d0 Error getting mfn 22de31 (pfn b8d9a) from L1 entry 
>> 800000022de31063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 229600 (pfn b45cb)
>> (XEN) mm.c:880:d0 Error getting mfn 229600 (pfn b45cb) from L1 entry 
>> 8000000229600063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 225942 (pfn b0689)
>> (XEN) mm.c:880:d0 Error getting mfn 225942 (pfn b0689) from L1 entry 
>> 8000000225942063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 23233f (pfn bd08c)
>> (XEN) mm.c:880:d0 Error getting mfn 23233f (pfn bd08c) from L1 entry 
>> 800000023233f063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 231212 (pfn bc1b9)
>> (XEN) mm.c:880:d0 Error getting mfn 231212 (pfn bc1b9) from L1 entry 
>> 8000000231212063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b214 (pfn b61b7)
>> (XEN) mm.c:880:d0 Error getting mfn 22b214 (pfn b61b7) from L1 entry 
>> 800000022b214063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22f632 (pfn ba599)
>> (XEN) mm.c:880:d0 Error getting mfn 22f632 (pfn ba599) from L1 entry 
>> 800000022f632063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22f631 (pfn ba59a)
>> (XEN) mm.c:880:d0 Error getting mfn 22f631 (pfn ba59a) from L1 entry 
>> 800000022f631063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b349 (pfn b6082)
>> (XEN) mm.c:880:d0 Error getting mfn 22b349 (pfn b6082) from L1 entry 
>> 800000022b349063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 23071d (pfn bb4ae)
>> (XEN) mm.c:880:d0 Error getting mfn 23071d (pfn bb4ae) from L1 entry 
>> 800000023071d063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de45 (pfn b8d86)
>> (XEN) mm.c:880:d0 Error getting mfn 22de45 (pfn b8d86) from L1 entry 
>> 800000022de45063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de47 (pfn b8d84)
>> (XEN) mm.c:880:d0 Error getting mfn 22de47 (pfn b8d84) from L1 entry 
>> 800000022de47063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 3400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 227c20 (pfn b2bab)
>> (XEN) mm.c:880:d0 Error getting mfn 227c20 (pfn b2bab) from L1 entry 
>> 8000000227c20063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de79 (pfn b8d52)
>> (XEN) mm.c:880:d0 Error getting mfn 22de79 (pfn b8d52) from L1 entry 
>> 800000022de79063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2259eb (pfn b05e0)
>> (XEN) mm.c:880:d0 Error getting mfn 2259eb (pfn b05e0) from L1 entry 
>> 80000002259eb063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2259ea (pfn b05e1)
>> (XEN) mm.c:880:d0 Error getting mfn 2259ea (pfn b05e1) from L1 entry 
>> 80000002259ea063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de78 (pfn b8d53)
>> (XEN) mm.c:880:d0 Error getting mfn 22de78 (pfn b8d53) from L1 entry 
>> 800000022de78063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22f79e (pfn ba42d)
>> (XEN) mm.c:880:d0 Error getting mfn 22f79e (pfn ba42d) from L1 entry 
>> 800000022f79e063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cfc (pfn bbacf)
>> (XEN) mm.c:880:d0 Error getting mfn 230cfc (pfn bbacf) from L1 entry 
>> 8000000230cfc063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de7b (pfn b8d50)
>> (XEN) mm.c:880:d0 Error getting mfn 22de7b (pfn b8d50) from L1 entry 
>> 800000022de7b063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22de7a (pfn b8d51)
>> (XEN) mm.c:880:d0 Error getting mfn 22de7a (pfn b8d51) from L1 entry 
>> 800000022de7a063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b571 (pfn b625a)
>> (XEN) mm.c:880:d0 Error getting mfn 22b571 (pfn b625a) from L1 entry 
>> 800000022b571063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b570 (pfn b625b)
>> (XEN) mm.c:880:d0 Error getting mfn 22b570 (pfn b625b) from L1 entry 
>> 800000022b570063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b290 (pfn b613b)
>> (XEN) mm.c:880:d0 Error getting mfn 22b290 (pfn b613b) from L1 entry 
>> 800000022b290063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b319 (pfn b60b2)
>> (XEN) mm.c:880:d0 Error getting mfn 22b319 (pfn b60b2) from L1 entry 
>> 800000022b319063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b573 (pfn b6258)
>> (XEN) mm.c:880:d0 Error getting mfn 22b573 (pfn b6258) from L1 entry 
>> 800000022b573063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b572 (pfn b6259)
>> (XEN) mm.c:880:d0 Error getting mfn 22b572 (pfn b6259) from L1 entry 
>> 800000022b572063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22a498 (pfn b5333)
>> (XEN) mm.c:880:d0 Error getting mfn 22a498 (pfn b5333) from L1 entry 
>> 800000022a498063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cc4 (pfn bbb07)
>> (XEN) mm.c:880:d0 Error getting mfn 230cc4 (pfn bbb07) from L1 entry 
>> 8000000230cc4063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cc6 (pfn bbb05)
>> (XEN) mm.c:880:d0 Error getting mfn 230cc6 (pfn bbb05) from L1 entry 
>> 8000000230cc6063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cc5 (pfn bbb06)
>> (XEN) mm.c:880:d0 Error getting mfn 230cc5 (pfn bbb06) from L1 entry 
>> 8000000230cc5063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2326d5 (pfn bd4f6)
>> (XEN) mm.c:880:d0 Error getting mfn 2326d5 (pfn bd4f6) from L1 entry 
>> 80000002326d5063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230de6 (pfn bb9e5)
>> (XEN) mm.c:880:d0 Error getting mfn 230de6 (pfn bb9e5) from L1 entry 
>> 8000000230de6063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cc7 (pfn bbb04)
>> (XEN) mm.c:880:d0 Error getting mfn 230cc7 (pfn bbb04) from L1 entry 
>> 8000000230cc7063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 2400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22a540 (pfn b528b)
>> (XEN) mm.c:880:d0 Error getting mfn 22a540 (pfn b528b) from L1 entry 
>> 800000022a540063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2306b8 (pfn bb513)
>> (XEN) mm.c:880:d0 Error getting mfn 2306b8 (pfn bb513) from L1 entry 
>> 80000002306b8063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b37c (pfn b604f)
>> (XEN) mm.c:880:d0 Error getting mfn 22b37c (pfn b604f) from L1 entry 
>> 800000022b37c063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230de7 (pfn bb9e4)
>> (XEN) mm.c:880:d0 Error getting mfn 230de7 (pfn bb9e4) from L1 entry 
>> 8000000230de7063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2306b9 (pfn bb512)
>> (XEN) mm.c:880:d0 Error getting mfn 2306b9 (pfn bb512) from L1 entry 
>> 80000002306b9063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b5b2 (pfn b6219)
>> (XEN) mm.c:880:d0 Error getting mfn 22b5b2 (pfn b6219) from L1 entry 
>> 800000022b5b2063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2306ba (pfn bb511)
>> (XEN) mm.c:880:d0 Error getting mfn 2306ba (pfn bb511) from L1 entry 
>> 80000002306ba063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 2259ce (pfn b05fd)
>> (XEN) mm.c:880:d0 Error getting mfn 2259ce (pfn b05fd) from L1 entry 
>> 80000002259ce063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 22b2e3 (pfn b60e8)
>> (XEN) mm.c:880:d0 Error getting mfn 22b2e3 (pfn b60e8) from L1 entry 
>> 800000022b2e3063 for l1e_owner=0, pg_owner=0
>> (XEN) mm.c:2367:d0 Bad type (saw 1400000000000001 != exp 7000000000000000) 
>> for 
>> mfn 230cfa (pfn bbad1)
>> (X[  OK  ]
>> Shutting down interface xenbr0:  xenbr0: port 3(vif5.1) entering disabled 
>> state
>> xenbr0: port 2(vif1.1) entering disabled state
>> xenbr0: port 1(eth0) entering disabled state
>> [  OK  ]
>> Shutting down interface eth0:  xenbr0: port 1(eth0) entering disabled state
>> [  OK  ]
>> Shutting down loopback interface:  [  OK  ]
>> Disabling IPv4 packet forwarding:  net.ipv4.ip_forward = 0
>> [  OK  ]
>> ip6tables: Flushing firewall rules: [  OK  ]
>> ip6tables: Setting chains to policy ACCEPT: mangle filter [  OK  ]
>> ip6tables: Unloading modules: [  OK  ]
>> iptables: Flushing firewall rules: [  OK  ]
>> iptables: Setting chains to policy ACCEPT: nat mangle filter [  OK  ]
>> iptables: Unloading modules: [  OK  ]
>> Sending all processes the TERM signal... (XEN) mm.c:3000:d0 Mfn 184699 not 
>> pinned
>> blktap_ring_vm_close: unmapping ring 2
>> blktap_ring_vm_close: unmapping ring 1
>> blktap_ring_vm_close: unmapping ring 0
>> blktap_ring_release: freeing device 2
>> blktap_ring_release: freeing device 1
>> blktap_ring_release: freeing device 0
>> blktap_ring_vm_close: unmapping ring 4
>> [  OK  ]
>> blktap_ring_vm_close: unmapping ring 5
>> blktap_ring_release: freeing device 5
>> blktap_ring_vm_close: unmapping ring 6
>> Sending all processes the KILL signal... [  OK  ]
>> Saving random seed:  [  OK  ]
>> Syncing hardware clock to system time [  OK  ]
>> Turning off swap:  [  OK  ]
>> Turning off quotas:  [  OK  ]
>> Unmounting file systems:  [  OK  ]
>> Stopping disk encryption for luks-11eb0145-088a-4c13-acf4-9784e82bb1e3 [  OK 
>>  
>> ]
>> Stopping disk encryption for luks-37e6b844-a112-427c-be60-ae6f4d9c5041 [  OK 
>>  
>> ]
>> mount: /dev/shm not mounted already, or bad option
>> Please stand by while rebooting the system...
>> __ratelimit: 4 callbacks suppressed
>> blktap_device_do_request: device closed: failing secs 73163416 - 73163432
>> blktap_device_do_request: device closed: failing secs 73163424 - 73163432
>> ------------[ cut here ]------------
>> kernel BUG at block/blk-core.c:2111!
>> invalid opcode: 0000 [#4] PREEMPT SMP
>> last sysfs file: 
>> /sys/devices/pci0000:00/0000:00:1c.4/0000:04:00.0/net/eth0/address
>> CPU 1
>> Modules linked in: bridge stp llc xt_physdev nf_conntrack_netbios_ns 
>> xt_state 
>> dm_multipath usblp e1000e thermal xts gf128mul cryptd aes_x86_64 dm_crypt 
>> dm_snapshot dm_zero dm_mirror dm_region_hash dm_log raid10 ahci [last 
>> unloaded: microcode]
>> Pid: 3555, comm: blkback.1.xvdc Tainted: G      D    2.6.32.15 #32 X8SIL
>> RIP: e030:[<ffffffff811c62a5>]  [<ffffffff811c62a5>] 
>> blk_finish_request+0x2e/0x27f
>> RSP: e02b:ffff88009a27dcb0  EFLAGS: 00010006
>> RAX: 0000000000000001 RBX: ffff8800352dacb0 RCX: 0000000000000000
>> RDX: ffff88008f1b5000 RSI: 0000000000000000 RDI: ffff8800352dacb0
>> RBP: ffff88009a27dd00 R08: 0000000000000000 R09: ffffffff81700f80
>> R10: 0000000000000080 R11: ffffffff81036d76 R12: 0000000000000000
>> R13: 0000000000000000 R14: 0000000000000000 R15: ffff88008f1b5000
>> FS:  00007f37d6cb2700(0000) GS:ffff88000313c000(0000) knlGS:0000000000000000
>> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: 00000036350a4af0 CR3: 0000000048f63000 CR4: 0000000000002660
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process blkback.1.xvdc (pid: 3555, threadinfo ffff88009a27c000, task 
>> ffff88008f1b5000)
>> Stack:
>>  0000000000000000 0000000000000000 ffff88009a27dcd0 ffffffff81250c0f
>> <0> ffff88009a27dd00 ffff8800352dacb0 0000000000000000 0000000000000000
>> <0> ffff88009a27de78 ffff88008f1b5000 ffff88009a27dd20 ffffffff811c66fb
>> Call Trace:
>>  [<ffffffff81250c0f>] ? add_disk_randomness+0x29/0x2b
>>  [<ffffffff811c66fb>] __blk_end_request+0x27/0x2e
>>  [<ffffffff811c676e>] __blk_end_request_cur+0x30/0x32
>>  [<ffffffff8124795b>] blktap_device_do_request+0x279/0x298
>>  [<ffffffff81066c07>] ? trace_hardirqs_off+0xd/0xf
>>  [<ffffffff8149782c>] ? _spin_unlock_irqrestore+0x56/0x74
>>  [<ffffffff8104d5b4>] ? del_timer+0x7f/0x89
>>  [<ffffffff811c7011>] __generic_unplug_device+0x30/0x35
>>  [<ffffffff811c703f>] generic_unplug_device+0x29/0x3a
>>  [<ffffffff81242eaf>] unplug_queue+0x26/0x41
>>  [<ffffffff81243a3c>] blkif_schedule+0x1e8/0x290
>>  [<ffffffff8105807b>] ? autoremove_wake_function+0x0/0x34
>>  [<ffffffff81243854>] ? blkif_schedule+0x0/0x290
>>  [<ffffffff81057e09>] kthread+0x7a/0x82
>>  [<ffffffff81014cfa>] child_rip+0xa/0x20
>>  [<ffffffff81014654>] ? restore_args+0x0/0x30
>>  [<ffffffff81014cf0>] ? child_rip+0x0/0x20
>> Code: e5 41 57 41 56 41 89 f6 41 55 41 54 53 48 89 fb 48 83 ec 28 f6 47 49 
>> 10 
>> 74 0c 48 8b 7f 40 48 89 de e8 df 1a 00 00 48 39 1b 74 04 <0f> 0b eb fe 83 3d 
>> 28 da f6 00 00 74 0b 83 7b 4c 01 75 05 e8 ea
>> RIP  [<ffffffff811c62a5>] blk_finish_request+0x2e/0x27f
>>  RSP <ffff88009a27dcb0>
>> ---[ end trace c5f9fdc66655c17e ]---
>> note: blkback.1.xvdc[3555] exited with preempt_count 1
>> md: stopping all md devices.
>> ------------[ cut here ]------------
>> kernel BUG at drivers/md/md.c:6163!
>> invalid opcode: 0000 [#5] PREEMPT SMP
>> last sysfs file: 
>> /sys/devices/pci0000:00/0000:00:1c.4/0000:04:00.0/net/eth0/address
>> CPU 0
>> Modules linked in: bridge stp llc xt_physdev nf_conntrack_netbios_ns 
>> xt_state 
>> dm_multipath usblp e1000e thermal xts gf128mul cryptd aes_x86_64 dm_crypt 
>> dm_snapshot dm_zero dm_mirror dm_region_hash dm_log raid10 ahci [last 
>> unloaded: microcode]
>> Pid: 22689, comm: kmirrord Tainted: G      D    2.6.32.15 #32 X8SIL
>> RIP: e030:[<ffffffff8132ecfa>]  [<ffffffff8132ecfa>] 
>> md_write_start+0x22/0x14b
>> RSP: e02b:ffff8800bc1ff870  EFLAGS: 00010246
>> RAX: 0000000000000001 RBX: ffff8800bbd75800 RCX: 0000000000001800
>> RDX: 0000000000000080 RSI: ffff88001f82e740 RDI: ffff8800bbd75800
>> RBP: ffff8800bc1ff8c0 R08: 0000000016896200 R09: 0000000000000080
>> R10: 0000000000000200 R11: ffffffff8105be65 R12: 00000000000000c1
>> R13: ffff8800bbd75800 R14: ffff88001f82e740 R15: ffff8800bbc0d540
>> FS:  00007f37d6cb2700(0000) GS:ffff880003120000(0000) knlGS:0000000000000000
>> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: 0000000001b5a178 CR3: 0000000048f63000 CR4: 0000000000002660
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process kmirrord (pid: 22689, threadinfo ffff8800bc1fe000, task 
>> ffff8800bb5f4000)
>> Stack:
>>  0000000000000000 00000000970a89dc 0000000000000000 ffff880000000001
>> <0> ffff8800bd3bfb58 0000000000000001 ffffffff8105be65 ffff8800bbd7ac00
>> <0> 00000000000000c1 ffff8800bbd75800 ffff8800bc1ff950 ffffffffa000e49d
>> Call Trace:
>>  [<ffffffff8105be65>] ? up+0xf/0x39
>>  [<ffffffffa000e49d>] make_request+0x105/0x65a [raid10]
>>  [<ffffffff8132f63c>] ? md_make_request+0x40/0x1d1
>>  [<ffffffff8132f742>] ? md_make_request+0x146/0x1d1
>>  [<ffffffff8101012f>] ? xen_restore_fl_direct_end+0x0/0x1
>>  [<ffffffff8106a2e7>] ? lock_release+0x15a/0x167
>>  [<ffffffff8132f78f>] md_make_request+0x193/0x1d1
>>  [<ffffffff8132f63c>] ? md_make_request+0x40/0x1d1
>>  [<ffffffff8105b864>] ? up_read+0x1e/0x36
>>  [<ffffffff8133a687>] ? dm_request+0x289/0x296
>>  [<ffffffff8133a444>] ? dm_request+0x46/0x296
>>  [<ffffffff811c5ed1>] generic_make_request+0x29d/0x2f9
>>  [<ffffffff8133c360>] ? linear_merge+0x4d/0x58
>>  [<ffffffff8133a7ac>] ? dm_merge_bvec+0xc6/0xe5
>>  [<ffffffff811c6052>] submit_bio+0x125/0x146
>>  [<ffffffff8133ead5>] dispatch_io+0x18b/0x1be
>>  [<ffffffff8133e836>] ? vm_get_page+0x0/0x42
>>  [<ffffffff8133e7fe>] ? vm_next_page+0x0/0x1c
>>  [<ffffffff8100f849>] ? xen_force_evtchn_callback+0xd/0xf
>>  [<ffffffff8105be65>] ? up+0xf/0x39
>>  [<ffffffff8133ec98>] dm_io+0x130/0x226
>>  [<ffffffff8133e836>] ? vm_get_page+0x0/0x42
>>  [<ffffffff8133e7fe>] ? vm_next_page+0x0/0x1c
>>  [<ffffffffa0012982>] disk_flush+0x33/0x55 [dm_log]
>>  [<ffffffff810a17c0>] ? mempool_free+0x71/0x76
>>  [<ffffffffa00164c2>] dm_rh_update_states+0x2e1/0x2f0 [dm_region_hash]
>>  [<ffffffffa001c86b>] do_mirror+0xa1/0x5ae [dm_mirror]
>>  [<ffffffff8100f849>] ? xen_force_evtchn_callback+0xd/0xf
>>  [<ffffffff81058257>] ? prepare_to_wait+0x1e/0x69
>>  [<ffffffff81010142>] ? check_events+0x12/0x20
>>  [<ffffffff81058257>] ? prepare_to_wait+0x1e/0x69
>>  [<ffffffff81054198>] ? worker_thread+0x19a/0x2ef
>>  [<ffffffff810541ed>] worker_thread+0x1ef/0x2ef
>>  [<ffffffff81054198>] ? worker_thread+0x19a/0x2ef
>>  [<ffffffffa001c7ca>] ? do_mirror+0x0/0x5ae [dm_mirror]
>>  [<ffffffff8105807b>] ? autoremove_wake_function+0x0/0x34
>>  [<ffffffff81053ffe>] ? worker_thread+0x0/0x2ef
>>  [<ffffffff81057e09>] kthread+0x7a/0x82
>>  [<ffffffff81014cfa>] child_rip+0xa/0x20
>>  [<ffffffff81014654>] ? restore_args+0x0/0x30
>>  [<ffffffff81014cf0>] ? child_rip+0x0/0x20
>> Code: 5c 41 5d 41 5e 41 5f c9 c3 55 48 89 e5 41 55 41 54 53 48 89 fb 48 83 
>> ec 
>> 38 f6 46 20 01 0f 84 26 01 00 00 8b 47 38 83 f8 01 75 04 <0f> 0b eb fe 45 31 
>> e4 83 f8 02 75 2a c7 47 38 00 00 00 00 f0 80
>> RIP  [<ffffffff8132ecfa>] md_write_start+0x22/0x14b
>>  RSP <ffff8800bc1ff870>
>> ---[ end trace c5f9fdc66655c17f ]---
>> md: md1 switched to read-only mode.
>> md: md0 switched to read-only mode.
>> sd 5:0:0:0: [sde] Synchronizing SCSI cache
>> xenbus_dev_shutdown: backend/console/5/0: Initialising != Connected, skipping
>> xenbus_dev_shutdown: backend/vkbd/5/0: Initialising != Connected, skipping
>> xenbus_dev_shutdown: backend/vfb/5/0: Initialising != Connected, skipping
>> blktap_device_do_request: device closed: failing secs 12817088 - 12817096
>> ------------[ cut here ]------------
>> kernel BUG at block/blk-core.c:2111!
>> invalid opcode: 0000 [#6] PREEMPT SMP
>> last sysfs file: 
>> /sys/devices/pci0000:00/0000:00:1c.4/0000:04:00.0/net/eth0/address
>> CPU 0
>> Modules linked in: bridge stp llc xt_physdev nf_conntrack_netbios_ns 
>> xt_state 
>> dm_multipath usblp e1000e thermal xts gf128mul cryptd aes_x86_64 dm_crypt 
>> dm_snapshot dm_zero dm_mirror dm_region_hash dm_log raid10 ahci [last 
>> unloaded: microcode]
>> Pid: 17290, comm: blkback.5.xvda Tainted: G      D    2.6.32.15 #32 X8SIL
>> RIP: e030:[<ffffffff811c62a5>]  [<ffffffff811c62a5>] 
>> blk_finish_request+0x2e/0x27f
>>
>>
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-devel
>>     
>
>   


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

<Prev in Thread] Current Thread [Next in Thread>