|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] Re: [Xen-devel] [xen-unstable test] 57852: regressions - FAIL
On Thu, 2015-06-04 at 12:01 +0000, osstest service user wrote: > flight 57852 xen-unstable real [real] > http://logs.test-lab.xenproject.org/osstest/logs/57852/ > > Regressions :-( > > Tests which did not succeed and are blocking, > including tests which could not be run: > test-amd64-amd64-xl-qemuu-win7-amd64 9 windows-install fail REGR. vs. > 57419 Is anyone looking into this? It seems to have been intermittent for a long time but the probability of failure seems to have increased significantly some time around flight 52633 (see [0]). Before that it failed <5% of the time and since then it looks to be closer to 45-50%. 5% could be put down to infrastructure or guest flakiness, 50% seems more like something on the Xen (or qemu etc) side. The bisector is taking a look[1] but TBH given a 50% pass rate I think it is unlikely to get anywhere (I suspect this isn't its first attempt at this either, pretty sure I saw a failed attempt on an earlier range). Taking 50370 as a rough baseline (4 consecutive passes before the first of the more frequent failures) gives a range of b6e7fbadbda4..5c44b5cf352e which is quite a few. It's noteworthy though that qemuu didn't change during the interval 50370..52633 (again, from [0]). None of the vnc snapshots look interesting, just the windows login screen. Neither do any of the logs look interesting. Ian. [0] http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-amd64-xl-qemuu-win7-amd64.xen-unstable.html [1] http://logs.test-lab.xenproject.org/osstest/results/bisect.xen-unstable.test-amd64-amd64-xl-qemuu-win7-amd64.windows-install.html > > Regressions which are regarded as allowable (not blocking): > test-amd64-amd64-libvirt-xsm 11 guest-start fail REGR. vs. > 57419 > test-amd64-i386-libvirt 11 guest-start fail like > 57419 > test-amd64-i386-libvirt-xsm 11 guest-start fail like > 57419 > test-amd64-amd64-libvirt 11 guest-start fail like > 57419 > test-amd64-amd64-rumpuserxen-amd64 15 > rumpuserxen-demo-xenstorels/xenstorels.repeat fail like 57419 > test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stop fail like > 57419 > test-armhf-armhf-libvirt-xsm 11 guest-start fail like > 57419 > test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop fail like > 57419 > > Tests which did not succeed, but are not blocking: > test-amd64-i386-xl-xsm 14 guest-localmigrate fail never > pass > test-amd64-amd64-xl-pvh-amd 11 guest-start fail never > pass > test-amd64-amd64-xl-xsm 14 guest-localmigrate fail never > pass > test-amd64-amd64-xl-pvh-intel 11 guest-start fail never > pass > test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 12 guest-localmigrate fail > never pass > test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 12 guest-localmigrate fail > never pass > test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 12 guest-localmigrate fail > never pass > test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 12 guest-localmigrate fail > never pass > test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop fail never > pass > test-armhf-armhf-libvirt 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-xsm 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-arndale 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never > pass > test-armhf-armhf-xl 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-sedf 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-sedf-pin 12 migrate-support-check fail never > pass > test-armhf-armhf-xl-credit2 12 migrate-support-check fail never > pass > > version targeted for testing: > xen fed56ba0e69b251d0222ef0785cd1c1838f9e51d > baseline version: > xen d6b6bd8374ac30597495d457829ce7ad6e8b7016 > > ------------------------------------------------------------ > People who touched revisions under test: > Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Dario Faggioli <dario.faggioli@xxxxxxxxxx> > George Dunlap <george.dunlap@xxxxxxxxxxxxx> > Ian Campbell <ian.campbell@xxxxxxxxxx> > Jan Beulich <jbeulich@xxxxxxxx> > Kevin Tian <kevin.tian@xxxxxxxxx> > Roger Pau Monnà <roger.pau@xxxxxxxxxx> > Ross Lagerwall <ross.lagerwall@xxxxxxxxxx> > Tim Deegan <tim@xxxxxxx> > Vitaly Kuznetsov <vkuznets@xxxxxxxxxx> > Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > ------------------------------------------------------------ > > jobs: > build-amd64-xsm pass > build-armhf-xsm pass > build-i386-xsm pass > build-amd64 pass > build-armhf pass > build-i386 pass > build-amd64-libvirt pass > build-armhf-libvirt pass > build-i386-libvirt pass > build-amd64-oldkern pass > build-i386-oldkern pass > build-amd64-pvops pass > build-armhf-pvops pass > build-i386-pvops pass > build-amd64-rumpuserxen pass > build-i386-rumpuserxen pass > test-amd64-amd64-xl pass > test-armhf-armhf-xl pass > test-amd64-i386-xl pass > test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm fail > test-amd64-i386-xl-qemut-debianhvm-amd64-xsm fail > test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm fail > test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm fail > test-amd64-amd64-libvirt-xsm fail > test-armhf-armhf-libvirt-xsm fail > test-amd64-i386-libvirt-xsm fail > test-amd64-amd64-xl-xsm fail > test-armhf-armhf-xl-xsm pass > test-amd64-i386-xl-xsm fail > test-amd64-amd64-xl-pvh-amd fail > test-amd64-i386-qemut-rhel6hvm-amd pass > test-amd64-i386-qemuu-rhel6hvm-amd pass > test-amd64-amd64-xl-qemut-debianhvm-amd64 pass > test-amd64-i386-xl-qemut-debianhvm-amd64 pass > test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass > test-amd64-i386-xl-qemuu-debianhvm-amd64 pass > test-amd64-i386-freebsd10-amd64 pass > test-amd64-amd64-xl-qemuu-ovmf-amd64 pass > test-amd64-i386-xl-qemuu-ovmf-amd64 pass > test-amd64-amd64-rumpuserxen-amd64 fail > test-amd64-amd64-xl-qemut-win7-amd64 fail > test-amd64-i386-xl-qemut-win7-amd64 fail > test-amd64-amd64-xl-qemuu-win7-amd64 fail > test-amd64-i386-xl-qemuu-win7-amd64 fail > test-armhf-armhf-xl-arndale pass > test-amd64-amd64-xl-credit2 pass > test-armhf-armhf-xl-credit2 pass > test-armhf-armhf-xl-cubietruck pass > test-amd64-i386-freebsd10-i386 pass > test-amd64-i386-rumpuserxen-i386 pass > test-amd64-amd64-xl-pvh-intel fail > test-amd64-i386-qemut-rhel6hvm-intel pass > test-amd64-i386-qemuu-rhel6hvm-intel pass > test-amd64-amd64-libvirt fail > test-armhf-armhf-libvirt pass > test-amd64-i386-libvirt fail > test-amd64-amd64-xl-multivcpu pass > test-armhf-armhf-xl-multivcpu pass > test-amd64-amd64-pair pass > test-amd64-i386-pair pass > test-amd64-amd64-xl-sedf-pin pass > test-armhf-armhf-xl-sedf-pin pass > test-amd64-amd64-xl-sedf pass > test-armhf-armhf-xl-sedf pass > test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass > test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass > test-amd64-amd64-xl-qemut-winxpsp3 pass > test-amd64-i386-xl-qemut-winxpsp3 pass > test-amd64-amd64-xl-qemuu-winxpsp3 pass > test-amd64-i386-xl-qemuu-winxpsp3 pass > > > ------------------------------------------------------------ > sg-report-flight on osstest.test-lab.xenproject.org > logs: /home/logs/logs > images: /home/logs/images > > Logs, config files, etc. are available at > http://logs.test-lab.xenproject.org/osstest/logs > > Test harness code can be found at > http://xenbits.xen.org/gitweb?p=osstest.git;a=summary > > > Not pushing. > > ------------------------------------------------------------ > commit fed56ba0e69b251d0222ef0785cd1c1838f9e51d > Author: Jan Beulich <jbeulich@xxxxxxxx> > Date: Tue Jun 2 13:45:03 2015 +0200 > > unmodified-drivers: tolerate IRQF_DISABLED being undefined > > It's being removed in Linux 4.1. > > Signed-off-by: Jan Beulich <jbeulich@xxxxxxxx> > Acked-by: Ian Campbell <ian.campbell@xxxxxxxxxx> > > commit 8a753b3f1cf5e4714974196df9517849bf174324 > Author: Ross Lagerwall <ross.lagerwall@xxxxxxxxxx> > Date: Tue Jun 2 13:44:24 2015 +0200 > > efi: fix allocation problems if ExitBootServices() fails > > If calling ExitBootServices() fails, the required memory map size may > have increased. When initially allocating the memory map, allocate a > slightly larger buffer (by an arbitrary 8 entries) to fix this. > > The ARM code path was already allocating a larger buffer than required, > so this moves the code to be common for all architectures. > > This was seen on the following machine when using the iscsidxe UEFI > driver. The machine would consistently fail the first call to > ExitBootServices(). > System Information > Manufacturer: Supermicro > Product Name: X10SLE-F/HF > BIOS Information > Vendor: American Megatrends Inc. > Version: 2.00 > Release Date: 04/24/2014 > > Signed-off-by: Ross Lagerwall <ross.lagerwall@xxxxxxxxxx> > Acked-by: Jan Beulich <jbeulich@xxxxxxxx> > Reviewed-by: Roy Franz <roy.franz@xxxxxxxxxx> > Acked-by: Ian Campbell <ian.campbell@xxxxxxxxxx> > > commit 376bbbabbda607d2039b8f839f15ff02721597d2 > Author: Dario Faggioli <dario.faggioli@xxxxxxxxxx> > Date: Tue Jun 2 13:43:15 2015 +0200 > > sched_rt: print useful affinity info when dumping > > In fact, printing the cpupool's CPU online mask > for each vCPU is just redundant, as that is the > same for all the vCPUs of all the domains in the > same cpupool, while hard affinity is already part > of the output of dumping domains info. > > Instead, print the intersection between hard > affinity and online CPUs, which is --in case of this > scheduler-- the effective affinity always used for > the vCPUs. > > This change also takes the chance to add a scratch > cpumask area, to avoid having to either put one > (more) cpumask_t on the stack, or dynamically > allocate it within the dumping routine. (The former > being bad because hypervisor stack size is limited, > the latter because dynamic allocations can fail, if > the hypervisor was built for a large enough number > of CPUs.) We allocate such scratch area, for all pCPUs, > when the first instance of the RTDS scheduler is > activated and, in order not to loose track/leak it > if other instances are activated in new cpupools, > and when the last instance is deactivated, we (sort > of) refcount it. > > Such scratch area can be used to kill most of the > cpumasks{_var}_t local variables in other functions > in the file, but that is *NOT* done in this chage. > > Finally, convert the file to use keyhandler scratch, > instead of open coded string buffers. > > Signed-off-by: Dario Faggioli <dario.faggioli@xxxxxxxxxx> > Reviewed-by: Meng Xu <mengxu@xxxxxxxxxxxxx> > Acked-by: George Dunlap <george.dunlap@xxxxxxxxxxxxx> > > commit e758ed14f390342513405dd766e874934573e6cb > Author: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Date: Mon Jun 1 12:00:18 2015 +0200 > > docs: clarification to terms used in hypervisor memory management > > Memory management is hard[citation needed]. Furthermore, it isn't helped > by > the inconsistent use of terms through the code, or that some terms have > changed meaning over time. > > Describe the currently-used terms in a more practical fashon, so new code > has > a concrete reference. > > Signed-off-by: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Acked-by: Tim Deegan <tim@xxxxxxx> > > commit 591e1e357c29589e9d6121d8faadc4f4d3b9013e > Author: Ross Lagerwall <ross.lagerwall@xxxxxxxxxx> > Date: Mon Jun 1 11:59:14 2015 +0200 > > x86: don't crash when mapping a page using EFI runtime page tables > > When an interrupt is received during an EFI runtime service call, Xen > may call map_domain_page() while using the EFI runtime page tables. > This fails because, although the EFI runtime page tables are a > copy of the idle domain's page tables, current points at a different > domain's vCPU. > > To fix this, return NULL from mapcache_current_vcpu() when using the EFI > runtime page tables which is treated equivalently to running in an idle > vCPU. > > This issue can be reproduced by repeatedly calling GetVariable() from > dom0 while using VT-d, since VT-d frequently maps a page from interrupt > context. > > Example call trace: > [<ffff82d0801615dc>] __find_next_zero_bit+0x28/0x60 > [<ffff82d08016a10e>] map_domain_page+0x4c6/0x4eb > [<ffff82d080156ae6>] map_vtd_domain_page+0xd/0xf > [<ffff82d08015533a>] msi_msg_read_remap_rte+0xe3/0x1d8 > [<ffff82d08014e516>] iommu_read_msi_from_ire+0x31/0x34 > [<ffff82d08016ff6c>] set_msi_affinity+0x134/0x17a > [<ffff82d0801737b5>] move_masked_irq+0x5c/0x98 > [<ffff82d080173816>] move_native_irq+0x25/0x36 > [<ffff82d08016ffcb>] ack_nonmaskable_msi_irq+0x19/0x20 > [<ffff82d08016ffdb>] ack_maskable_msi_irq+0x9/0x37 > [<ffff82d080173e8b>] do_IRQ+0x251/0x635 > [<ffff82d080234502>] common_interrupt+0x62/0x70 > [<00000000df7ed2be>] 00000000df7ed2be > > Signed-off-by: Ross Lagerwall <ross.lagerwall@xxxxxxxxxx> > > commit 47ec25a3c8cdd7a057af0a05e8e00257ef950437 > Merge: 088e9b2 818e376 > Author: Ian Campbell <ian.campbell@xxxxxxxxxx> > Date: Fri May 29 13:22:31 2015 +0100 > > Merge branch 'staging' of ssh://xenbits.xen.org/home/xen/git/xen into > staging > > commit 088e9b2796bd1f9ebe4fda800275cc689677b699 > Author: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > Date: Mon May 18 15:03:56 2015 +0800 > > libxc/restore: implement Remus checkpointed restore > > With Remus, the restore flow should be: > the first full migration stream -> { periodically restore stream } > > Signed-off-by: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > Signed-off-by: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > CC: Ian Campbell <Ian.Campbell@xxxxxxxxxx> > CC: Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx> > CC: Wei Liu <wei.liu2@xxxxxxxxxx> > Reviewed-by: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Acked-by: Ian Campbell <ian.campbell@xxxxxxxxxx> > > commit a25e4e96fc95150f5c58d069de1b204aa6487ed8 > Author: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > Date: Mon May 18 15:03:55 2015 +0800 > > libxc/save: implement Remus checkpointed save > > With Remus, the save flow should be: > live migration->{ periodically save(checkpointed save) } > > Signed-off-by: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > CC: Ian Campbell <Ian.Campbell@xxxxxxxxxx> > CC: Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx> > CC: Wei Liu <wei.liu2@xxxxxxxxxx> > CC: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Reviewed-by: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Acked-by: Ian Campbell <ian.campbell@xxxxxxxxxx> > > commit cfa955591caea5d7ec505cdcbf4442f2d6e889e1 > Author: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > Date: Mon May 18 15:03:54 2015 +0800 > > libxc/save: refactor of send_domain_memory_live() > > Split the send_domain_memory_live() into three helper function: > - send_memory_live() do the actually live send > - suspend_and_send_dirty() suspend the guest and send dirty pages > - send_memory_verify() > The motivation of this is that when we send checkpointed stream, we > will skip the actually live part. > > Signed-off-by: Yang Hongyang <yanghy@xxxxxxxxxxxxxx> > CC: Ian Campbell <Ian.Campbell@xxxxxxxxxx> > CC: Ian Jackson <Ian.Jackson@xxxxxxxxxxxxx> > CC: Wei Liu <wei.liu2@xxxxxxxxxx> > CC: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Reviewed-by: Andrew Cooper <andrew.cooper3@xxxxxxxxxx> > Acked-by: Ian Campbell <ian.campbell@xxxxxxxxxx> > > commit 818e376d3b17845d39735517650224c64c9e0078 > Author: Jan Beulich <jbeulich@xxxxxxxx> > Date: Thu May 28 12:07:33 2015 +0200 > > Revert "use ticket locks for spin locks" > > This reverts commit 45fcc4568c5162b00fb3907fb158af82dd484a3d as it > introduces yet to be explained issues on ARM. > > commit 02cdd81aa0a88007addc788c6cf93e2f1cb1a314 > Author: Jan Beulich <jbeulich@xxxxxxxx> > Date: Thu May 28 12:06:47 2015 +0200 > > Revert "spinlock: fix build with older GCC" > > This reverts commit 1037e33c88bb0e1fe530c164f242df17030102e1 as its > prereq commit 45fcc4568c is about to be reverted. > > commit 814ca12647f06b023f4aac8eae837ba9b417acc7 > Author: Jan Beulich <jbeulich@xxxxxxxx> > Date: Thu May 28 11:59:34 2015 +0200 > > Revert "x86,arm: remove asm/spinlock.h from all architectures" > > This reverts commit e62e49e6d5d4e8d22f3df0b75443ede65a812435 as > its prerequisite 45fcc4568c is going to be reverted. > > commit cf6b3ccf28faee01a078311fcfe671148c81ea75 > Author: Roger Pau Monnà <roger.pau@xxxxxxxxxx> > Date: Thu May 28 10:56:08 2015 +0200 > > x86/pvh: disable posted interrupts > > Enabling posted interrupts requires the virtual interrupt delivery > feature, > which is disabled for PVH guests, so make sure posted interrupts are also > disabled or else vmlaunch will fail. > > Signed-off-by: Roger Pau Monnà <roger.pau@xxxxxxxxxx> > Reported-and-Tested-by: Lars Eggert <lars@xxxxxxxxxx> > Acked-by: Kevin Tian <kevin.tian@xxxxxxxxx> > > commit d4d39de054a6f6c5a474aee62999a8ea7c2fd180 > Author: Vitaly Kuznetsov <vkuznets@xxxxxxxxxx> > Date: Thu May 28 10:55:43 2015 +0200 > > public: fix xen_domctl_monitor_op_t definition > > It seems xen_domctl_monitor_op_t was supposed to be a typedef for > struct xen_domctl_monitor_op and not the non-existent xen_domctl__op. > > Signed-off-by: Vitaly Kuznetsov <vkuznets@xxxxxxxxxx> > (qemu changes not included) > > _______________________________________________ > Xen-devel mailing list > Xen-devel@xxxxxxxxxxxxx > http://lists.xen.org/xen-devel _______________________________________________ Xen-devel mailing list Xen-devel@xxxxxxxxxxxxx http://lists.xen.org/xen-devel
|
 |
Lists.xenproject.org is hosted with RackSpace, monitoring our |