Re: [Xen-devel] [xen-4.8-testing test] 144726: regressions - trouble: fail/pass/starved

[Ian Jackson <ian.jackson@xxxxxxxxxx>]

osstest service owner writes ("[xen-4.8-testing test] 144726: regressions - 
trouble: fail/pass/starved"):
> flight 144726 xen-4.8-testing real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/144726/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-xtf-amd64-amd64-5 50 xtf/test-hvm64-lbr-tsx-vmentry fail REGR. vs. 
> 144558

See patch below for analysis.  Andrew, would you please take a look
and check that what I said is true.

If Jan approves will force push 4.8-testing.

From Juergen I would like a release-ack for the osstest commit to
"allow" it for the future.

Thanks,
Ian.

From 93a4162b6d85bd1e78d822f1e807517c3e207ce7 Mon Sep 17 00:00:00 2001
From: Ian Jackson <ian.jackson@xxxxxxxxxxxxx>
Date: Thu, 12 Dec 2019 14:37:11 +0000
Subject: [OSSTEST PATCH] allow: xen-4.8-testing xtf/test-hvm64-lbr-tsx-vmentry

Xen 4.8 lacks
  20f1976b44199d1e7a15fe5d2c8c1a4375b74997
  x86/vmx: Fix vmentry failure because of invalid LER on Broadwell
and
  d6e9f8d4f35d938417f9dc2ea50f6e8004e26725
  x86/vmx: fix vmentry failure with TSX bits in LBR
and given its support lifetime, we do not intend to backport them.

These bugs are checked for by xtf/test-hvm64-lbr-tsx-vmentry.  So
those tests fail in xen-4.8-testing but only on applicable hardware.
Because we don't pin these tests to individual hosts (because that
would involve running the XTF tests on each host pair) this can show
up as a "regression".  Force pushing it makes it go away for a bit,
until for some reason the test runs on a different host.

Instead, treat these "regressions" as allowable but only in 4.8.

I have tested this with
  ./sg-report-flight --that-flight=144558 144726
and diff'd before and after.  The difference is as expected, that
  test-xtf-amd64-amd64-5 50 xtf/test-hvm64-lbr-tsx-vmentry fail REGR. vs. 144558
is now
  Regressions which are regarded as allowable (not blocking):

CC: Andrew Cooper <Andrew.Cooper3@xxxxxxxxxx>
CC: Juergen Gross <jgross@xxxxxxxx>
Signed-off-by: Ian Jackson <ian.jackson@xxxxxxxxxxxxx>
---
 allow.xen-4.8-testing | 1 +
 1 file changed, 1 insertion(+)
 create mode 100644 allow.xen-4.8-testing

diff --git a/allow.xen-4.8-testing b/allow.xen-4.8-testing
new file mode 100644
index 00000000..0aff6917
--- /dev/null
+++ b/allow.xen-4.8-testing
@@ -0,0 +1 @@
+test-xtf-amd64-amd64-@@                xtf/test-hvm64-lbr-tsx-vmentry
-- 
2.11.0


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel