[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] [linux-4.19 bisection] complete test-amd64-amd64-qemuu-nested-intel



branch xen-unstable
xenbranch xen-unstable
job test-amd64-amd64-qemuu-nested-intel
testid debian-hvm-install/l1/l2

Tree: linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git

*** Found and reproduced problem changeset ***

  Bug is in tree:  xen git://xenbits.xen.org/xen.git
  Bug introduced:  dafd936dddbd7978d4131275ad1112f64457bf64
  Bug not present: 1ecb1ee4d8475475c3ccf72f6654644b242ce856
  Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/129524/


  commit dafd936dddbd7978d4131275ad1112f64457bf64
  Author: George Dunlap <george.dunlap@xxxxxxxxxx>
  Date:   Mon Oct 29 14:51:51 2018 +0000
  
      Make credit2 the default scheduler
      
      Credit2 was declared "supported" in 4.8, and as of 4.10 had two other
      critical features implemented (soft affinity / NUMA and caps).
      
      Why change the default?
      
      The code is better: more predictable, less jitter, easier to determine
      how modifications will affect overall behavior, easier in the future
      to make load-balancing behavior more subtle (e.g., taking into account
      the cost of powering up extra cores, &c).
      
      Overall performance compared to Credit1 is somewhat of a mixed bag.
      Unfortunately most of what I have are tests using XenServer's internal
      perf testing system, so I can't share the raw data (via links anyway).
      
      Here is a summary of data from an internal e-mail Dario sent in the
      past:
      
      * DVDbench: On underloaded systems, credit2 outperformed credit1 by
      about 4%.  On overloaded systems, credit2 underperformed by about 3%.
      
      * On a range of tests (unixbench, lmbench, &c), credit and credit2
      perform within 5% of each other (up and down).
      
      * Credit2 fairly consistently beats credit for TCP-style workloads.
      
      * Credit2 is sometimes equal to, sometimes 5-15% worse than, credit for
      synthetic CPU workloads (e.g., Dhrystone).
      
      * On LoginVSI, credit2 fairly consistently outperforms credit by about 
10%.
      
      Credit2, like credit, has a number of workloads / setups for which
      performance could be improved.  Personally I think networking and
      partially-loaded systems is going to be more representative of what
      Xen is actually used for; so I think credit2 is on the whole the
      better scheduler to use by default.  And in any case, making those
      improvements on credit2 will be easier than on credit.
      
      Signed-off-by: George Dunlap <george.dunlap@xxxxxxxxxx>
      Acked-by: Dario Faggioli <dfaggioli@xxxxxxxx>


For bisection revision-tuple graph see:
   
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.html
Revision IDs in each graph node refer, respectively, to the Trees above.

----------------------------------------
Running cs-bisection-step 
--graph-out=/home/logs/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2
 --summary-out=tmp/129524.bisection-summary --basis-template=129313 
--blessings=real,real-bisect linux-4.19 test-amd64-amd64-qemuu-nested-intel 
debian-hvm-install/l1/l2
Searching for failure / basis pass:
 129428 fail [host=elbling0] / 129313 [host=huxelrebe0] template as basis? 
using template as basis.
Failure / basis pass flights: 129428 / 129313
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest 07a03b97b9ce2a6430344386eeab9b16283b893f 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
2cf113891a38cc05434bc9876ffc107a990887be
Basis pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 
de5b678ca4dcdfa83e322491d478d66df56c1986 
92666fdd6e0afab989b2d89759d9b43f2c645ae7
Generating revisions with ./adhoc-revtuple-generator  
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git#84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d-07a03b97b9ce2a6430344386eeab9b16283b893f
 
git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860
 
git://xenbits.xen.org/qemu-xen-traditional.git#9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149-d0d8ad39ecb51cd7497cd524484fe09f50876798
 
git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-de5b678ca4dcdfa83e322491d478d66df56c1986
 
git://xenbits.xen.org/xen.git#92666fdd6e0afab989b2d89759d9b43f2c645ae7-2cf113891a38cc05434bc9876ffc107a990887be
Loaded 110636 nodes in revision graph
Searching for test results:
 129313 [host=huxelrebe0]
 129412 fail 07a03b97b9ce2a6430344386eeab9b16283b893f 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
2cf113891a38cc05434bc9876ffc107a990887be
 129428 fail 07a03b97b9ce2a6430344386eeab9b16283b893f 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
2cf113891a38cc05434bc9876ffc107a990887be
 129476 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
1ecb1ee4d8475475c3ccf72f6654644b242ce856
 129497 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
dafd936dddbd7978d4131275ad1112f64457bf64
 129511 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
dafd936dddbd7978d4131275ad1112f64457bf64
 129482 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
45cb9a4123b5550eb1f84846fe5482acae1c13a3
 129459 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 
de5b678ca4dcdfa83e322491d478d66df56c1986 
92666fdd6e0afab989b2d89759d9b43f2c645ae7
 129464 fail 07a03b97b9ce2a6430344386eeab9b16283b893f 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
2cf113891a38cc05434bc9876ffc107a990887be
 129487 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
f355ed8448bc5685af749ebbd3b3816f3c8f927a
 129469 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 
de5b678ca4dcdfa83e322491d478d66df56c1986 
92666fdd6e0afab989b2d89759d9b43f2c645ae7
 129471 fail 07a03b97b9ce2a6430344386eeab9b16283b893f 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
2cf113891a38cc05434bc9876ffc107a990887be
 129490 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
6faff8f9005d685185cd3f4ed116bf45d7d1553f
 129494 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
0a1fa635029d100d4b6b7eddb31d49603217cab7
 129504 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
1ecb1ee4d8475475c3ccf72f6654644b242ce856
 129524 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
dafd936dddbd7978d4131275ad1112f64457bf64
 129517 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
1ecb1ee4d8475475c3ccf72f6654644b242ce856
Searching for interesting versions
 Result found: flight 129459 (pass), for basis pass
 Result found: flight 129464 (fail), for basis failure
 Repro found: flight 129469 (pass), for basis pass
 Repro found: flight 129471 (fail), for basis failure
 0 revisions at 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
d0d8ad39ecb51cd7497cd524484fe09f50876798 
de5b678ca4dcdfa83e322491d478d66df56c1986 
1ecb1ee4d8475475c3ccf72f6654644b242ce856
No revisions left to test, checking graph state.
 Result found: flight 129476 (pass), for last pass
 Result found: flight 129497 (fail), for first failure
 Repro found: flight 129504 (pass), for last pass
 Repro found: flight 129511 (fail), for first failure
 Repro found: flight 129517 (pass), for last pass
 Repro found: flight 129524 (fail), for first failure

*** Found and reproduced problem changeset ***

  Bug is in tree:  xen git://xenbits.xen.org/xen.git
  Bug introduced:  dafd936dddbd7978d4131275ad1112f64457bf64
  Bug not present: 1ecb1ee4d8475475c3ccf72f6654644b242ce856
  Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/129524/


  commit dafd936dddbd7978d4131275ad1112f64457bf64
  Author: George Dunlap <george.dunlap@xxxxxxxxxx>
  Date:   Mon Oct 29 14:51:51 2018 +0000
  
      Make credit2 the default scheduler
      
      Credit2 was declared "supported" in 4.8, and as of 4.10 had two other
      critical features implemented (soft affinity / NUMA and caps).
      
      Why change the default?
      
      The code is better: more predictable, less jitter, easier to determine
      how modifications will affect overall behavior, easier in the future
      to make load-balancing behavior more subtle (e.g., taking into account
      the cost of powering up extra cores, &c).
      
      Overall performance compared to Credit1 is somewhat of a mixed bag.
      Unfortunately most of what I have are tests using XenServer's internal
      perf testing system, so I can't share the raw data (via links anyway).
      
      Here is a summary of data from an internal e-mail Dario sent in the
      past:
      
      * DVDbench: On underloaded systems, credit2 outperformed credit1 by
      about 4%.  On overloaded systems, credit2 underperformed by about 3%.
      
      * On a range of tests (unixbench, lmbench, &c), credit and credit2
      perform within 5% of each other (up and down).
      
      * Credit2 fairly consistently beats credit for TCP-style workloads.
      
      * Credit2 is sometimes equal to, sometimes 5-15% worse than, credit for
      synthetic CPU workloads (e.g., Dhrystone).
      
      * On LoginVSI, credit2 fairly consistently outperforms credit by about 
10%.
      
      Credit2, like credit, has a number of workloads / setups for which
      performance could be improved.  Personally I think networking and
      partially-loaded systems is going to be more representative of what
      Xen is actually used for; so I think credit2 is on the whole the
      better scheduler to use by default.  And in any case, making those
      improvements on credit2 will be easier than on credit.
      
      Signed-off-by: George Dunlap <george.dunlap@xxxxxxxxxx>
      Acked-by: Dario Faggioli <dfaggioli@xxxxxxxx>

Revision graph left in 
/home/logs/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.{dot,ps,png,html,svg}.
----------------------------------------
129524: tolerable ALL FAIL

flight 129524 linux-4.19 real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/129524/

Failures :-/ but no regressions.

Tests which did not succeed,
including tests which could not be run:
 test-amd64-amd64-qemuu-nested-intel 17 debian-hvm-install/l1/l2 fail baseline 
untested


jobs:
 test-amd64-amd64-qemuu-nested-intel                          fail    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.