WW15 - 2018-04-09- Full Test Cycle - 2.5 M3 rc1: Difference between revisions
No edit summary |
No edit summary |
||
(5 intermediate revisions by the same user not shown) | |||
Line 98: | Line 98: | ||
=Testing data= | =Testing data= | ||
<nowiki> | <nowiki> | ||
Test type: | Test type: Full Pass Test | ||
Branch: | Branch: master | ||
Build name: | Build name: yocto-2.5_M3.rc1 | ||
poky commit: | poky commit: f49ee61422c867516db252054e993df29f775136 | ||
Autobuilder images repository: | Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/yocto-2.5_M3.rc1/ | ||
Distributions tested: | Distributions tested: | ||
CentOs 7 | |||
Debian 9 | |||
Fedora 26 | |||
Fedora 27 | |||
OpenSuse 42.3 | |||
Ubuntu 16.04 | |||
Ubuntu 17.10 | |||
</nowiki> | </nowiki> | ||
{| | {| | ||
Line 136: | Line 143: | ||
|sort=ID | |sort=ID | ||
|group=product | |group=product | ||
|id= | |id=12641,12637,12655,12647,12665,12666,12633,12670 | ||
}} | }} | ||
<br> | <br> | ||
== <span style="color: red; "> High and M+ | == <span style="color: red; "> High and M+ issues Found during QA Test (NOT NEW) </span>== | ||
{{#bugzilla: | {{#bugzilla: | ||
|columns=id,summary,priority,to,qa,milestone,status,resolution,cf_regression_type,created | |columns=id,summary,priority,to,qa,milestone,status,resolution,cf_regression_type,created | ||
Line 146: | Line 153: | ||
|sort=priority | |sort=priority | ||
|group=product | |group=product | ||
|id= | |id=11431,12590,12444,11288 | ||
}}<br> | }}<br> | ||
Line 155: | Line 162: | ||
|sort=priority | |sort=priority | ||
|group=cf_regression_type,product | |group=cf_regression_type,product | ||
|id= | |id=12591,12499 | ||
}} | }} | ||
Line 178: | Line 185: | ||
= Build Performance Test = | = Build Performance Test = | ||
Detailed description on how performance test is run canbe found on the [[Performance Test]] wiki. | Detailed description on how performance test is run canbe found on the [[Performance Test]] wiki. | ||
The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had | The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different. | ||
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | * [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | ||
Line 187: | Line 194: | ||
== Performance Charts== | == Performance Charts== | ||
Note: performance test results in below are both executed from the same machines in Linux Foundation. | |||
[[File: | [[File:Ww15-2k18 - table.png | 600px]] | ||
=pTest for genericx86-64 on NUC= | =pTest for genericx86-64 on NUC= | ||
Line 221: | Line 212: | ||
== results == | == results == | ||
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive] | |||
<br />Ran on a NUC and compared with[[Ptest 385944254d0ef88bd6450a221a54cbcb40020b42| 2.5_m2_rc1]] | |||
[https://wiki.yoctoproject.org/wiki/images/1/1c/Ptest_2.5_m3_rc1_NewAB.txt < FULL_LOG] | |||
{| style="border-spacing:0;" | |||
| style="background-color:#ff8080;border:0.05pt solid #000000;padding:0.0382in;"| Failures | |||
|- | |||
| style="background-color:#99ff66;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;"| % increased | |||
|- | |||
| style="background-color:#c5000b;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#ffffff"| % decreased | |||
|- | |||
| style="background-color:gray;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#000000"| Module not executed | |||
|} | |||
{| class="wikitable" | |||
|+Results | |||
|- | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Package Name''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Tests ran''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Failed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passrate''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Last Passrate''' | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| acl | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| attr | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bash | |||
| align=center style="background-color:transparent;border-color:#000000"|79 | |||
| align=center style="background-color:transparent;border-color:#000000"|76 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bluez5 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| busybox | |||
| align=center style="background-color:transparent;border-color:#000000"|524 | |||
| align=center style="background-color:transparent;border-color:#000000"|510 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|14 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|97.33 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|98.09 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bzip2 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| dbus-test | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|19 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|2 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|90.48 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|26.67 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffstat | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffutils | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| e2fsprogs | |||
| align=center style="background-color:transparent;border-color:#000000"|309 | |||
| align=center style="background-color:transparent;border-color:#000000"|309 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|85.76 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| flex | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gawk | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdbm | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdk-pixbuf | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| glib-2.0 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gzip | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| kbd | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libpcre | |||
| align=center style="background-color:transparent;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|1 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|66.67 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|66.67 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libxml-parser-perl | |||
| align=center style="background-color:transparent;border-color:#000000"|15 | |||
| align=center style="background-color:transparent;border-color:#000000"|15 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libxml2 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lttng-tools | |||
| align=center style="background-color:transparent;border-color:#000000"|2057 | |||
| align=center style="background-color:transparent;border-color:#000000"|1988 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|69 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lzo | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| nettle | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssh | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssl | |||
| align=center style="background-color:transparent;border-color:#000000"|53 | |||
| align=center style="background-color:transparent;border-color:#000000"|53 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| pango | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| perl | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| python | |||
| align=center style="background-color:transparent;border-color:#000000"|30548 | |||
| align=center style="background-color:transparent;border-color:#000000"|30362 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|186 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|99.39 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|99.35 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| quilt | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| sed | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| slang | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| strace | |||
| align=center style="background-color:transparent;border-color:#000000"|374 | |||
| align=center style="background-color:transparent;border-color:#000000"|344 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|30 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|91.98 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.73 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| tcl | |||
| align=center style="background-color:transparent;border-color:#000000"|148 | |||
| align=center style="background-color:transparent;border-color:#000000"|147 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|1 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|99.32 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|99.32 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| util-linux | |||
| align=center style="background-color:transparent;border-color:#000000"|376 | |||
| align=center style="background-color:transparent;border-color:#000000"|364 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.81 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.81 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| valgrind | |||
| align=center style="background-color:transparent;border-color:#000000"|559 | |||
| align=center style="background-color:transparent;border-color:#000000"|299 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|260 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| zlib | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
|} | |||
=Detailed Report= | =Detailed Report= | ||
Latest revision as of 09:30, 10 April 2018
Testing data
Test type: Full Pass Test Branch: master Build name: yocto-2.5_M3.rc1 poky commit: f49ee61422c867516db252054e993df29f775136 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/yocto-2.5_M3.rc1/ Distributions tested: CentOs 7 Debian 9 Fedora 26 Fedora 27 OpenSuse 42.3 Ubuntu 16.04 Ubuntu 17.10
{{#testopia: | run_id=0, {{#var:1_BSPs_genericx86-64_on_NUC7}}, {{#var:2_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:3_BSPs_Beaglebone_Black}}, {{#var:4_BSPs_EdgeRouter}}, {{#var:5_BSPs_MPC8315e-rdb}}, {{#var:6_BSPs_qemu-x86}}, {{#var:7_BSPs_qemu-x86-64}}, {{#var:8_BSPs_qemuarm}}, {{#var:9_BitBake_Ubuntu_16.04_x86_64}}, {{#var:10_BSPs_qemumips}}, {{#var:11_BSPs_qemumips64}}, {{#var:12_BSPs_qemuppc}}, {{#var:13_BSPs_qemu-x86}}, {{#var:14_BSPs_qemu-x86-64}}, {{#var:15_BSPs_qemuarm}}, {{#var:16_BSPs_qemuarm64}}, {{#var:17_BSPs_qemumips}}, {{#var:18_BSPs_qemumips64}}, {{#var:19_BSPs_qemuppc}}, {{#var:20_BSPs_genericx86_on_MTURBOT32}}, {{#var:21_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:22_BSPs_genericx86-64_on_NUC6}}, {{#var:23_BSPs_genericx86-64_on_NUC7}}, {{#var:24_BSPs_Beaglebone_Black}}, {{#var:25_BSPs_EdgeRouter}}, {{#var:26_BSPs_MPC8315e-rdb}}, {{#var:27_BSPs_genericx86-WIC_on_MTURBOT32}}, {{#var:28_BSPs_genericx86-64-WIC_on_MTURBOT64}}, {{#var:29_BSPs_genericx86-64-WIC_on_NUC6}}, {{#var:30_BSPs_genericx86-64-WIC_on_NUC7}}, {{#var:31_BSPs_qemu-x86-WIC}}, {{#var:32_BSPs_qemu-x86-64-WIC}}, {{#var:33_Meta-yocto_Ubuntu_16.04_x86_64}}, {{#var:34_OE-Core_CentOS_7_x86_64}}, {{#var:35_OE-Core_Debian_9_x86_64}}, {{#var:36_OE-Core_Fedora_26_x86_64}}, {{#var:37_OE-Core_Fedora_27_x86_64}}, {{#var:38_OE-Core_OpenSuse_42.3_x86_64}}, {{#var:39_OE-Core_Ubuntu_16.04_x86_64}}, {{#var:40_OE-Core_Ubuntu_17.10_x86_64}}, {{#var:41_Runtime_VMWare_Player_on_Ubuntu}}, {{#var:42_Toaster_Ubuntu_16.04_x86_64}}, {{#var:43_Toaster_Ubuntu_16.04_x86_64}}, {{#var:44_ADT_qemu-x86}}, {{#var:45_ADT_qemu-x86-64}}, {{#var:46_ADT_qemuarm}}, {{#var:47_ADT_qemuarm64}}, {{#var:48_ADT_qemumips}}, {{#var:49_ADT_qemumips64}}, {{#var:50_ADT_qemuppc}}, {{#var:51_CROPS_Ubuntu_16.04}}, {{#var:52_Eclipse Plugin_Oxygen_-_Fedora26}}, {{#var:53_Eclipse Plugin_Neon_-_Fedora_26}}, {{#var:54_eSDK_Ubuntu_16.04}}, {{#var:55_eSDK_Ubuntu_16.04}}, {{#var:56_Kernel_Ubuntu_16.04}}, {{#var:57_General Runtime_user-preference_(any_supported_environment)}}, {{#var:58_Package Management Issues_Any_Supported_Distro}}, {{#var:59_ADT_Ubuntu_16.04_x86_64}}, {{#var:60_ADT_Fedora_26_i686}}, {{#var:61_BSPs_qemuarm64}}, {{#var:62_ADT_qemu-x86}}, {{#var:63_ADT_qemuarm}}, {{#var:64_ADT_qemumips}}, {{#var:65_ADT_qemuppc}}, {{#var:66_Eclipse Plugin_Oxygen_-_Fedora26}}, {{#var:67_Eclipse Plugin_Neon_-_Fedora_26}}, {{#var:68_Runtime_VMWare_Player_on_Ubuntu}}, {{#var:69_BSPs_genericx86-64_on_NUC7}}, {{#var:70_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:71_BSPs_Beaglebone_Black}}, {{#var:72_BSPs_EdgeRouter}}, {{#var:73_BSPs_MPC8315e-rdb}}, {{#var:74_BSPs_qemu-x86}}, {{#var:75_BSPs_qemu-x86-64}}, {{#var:76_BSPs_qemuarm}}, {{#var:77_BSPs_qemuarm64}}, {{#var:78_BSPs_qemumips}}, {{#var:79_BSPs_qemumips64}}, {{#var:80_BSPs_qemuppc}}, {{#var:81_BSPs_qemu-x86}}, {{#var:82_BSPs_genericx86_on_MTURBOT32}}, {{#var:83_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:84_BSPs_genericx86-64_on_NUC6}}, {{#var:85_BSPs_genericx86-64_on_NUC7}}, {{#var:86_BSPs_Beaglebone_Black}}, {{#var:87_BSPs_EdgeRouter}}, {{#var:88_BSPs_MPC8315e-rdb}}, {{#var:89_BSPs_genericx86-WIC_on_MTURBOT32}}, {{#var:90_BSPs_genericx86-64-WIC_on_MTURBOT64}}, {{#var:91_BSPs_genericx86-64-WIC_on_NUC6}}, {{#var:92_BSPs_genericx86-64-WIC_on_NUC7}}, {{#var:93_BSPs_qemu-x86-64-WIC}}, {{#var:94_General Runtime_user-preference_(any_supported_environment)}} | report_id=concatstats}}
|