WW07 - 2018-02-14- Full Test Cycle - 2.5 M2 rc1: Difference between revisions
(Created page with "{| {{#vardefine:1_BSPs_genericx86-64_on_NUC7| 9051}} {{#vardefine:2_BSPs_genericx86-64_on_MTURBOT64| 9052}} {{#vardefine:3_BSPs_Beaglebone_Black| 9053}} {{#vardefine:4_BSPs...") |
No edit summary |
||
(4 intermediate revisions by the same user not shown) | |||
Line 60: | Line 60: | ||
=Testing data= | =Testing data= | ||
<nowiki> | <nowiki> | ||
Test type: | Test type: Full Pass Test | ||
Branch: | Branch: master | ||
Build name: | Build name: yocto-2.5_M2.rc1 | ||
poky commit: | poky commit: 385944254d0ef88bd6450a221a54cbcb40020b42 | ||
Autobuilder images repository: | Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.5_M2.rc1 | ||
Distributions tested: | Distributions tested: | ||
CentOs 7 | |||
Debian 9 | |||
Fedora 26 | |||
Fedora 27 | |||
OpenSuse 42.3 | |||
Ubuntu 16.04 | |||
Ubuntu 17.10 | |||
</nowiki> | </nowiki> | ||
{| | {| | ||
Line 98: | Line 105: | ||
|sort=ID | |sort=ID | ||
|group=product | |group=product | ||
|id= | |id=12545 | ||
}} | }} | ||
<br> | <br> | ||
Line 108: | Line 115: | ||
|sort=priority | |sort=priority | ||
|group=product | |group=product | ||
|id= | |id=12131,11288 | ||
}}<br> | }}<br> | ||
Line 117: | Line 124: | ||
|sort=priority | |sort=priority | ||
|group=cf_regression_type,product | |group=cf_regression_type,product | ||
|id= | |id=12499 | ||
}} | }} | ||
Line 140: | Line 147: | ||
= Build Performance Test = | = Build Performance Test = | ||
Detailed description on how performance test is run canbe found on the [[Performance Test]] wiki. | Detailed description on how performance test is run canbe found on the [[Performance Test]] wiki. | ||
Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different. | |||
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | * [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | ||
Line 148: | Line 155: | ||
== Performance Charts== | == Performance Charts== | ||
Note: performance test results in below are both executed from the same machines in Linux Foundation. | |||
[[File:Ww08-2k18 - table.png | 600px]] | |||
[[File: | |||
=pTest for genericx86-64 on NUC= | =pTest for genericx86-64 on NUC= | ||
Line 183: | Line 173: | ||
== results == | == results == | ||
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive] | |||
<br />Ran on a NUC and compared with[[Ptest f2b03953b28755277437641645669396f285919a| 2.5_M1_rc3]] | |||
[https://wiki.yoctoproject.org/wiki/images/d/d1/Ptest_2.5_m2_rc1.txt < FULL_LOG] | |||
{| style="border-spacing:0;" | |||
| style="background-color:#ff8080;border:0.05pt solid #000000;padding:0.0382in;"| Failures | |||
|- | |||
| style="background-color:#99ff66;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;"| % increased | |||
|- | |||
| style="background-color:#c5000b;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#ffffff"| % decreased | |||
|- | |||
| style="background-color:gray;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#000000"| Module not executed | |||
|} | |||
{| class="wikitable" | |||
|+Results | |||
|- | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Package Name''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Tests ran''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Failed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passrate''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Last Passrate''' | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| acl | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| attr | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bash | |||
| align=center style="background-color:transparent;border-color:#000000"|79 | |||
| align=center style="background-color:transparent;border-color:#000000"|76 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bluez5 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| busybox | |||
| align=center style="background-color:transparent;border-color:#000000"|524 | |||
| align=center style="background-color:transparent;border-color:#000000"|514 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|10 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|98.09 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|98.47 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bzip2 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| dbus-test | |||
| align=center style="background-color:transparent;border-color:#000000"|15 | |||
| align=center style="background-color:transparent;border-color:#000000"|4 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|11 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|26.67 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|26.67 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffstat | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffutils | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| e2fsprogs | |||
| align=center style="background-color:transparent;border-color:#000000"|309 | |||
| align=center style="background-color:transparent;border-color:#000000"|265 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|44 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|85.76 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|85.76 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| flex | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gawk | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdbm | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdk-pixbuf | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| glib-2.0 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gzip | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| kbd | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libpcre | |||
| align=center style="background-color:transparent;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|1 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|66.67 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|66.67 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libxml2 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lttng-tools | |||
| align=center style="background-color:transparent;border-color:#000000"|2057 | |||
| align=center style="background-color:transparent;border-color:#000000"|1988 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|69 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lzo | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| nettle | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssh | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssl | |||
| align=center style="background-color:transparent;border-color:#000000"|52 | |||
| align=center style="background-color:transparent;border-color:#000000"|52 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| pango | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| perl | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|99.96 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| python | |||
| align=center style="background-color:transparent;border-color:#000000"|30558 | |||
| align=center style="background-color:transparent;border-color:#000000"|30358 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|200 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.35 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.59 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| quilt | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| sed | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| slang | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| strace | |||
| align=center style="background-color:transparent;border-color:#000000"|370 | |||
| align=center style="background-color:transparent;border-color:#000000"|369 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|1 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|99.73 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|99.73 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| tcl | |||
| align=center style="background-color:transparent;border-color:#000000"|148 | |||
| align=center style="background-color:transparent;border-color:#000000"|147 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|1 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.32 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|100.0 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| util-linux | |||
| align=center style="background-color:transparent;border-color:#000000"|376 | |||
| align=center style="background-color:transparent;border-color:#000000"|364 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.81 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.81 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| valgrind | |||
| align=center style="background-color:transparent;border-color:#000000"|559 | |||
| align=center style="background-color:transparent;border-color:#000000"|299 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|260 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| zlib | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
|} | |||
=Detailed Report= | =Detailed Report= | ||
Latest revision as of 06:51, 22 February 2018
Testing data
Test type: Full Pass Test Branch: master Build name: yocto-2.5_M2.rc1 poky commit: 385944254d0ef88bd6450a221a54cbcb40020b42 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.5_M2.rc1 Distributions tested: CentOs 7 Debian 9 Fedora 26 Fedora 27 OpenSuse 42.3 Ubuntu 16.04 Ubuntu 17.10
{{#testopia: | run_id=0, {{#var:1_BSPs_genericx86-64_on_NUC7}}, {{#var:2_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:3_BSPs_Beaglebone_Black}}, {{#var:4_BSPs_EdgeRouter}}, {{#var:5_BSPs_MPC8315e-rdb}}, {{#var:6_BSPs_qemu-x86}}, {{#var:7_BSPs_qemu-x86-64}}, {{#var:8_BSPs_qemuarm}}, {{#var:9_BSPs_qemuarm64}}, {{#var:10_BSPs_qemumips}}, {{#var:11_BSPs_qemumips64}}, {{#var:12_BSPs_qemuppc}}, {{#var:13_BSPs_qemu-x86}}, {{#var:14_BSPs_qemu-x86-64}}, {{#var:15_BSPs_qemuarm}}, {{#var:16_BSPs_qemuarm64}}, {{#var:17_BSPs_qemumips}}, {{#var:18_BSPs_qemumips64}}, {{#var:19_BSPs_qemuppc}}, {{#var:20_BSPs_genericx86_on_MTURBOT32}}, {{#var:21_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:22_BSPs_genericx86-64_on_NUC6}}, {{#var:23_BSPs_genericx86-64_on_NUC7}}, {{#var:24_BSPs_genericx86-WIC_on_MTURBOT32}}, {{#var:25_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:26_BSPs_genericx86-64-WIC_on_NUC6}}, {{#var:27_BSPs_genericx86-64-WIC_on_NUC7}}, {{#var:28_BSPs_qemu-x86-WIC}}, {{#var:29_BSPs_qemu-x86-64-WIC}}, {{#var:30_OE-Core_CentOS_7_x86_64}}, {{#var:31_OE-Core_Debian_9_x86_64}}, {{#var:32_OE-Core_Fedora_26_x86_64}}, {{#var:33_OE-Core_Fedora_27_x86_64}}, {{#var:34_OE-Core_OpenSuse_42.3_x86_64}}, {{#var:35_OE-Core_Ubuntu_16.04_x86_64}}, {{#var:36_OE-Core_Ubuntu_17.10_x86_64}}, {{#var:37_Runtime_VMWare_Player_on_Ubuntu}}, {{#var:38_Toaster_Ubuntu_16.04_x86_64}}, {{#var:39_Toaster_Ubuntu_16.04_x86_64}}, {{#var:40_ADT_Fedora_26_i686}}, {{#var:41_ADT_Ubuntu_16.04_x86_64}}, {{#var:42_ADT_Fedora_26_i686}}, {{#var:43_ADT_Ubuntu_16.04_x86_64}}, {{#var:44_CROPS_Ubuntu_16.04}}, {{#var:45_Eclipse Plugin_Oxygen_-_Fedora26}}, {{#var:46_Eclipse Plugin_Neon_-_Fedora_24}}, {{#var:47_eSDK_Ubuntu_16.04}}, {{#var:48_eSDK_Ubuntu_16.04}}, {{#var:49_Kernel_Ubuntu_16.04}}, {{#var:50_General Runtime_user-preference_(any_supported_environment)}}, {{#var:51_Package Management Issues_Any_Supported_Distro}}, {{#var:52_BSPs_MPC8315e-rdb}}, {{#var:53_BSPs_EdgeRouter}}, {{#var:54_BSPs_Beaglebone_Black}}, {{#var:55_BitBake_Ubuntu_16.04_x86_64}}, {{#var:56_Meta-yocto_Ubuntu_16.04_x86_64}} | report_id=concatstats}}
|