WW19 - 2018-05-10- Full Test Cycle - 2.5 M4 rc1: Difference between revisions
No edit summary |
No edit summary |
||
(4 intermediate revisions by the same user not shown) | |||
Line 121: | Line 121: | ||
|sort=ID | |sort=ID | ||
|group=product | |group=product | ||
|id= | |id=12712,12725,12736 | ||
}} | }} | ||
<br> | <br> | ||
Line 131: | Line 131: | ||
|sort=priority | |sort=priority | ||
|group=product | |group=product | ||
|id= | |id=11431,12602,12666 | ||
}}<br> | }}<br> | ||
Line 140: | Line 140: | ||
|sort=priority | |sort=priority | ||
|group=cf_regression_type,product | |group=cf_regression_type,product | ||
|id= | |id=12591,12499 | ||
}} | }} | ||
Line 162: | Line 162: | ||
= Build Performance Test = | = Build Performance Test = | ||
Detailed description on how performance test is run canbe found on the Performance Test wiki. The | Detailed description on how performance test is run canbe found on the Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different. | ||
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | * [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | ||
Line 189: | Line 189: | ||
== results == | == results == | ||
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive] | |||
<br />Ran on a NUC and compared with[[Ptest f49ee61422c867516db252054e993df29f775136| 2.5_m3_rc1]] | |||
[https://wiki.yoctoproject.org/wiki/images/e/ea/Ptest_2.5_m4_rc1.txt < FULL_LOG] | |||
{| style="border-spacing:0;" | |||
| style="background-color:#ff8080;border:0.05pt solid #000000;padding:0.0382in;"| Failures | |||
|- | |||
| style="background-color:#99ff66;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;"| % increased | |||
|- | |||
| style="background-color:#c5000b;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#ffffff"| % decreased | |||
|- | |||
| style="background-color:gray;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#000000"| Module not executed | |||
|} | |||
{| class="wikitable" | |||
|+Results | |||
|- | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Package Name''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Tests ran''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Failed''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passrate''' | |||
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Last Passrate''' | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| acl | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|380 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| attr | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|143 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bash | |||
| align=center style="background-color:transparent;border-color:#000000"|79 | |||
| align=center style="background-color:transparent;border-color:#000000"|76 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.2 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bluez5 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| busybox | |||
| align=center style="background-color:transparent;border-color:#000000"|524 | |||
| align=center style="background-color:transparent;border-color:#000000"|514 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|10 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|98.09 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|97.33 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| bzip2 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|6 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| dbus-test | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|19 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|90.48 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|90.48 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffstat | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|440 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| diffutils | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| e2fsprogs | |||
| align=center style="background-color:transparent;border-color:#000000"|309 | |||
| align=center style="background-color:transparent;border-color:#000000"|309 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| flex | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|114 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gawk | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|339 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdbm | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|25 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gdk-pixbuf | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|20 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| glib-2.0 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|253 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| gzip | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|21 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| kbd | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|7 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libpcre | |||
| align=center style="background-color:transparent;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000"|3 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|66.67 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libxml-parser-perl | |||
| align=center style="background-color:transparent;border-color:#000000"|15 | |||
| align=center style="background-color:transparent;border-color:#000000"|15 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| libxml2 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|134 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lttng-tools | |||
| align=center style="background-color:transparent;border-color:#000000"|2057 | |||
| align=center style="background-color:transparent;border-color:#000000"|1988 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|69 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|96.65 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| lzo | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|5 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| nettle | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|93 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssh | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|60 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| openssl | |||
| align=center style="background-color:transparent;border-color:#000000"|53 | |||
| align=center style="background-color:transparent;border-color:#000000"|53 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| pango | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|12 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| perl | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|2287 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| python | |||
| align=center style="background-color:transparent;border-color:#000000"|30552 | |||
| align=center style="background-color:transparent;border-color:#000000"|30358 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|194 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.37 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.39 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| quilt | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|57 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| sed | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|86 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| slang | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|97 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| strace | |||
| align=center style="background-color:transparent;border-color:#000000"|374 | |||
| align=center style="background-color:transparent;border-color:#000000"|344 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|30 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|91.98 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|91.98 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| tcl | |||
| align=center style="background-color:transparent;border-color:#000000"|148 | |||
| align=center style="background-color:transparent;border-color:#000000"|146 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|2 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|98.65 | |||
| align=center style="background-color:#c5000b;border-color:#000000;color:#ffffff"|99.32 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:down_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| util-linux | |||
| align=center style="background-color:transparent;border-color:#000000"|377 | |||
| align=center style="background-color:transparent;border-color:#000000"|365 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|12 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|96.82 | |||
| align=center style="background-color:#99ff66;border-color:#000000;color:#000000"|96.81 | |||
| align=center style="background-color:transparent;border-color:transparent" |[[File:up_rate.png|15px]] | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| valgrind | |||
| align=center style="background-color:transparent;border-color:#000000"|559 | |||
| align=center style="background-color:transparent;border-color:#000000"|299 | |||
| align=center style="background-color:#ff8080;border-color:#000000"|260 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|53.49 | |||
|- | |||
| align=left style="background-color:trasnparentborder-color:#000000"| zlib | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|2 | |||
| align=center style="background-color:transparent;border-color:#000000"|0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
| align=center style="background-color:transparent;border-color:#000000;color:#000000"|100.0 | |||
|- | |||
|} | |||
=Detailed Report= | =Detailed Report= | ||
Latest revision as of 02:47, 10 May 2018
Testing data
Test type: Full Pass Test Branch: master Build name: yocto-2.5_M4.rc1 poky commit: da3625c52e1ab8985fba4fc3d133edf92142f182 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.5.rc1/ Distributions tested: CentOs 7 Debian 9 Fedora 26 Fedora 27 OpenSuse 42.3 Ubuntu 16.04 Ubuntu 17.10
{{#testopia: | run_id=0, {{#var:1_BitBake_Ubuntu_16.04_x86_64}}, {{#var:2_BSPs_genericx86-64_on_NUC7}}, {{#var:3_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:4_BSPs_Beaglebone_Black}}, {{#var:5_BSPs_EdgeRouter}}, {{#var:6_BSPs_MPC8315e-rdb}}, {{#var:7_BSPs_qemu-x86}}, {{#var:8_BSPs_qemu-x86-64}}, {{#var:9_BSPs_qemuarm}}, {{#var:10_BSPs_qemuarm64}}, {{#var:11_BSPs_qemumips}}, {{#var:12_BSPs_qemumips64}}, {{#var:13_BSPs_qemuppc}}, {{#var:14_BSPs_qemu-x86}}, {{#var:15_BSPs_qemu-x86-64}}, {{#var:16_BSPs_qemuarm}}, {{#var:17_BSPs_qemuarm64}}, {{#var:18_BSPs_qemumips}}, {{#var:19_BSPs_qemumips64}}, {{#var:20_BSPs_qemuppc}}, {{#var:21_BSPs_genericx86_on_MTURBOT32}}, {{#var:22_BSPs_genericx86-64_on_MTURBOT64}}, {{#var:23_BSPs_genericx86-64_on_NUC6}}, {{#var:24_BSPs_genericx86-64_on_NUC7}}, {{#var:25_BSPs_Beaglebone_Black}}, {{#var:26_BSPs_EdgeRouter}}, {{#var:27_BSPs_MPC8315e-rdb}}, {{#var:28_BSPs_genericx86-WIC_on_MTURBOT32}}, {{#var:29_BSPs_genericx86-64-WIC_on_MTURBOT64}}, {{#var:30_BSPs_genericx86-64-WIC_on_NUC6}}, {{#var:31_BSPs_genericx86-64-WIC_on_NUC7}}, {{#var:32_BSPs_qemu-x86-WIC}}, {{#var:33_BSPs_qemu-x86-64-WIC}}, {{#var:34_BSPs_qemu-x86}}, {{#var:35_BSPs_qemu-x86-64}}, {{#var:36_BSPs_qemuarm}}, {{#var:37_BSPs_qemuarm64}}, {{#var:38_BSPs_qemumips}}, {{#var:39_BSPs_qemumips64}}, {{#var:40_BSPs_qemuppc}}, {{#var:41_Meta-yocto_Ubuntu_16.04_x86_64}}, {{#var:42_OE-Core_CentOS_7_x86_64}}, {{#var:43_OE-Core_Debian_9_x86_64}}, {{#var:44_OE-Core_Fedora_26_x86_64}}, {{#var:45_OE-Core_Fedora_27_x86_64}}, {{#var:46_OE-Core_OpenSuse_42.3_x86_64}}, {{#var:47_OE-Core_Ubuntu_16.04_x86_64}}, {{#var:48_OE-Core_Ubuntu_17.10_x86_64}}, {{#var:49_Runtime_VMWare_Player_on_Ubuntu}}, {{#var:50_Toaster_Ubuntu_16.04_x86_64}}, {{#var:51_Toaster_Ubuntu_16.04_x86_64}}, {{#var:52_ADT_qemu-x86}}, {{#var:53_ADT_qemu-x86-64}}, {{#var:54_ADT_qemuarm}}, {{#var:55_ADT_qemuarm64}}, {{#var:56_ADT_qemumips}}, {{#var:57_ADT_qemumips64}}, {{#var:58_ADT_qemuppc}}, {{#var:59_CROPS_Ubuntu_16.04}}, {{#var:60_Eclipse Plugin_Oxygen_-_Fedora26}}, {{#var:61_Eclipse Plugin_Neon_-_Fedora_24}}, {{#var:62_eSDK_Ubuntu_16.04}}, {{#var:63_eSDK_Ubuntu_16.04}}, {{#var:64_Kernel_Ubuntu_16.04}}, {{#var:65_General Runtime_user-preference_(any_supported_environment)}}, {{#var:66_Package Management Issues_Any_Supported_Distro}}, {{#var:67_ADT_Fedora_26_i686}}, {{#var:68_ADT_Ubuntu_16.04_x86_64}}, {{#var:69_ADT_qemu-x86}}, {{#var:70_ADT_qemuarm}}, {{#var:71_ADT_qemumips}}, {{#var:72_ADT_qemuppc}} | report_id=concatstats}}
|