Performance Test: Difference between revisions

From Yocto Project
Jump to navigationJump to search
 
(52 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== Build time tracking ==
== Build time tracking ==


Script used for running the builds: (dylan/master branch): scripts/contrib/build-perf-test.sh
Script used for running the builds:  


Two identical test systems are used for the results below, one with Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and one with Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64) with all updates available installed. Extra packages installed (besides what's by the default in the distro) are the ones in the Quick Start guide.
*Before morty: poky/scripts/contrib/build-perf-test.sh
*After morty: poky/scripts/oe-build-perf-test
 
Two identical test systems are used for the results, with all updates available installed. Extra packages installed (besides what's by the default in the distro) are the ones in the Quick Start guide.
 
Configuration of the GDC Setup 2.1 - Current master
* Ubuntu 15.10 (Wily Werewolf)" -->  4.2.0-16-generic
* Fedora release 23 (Twenty Three) --> 4.7.10-100.fc23.x86_64
* HW configuration: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz, 16GB RAM,  1 x 600 GB SDD, 1 x 2 TB HDD


All system/distro settings are '''distro's defaults''', that includes:
All system/distro settings are '''distro's defaults''', that includes:
Line 10: Line 18:


- IO scheduler: cfq and CPU governer: ondemand
- IO scheduler: cfq and CPU governer: ondemand
HW config is: SandyBridge i7-2600 CPU @ 3.40GHz HT-enabled (4 cores/8 threads),  8GB RAM,  1 x 500 GB HDD


local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).
local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).
Line 19: Line 25:
PARALLEL_MAKE = "-j 8"
PARALLEL_MAKE = "-j 8"
MACHINE = "qemux86"</nowiki>
MACHINE = "qemux86"</nowiki>
In the tables below, unless otherwise noted, sizes are in kilobytes.
'''Note:
*This page holds a re-run of milestone/RCs builds for the 1.5 cycle + 1.4.1/1.4.2 and for upcoming builds for 1.6.
*[https://wiki.yoctoproject.org/wiki/Performance_Test_Weekly_1.5 This page] has the old weekly results ran during the 1.5 cycle. The results differ because the test sytems used there are a bit different than those here (so don't cross compare results). '''


FAQ:
FAQ:
*Q: Where is M2 ? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
*Q: Where is 1.5_M2? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
*Q: What's with the different number of RCs? See [[Yocto_Project_Release_Process#Milestone_Releases]]
*Q: What's with the different number of RCs? See [[Yocto_Project_Release_Process#Milestone_Releases]]
*Q: Why are there more results for some commits? The script is ran from a cron job multiple times a day, sometimes master changes daily sometimes it doesn't, hence more results for one commit (ie weekends)




----
== Daily Test Results ==
Ubuntu has the default system shell (/bin/sh -> /bin/dash) and Fedora has the default SELinux policy (enabled). (Some quick tests showed that switching to bash or disabling SELinux had an minimal impact on the total build time).
Build performance test suite is run multiple times per day. Latest test reports for master branch can found here:
 
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-ubuntu16_master_qemux86.html Ubuntu 16.04]
# sh -> dash (default)
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-ubuntu16-xeon_master_qemux86.html Ubuntu 16.04 (Intel® Xeon® HW)]
 
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-centos7_master_qemux86.html CentOS 7]
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:02,12:03.51,1:09:57,4:49.58,0:26.57,0:13.32,0:01.72,25446936,4810304
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-opensuse422_master_qemux86.html OpenSUSE Leap 42.2] (retired)
 
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-fedora25_master_qemux86.html Fedora 25] (retired)
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:10,12:06.96,1:10:22,4:52.66,0:26.31,0:13.35,0:01.66,25425188,4815440
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf01_master_qemux86.html Fedora 23] (retired)
 
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf02_master_qemux86.html Ubuntu 15.10] (retired)
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:16,12:09.09,1:10:34,4:47.50,0:26.10,0:13.51,0:01.57,25425852,4810240
 
# sh -> bash
 
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:12:56,12:03.28,1:10:25,4:57.96,0:26.19,0:13.36,0:01.59,25426624,4810376
 
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:13:36,12:04.68,1:10:30,5:04.22,0:26.15,0:13.34,0:01.64,25425332,4815348
 
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:21,12:08.91,1:10:41,5:01.82,0:26.39,0:13.39,0:01.83,25426632,4815256
 
# selinux=1 (default)
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:15:22,10:40.98,1:13:21,4:05.22,0:32.10,0:15.63,0:01.63,25831032,4898552
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:16:28,10:40.84,1:14:15,4:04.72,0:31.64,0:15.79,0:01.63,25831752,4898616
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:17:04,10:32.56,1:14:18,4:04.11,0:31.74,0:15.75,0:01.59,25831972,4898692
 
# selinux=0
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:16:22,10:14.86,1:13:09,3:55.77,0:31.72,0:15.58,0:01.60,25832104,4898672
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:16:45,10:24.95,1:13:25,4:04.07,0:31.64,0:15.64,0:01.60,25831380,4898616
 
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:17:28,10:16.52,1:12:42,4:02.91,0:31.70,0:15.53,0:01.59,25834384,4898748
 
----
 
== 1.4.1 & 1.4.2 Build Time results ==
 
<tab class=wikitable sep=comma head=top>
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
ubuntu12,dylan:789b2b7e0cca404ff8ba8ed5ba823d215e6ba5b4,dylan-9.0.0,1:15:10,11:51.45,1:06:52,5:15.66,0:26.08,0:14.64,0:01.95,28104788,4693596
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:16:41,11:32.41,1:06:51,5:14.78,0:26.75,0:14.81,0:01.96,28213628,4743912
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:14:31,11:34.66,1:06:41,5:12.70,0:26.54,0:14.74,0:01.92,28213772,4743844
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:12:39,11:35.99,1:06:59,5:16.48,0:26.77,0:14.71,0:01.96,28217808,4743800
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:12:58,12:56.22,1:07:45,4:54.36,0:26.78,0:14.73,0:01.95,25349116,4767324
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:13:33,12:44.85,1:08:10,5:01.71,0:26.87,0:14.80,0:01.99,25349708,4767348
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:13:00,12:59.19,1:08:13,5:07.04,0:26.83,0:14.73,0:01.97,25363408,4767380
</tab>
 
 
<tab class=wikitable sep=comma head=top>
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
fedora19,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:14:55,10:11.74,1:10:35,4:06.95,0:34.06,0:17.79,0:01.99,28710092,4835464
fedora19,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:12:34,10:09.63,1:10:30,4:03.92,0:33.53,0:17.84,0:01.92,28713992,4835460
fedora19,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,yocto-1.4.1,1:17:15,10:11.67,1:11:47,4:45.40,0:33.90,0:17.31,0:01.97,28710884,4835484
fedora19,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:14:50,10:53.97,1:15:47,4:19.85,0:34.18,0:17.92,0:01.92,25778860,4858892
fedora19,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:14:58,10:43.16,1:12:00,4:07.15,0:33.93,0:17.88,0:01.98,25776164,4858920
fedora19,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.2,1:16:11,11:23.14,1:12:31,4:08.25,0:33.64,0:18.03,0:01.95,25775976,4858876
</tab>
 


== 1.5 Milestones results ==
== Milestone Test results ==
Guadalajara Setup from 2.1 M4 to actual master


<tab class=wikitable sep=comma head=top>
* [https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html GDC Charts]
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:14:16,12:53.53,1:08:28,5:11.74,0:27.39,0:15.28,0:02.18,25391176,4799632
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:14:20,12:54.69,1:08:27,5:23.61,0:27.24,0:15.19,0:02.15,25390100,4799560
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:13:14,12:42.64,1:08:49,5:05.26,0:27.49,0:15.16,0:02.14,25390404,4799588
-
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:14:39,13:29.39,1:11:05,4:47.33,0:28.01,0:15.53,0:02.09,25316072,4827788
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:15:39,13:39.82,1:11:14,5:00.98,0:28.02,0:15.74,0:02.11,25297644,4827824
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:13:38,13:20.40,1:10:29,4:50.66,0:28.21,0:15.63,0:02.08,25296940,4823004
-
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:15:31,13:21.54,1:11:40,4:50.34,0:28.58,0:15.74,0:02.11,25440952,4838208
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:15:34,13:17.44,1:11:25,4:54.69,0:28.74,0:15.71,0:02.09,25421728,4833420
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:16:25,13:37.05,1:11:54,4:56.99,0:28.63,0:15.85,0:02.12,25378284,4833444
-
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:17:58,13:44.95,1:12:30,5:03.64,0:28.95,0:15.97,0:02.32,26131176,4961052
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:18:54,14:00.29,1:13:15,4:59.28,0:28.65,0:15.96,0:02.24,26192480,4966232
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:18:56,14:17.80,1:14:11,4:59.10,0:28.81,0:16.12,0:02.25,26131008,4961248
-
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:18:19,13:41.56,1:11:33,4:53.58,0:28.27,0:15.41,0:01.54,25688600,4898748
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:15:25,13:59.10,1:11:41,4:51.22,0:28.39,0:15.36,0:01.56,25692980,4898576
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:17:12,13:41.63,1:12:06,4:51.32,0:27.97,0:15.38,0:01.58,25688548,4903912
-
ubuntu12,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:15:17,13:47.21,1:10:44,4:55.33,0:28.11,0:15.16,0:01.54,25726992,4897340
ubuntu12,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:15:03,14:06.96,1:11:32,4:50.64,0:27.95,0:15.20,0:01.58,25704416,4902296
ubuntu12,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:17:16,14:07.67,1:12:23,4:53.21,0:27.78,0:15.19,0:01.58,25686264,4902292
-
ubuntu12,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:16:38,14:17.30,1:10:05,4:42.63,0:25.57,0:12.87,0:01.50,25770616,4925008
ubuntu12,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:14:39,14:14.73,1:11:21,4:53.20,0:25.47,0:12.80,0:01.48,25770168,4924972
ubuntu12,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:17:48,14:19.40,1:11:51,4:53.53,0:25.39,0:12.81,0:01.49,25773428,4924908
-
ubuntu12,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:14:30,13:57.15,1:11:08,4:54.14,0:25.68,0:13.07,0:01.59,25763920,4920848
ubuntu12,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:15:28,14:06.75,1:11:38,4:51.25,0:25.45,0:13.03,0:01.61,25761664,4921016
ubuntu12,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:16:24,14:15.42,1:12:12,4:42.56,0:25.46,0:12.97,0:01.59,25780792,4915792
-
ubuntu12,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:17:19,13:59.28,1:11:50,4:48.02,0:25.62,0:12.96,0:01.59,25759796,4919568
ubuntu12,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:16:54,13:56.51,1:11:56,4:50.50,0:25.67,0:13.04,0:01.62,25763872,4919684
ubuntu12,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:14:44,14:02.52,1:10:37,4:44.39,0:25.65,0:13.03,0:01.59,25760268,4919680
-
ubuntu12,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:13:29,14:16.93,1:09:47,4:44.19,0:25.66,0:13.02,0:01.61,25761072,4924448
ubuntu12,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:13:12,13:42.57,1:10:12,4:42.28,0:25.77,0:13.09,0:01.58,25762964,4919732
ubuntu12,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:13:39,13:45.03,1:10:07,4:46.75,0:25.81,0:13.02,0:01.57,25759624,4919564
</tab>


<tab class=wikitable sep=comma head=top>
== Old Test results ==
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
fedora19,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:19:37,10:38.18,1:12:10,4:03.70,0:34.59,0:18.54,0:02.23,25801440,4887964
fedora19,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:19:03,11:24.42,1:12:52,4:01.95,0:34.92,0:18.56,0:02.13,25796764,4887836
fedora19,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.final,1:17:50,10:59.62,1:12:27,4:18.09,0:34.47,0:18.48,0:02.11,25801880,4887780
-
fedora19,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:20:02,11:43.17,1:13:52,3:58.63,0:35.54,0:19.14,0:02.13,25704568,4911492
fedora19,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:21:20,12:11.54,1:14:48,3:59.29,0:35.74,0:19.06,0:02.18,25710016,4911228
fedora19,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:21:13,11:04.79,1:14:39,4:17.40,0:35.37,0:18.72,0:02.10,25704988,4911520
-
fedora19,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:22:38,11:18.43,1:18:37,4:17.43,0:36.29,0:19.14,0:02.10,25783316,4921400
fedora19,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:22:51,11:29.19,1:17:53,4:09.21,0:35.81,0:19.49,0:02.13,25782900,4921324
fedora19,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3,1:23:13,11:28.11,1:16:30,4:13.87,0:35.91,0:19.17,0:02.11,25785912,4921496
-
fedora19,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:23:20,12:42.28,1:16:41,4:08.14,0:35.09,0:18.98,0:02.29,26535116,5049040
fedora19,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:23:58,12:29.62,1:17:23,4:07.62,0:34.85,0:19.07,0:02.33,26540144,5048920
fedora19,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:25:03,11:49.90,1:18:40,4:15.76,0:34.56,0:18.93,0:02.30,26536564,5048832
-
fedora19,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:21:45,12:37.91,1:15:53,4:05.91,0:34.19,0:18.32,0:01.60,26096196,4986476
fedora19,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:22:51,12:50.33,1:17:02,4:06.61,0:34.13,0:18.61,0:01.62,26093328,4986408
fedora19,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.final,1:22:32,12:01.28,1:17:13,4:15.72,0:34.03,0:18.35,0:01.59,26094088,4986944
-
fedora19,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:22:27,13:14.06,1:16:17,3:57.51,0:34.03,0:18.30,0:01.61,26090072,4984856
fedora19,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:22:51,13:12.33,1:16:06,3:58.44,0:34.06,0:18.15,0:01.62,26090640,4985060
fedora19,master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82,1.5_M5.rc1,1:22:22,12:05.53,1:16:26,4:08.26,0:33.83,0:18.11,0:01.59,26090756,4984916
-
fedora19,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:20:58,12:53.74,1:14:58,3:53.32,0:31.15,0:15.29,0:01.61,26176264,5008052
fedora19,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:22:00,12:03.23,1:15:15,4:01.62,0:30.91,0:15.24,0:01.58,26177500,5007748
fedora19,master:853bc53cd58a621918f0e5ce662dba263d1befb4,1.5_M5.rc4,1:22:11,12:07.04,1:16:20,3:59.87,0:30.93,0:15.30,0:01.59,26181592,5008024
-
fedora19,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:23:16,13:40.63,1:16:49,3:47.56,0:31.17,0:15.36,0:01.67,26168976,5003560
fedora19,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:22:23,12:48.88,1:16:17,3:51.08,0:31.24,0:15.36,0:01.62,26169684,5003712
fedora19,master:4d8ab87d25ea6e59dc88375813ef88ee0ac813d0,1.5_M5.rc5,1:22:37,12:23.94,1:16:50,3:59.73,0:31.08,0:15.19,0:01.61,26167128,5003628
-
fedora19,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:23:49,12:43.59,1:16:15,3:49.05,0:31.30,0:15.55,0:01.63,26165572,5007660
fedora19,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:22:48,15:11.65,1:16:33,4:01.86,0:30.94,0:15.26,0:01.60,26165408,5007688
fedora19,master:a02280f99f05b1c21de2a78de9222a2f62a0dabc,1.5_M5.rc6,1:21:56,12:14.56,1:16:20,4:05.10,0:30.99,0:15.25,0:01.63,26164444,5007468
-
fedora19,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:16:54,11:52.82,1:12:45,4:02.22,0:31.04,0:15.21,0:01.60,26162736,5007468
fedora19,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:19:45,12:02.39,1:13:23,4:06.09,0:31.20,0:15.36,0:01.62,26165196,5007264
fedora19,dora:102bf5e0f640fe85068452a42b85077f1c81e0c9,dora-10.0.0,1:19:18,11:57.40,1:14:25,4:05.45,0:31.07,0:15.25,0:01.61,26164232,5007452
</tab>


Milestone test results from the retired Romania Setup (Yocto 1.6 – 2.1) can be found from here:


== 1.6 Nightly results ==
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts]


<tab class=wikitable sep=comma head=top>
Raw test data from the retired Romania test setup has been moved to
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
* [[Performance_Test_Old_Results]]
ubuntu12,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:13:13,13:47.91,1:10:42,4:45.40,0:25.86,0:13.04,0:01.65,25786744,4921696
* [[Performance_Test_Weekly_1.5]] has the old weekly results ran during the 1.5 cycle.
ubuntu12,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:14:33,13:35.20,1:10:41,4:39.72,0:25.69,0:13.09,0:01.57,25849388,4926928
ubuntu12,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:14:12,13:52.45,1:10:32,4:44.44,0:25.76,0:13.02,0:01.59,25786904,4926808
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:13:19,13:35.59,1:10:57,4:46.91,0:26.06,0:13.18,0:01.62,25916096,4935088
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:14:17,13:55.93,1:11:39,4:51.40,0:26.12,0:13.28,0:01.57,25916996,4940148
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:15:49,13:55.69,1:11:16,4:52.35,0:26.07,0:13.38,0:01.58,25919672,4934920
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:16:31,13:48.10,1:12:12,4:52.67,0:26.06,0:13.29,0:01.60,25915568,4934908
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:14:42,13:44.93,1:11:34,5:27.95,0:26.31,0:13.22,0:01.59,25872852,4940028
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:15:11,13:55.13,1:11:22,4:52.27,0:26.47,0:13.33,0:01.57,25915880,4934776
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:15:53,13:50.68,1:11:38,4:58.33,0:26.43,0:13.28,0:01.61,25916532,4935080
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:16:32,13:43.83,1:11:53,4:43.32,0:25.98,0:13.53,0:01.56,25915960,4939960
ubuntu12,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:16:44,13:54.08,1:12:33,4:49.35,0:26.31,0:13.11,0:01.60,25876384,4934876
ubuntu12,master:ffb440c37c3491fa5d9a1408341f7c15eacdc9ce,poky-10.0.0.final-138-gffb440c,1:15:31,13:41.38,1:11:51,4:50.09,0:26.03,0:13.21,0:01.56,25873016,4940116
ubuntu12,master:ffb440c37c3491fa5d9a1408341f7c15eacdc9ce,poky-10.0.0.final-138-gffb440c,1:15:59,14:17.40,1:11:48,4:50.08,0:26.27,0:13.40,0:01.58,25872908,4935128
ubuntu12,master:ffb440c37c3491fa5d9a1408341f7c15eacdc9ce,poky-10.0.0.final-138-gffb440c,1:16:19,13:55.38,1:12:24,4:50.78,0:25.96,0:13.31,0:01.62,25917548,4935248
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:24:28,14:02.33,1:12:28,4:52.09,0:26.11,0:13.25,0:01.59,25936768,4940140
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:17:09,13:59.74,1:12:37,4:53.00,0:26.19,0:13.22,0:01.66,25919012,4940188
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:17:03,13:56.38,1:12:06,4:52.73,0:26.44,0:13.73,0:01.71,25914480,4935060
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:16:23,13:50.32,1:12:20,4:48.78,0:26.09,0:13.23,0:01.54,25937372,4935072
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:16:12,13:51.26,1:12:01,4:48.88,0:26.19,0:13.31,0:01.60,25916516,4935016
ubuntu12,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:15:58,14:13.25,1:13:00,4:46.21,0:26.35,0:13.42,0:01.64,25873320,4935044
ubuntu12,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:17:23,14:14.80,1:13:04,4:46.09,0:26.28,0:13.33,0:01.63,25911288,4936820
ubuntu12,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:17:07,14:03.54,1:13:01,4:46.51,0:25.86,0:13.30,0:01.62,25915300,4936868
ubuntu12,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:17:51,13:57.23,1:13:22,4:52.45,0:26.29,0:13.23,0:01.57,25930620,4936756
ubuntu12,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:21:02,14:12.31,1:13:37,4:46.54,0:26.50,0:13.23,0:01.62,25917800,4937136
ubuntu12,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:23:03,14:02.76,1:13:28,4:48.92,0:26.01,0:13.30,0:01.67,25919564,4937016
ubuntu12,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:18:12,14:07.18,1:14:21,4:51.94,0:25.93,0:13.37,0:01.60,25918724,4942128
ubuntu12,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:17:08,14:12.49,1:13:12,4:52.29,0:26.39,0:13.38,0:01.58,25876108,4937088
ubuntu12,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:26:09,13:55.49,1:13:58,4:49.29,0:26.24,0:13.18,0:01.58,25919940,4942120
ubuntu12,master:9160f376065752e2e92c8b37ee9a80d0eb86b53b,poky-10.0.0.final-333-g9160f37,1:14:02,13:59.64,1:11:37,4:56.92,0:26.35,0:13.46,0:01.79,25961128,4950964
ubuntu12,master:9160f376065752e2e92c8b37ee9a80d0eb86b53b,poky-10.0.0.final-333-g9160f37,1:14:57,14:03.46,1:11:52,4:56.19,0:26.02,0:13.22,0:01.59,25916916,4950992
ubuntu12,master:3e6b57fcfea93fbefd746ba056410409b35c5523,poky-10.0.0.final-353-g3e6b57f,1:15:03,13:59.04,1:11:47,4:45.92,0:26.45,0:13.47,0:01.75,25942600,4947516
ubuntu12,master:3e6b57fcfea93fbefd746ba056410409b35c5523,poky-10.0.0.final-353-g3e6b57f,1:15:49,14:08.52,1:12:28,4:48.34,0:26.03,0:13.27,0:01.63,25940820,4947344
ubuntu12,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:15:06,13:57.91,1:13:34,4:48.47,0:26.16,0:13.28,0:01.61,25946556,4952412
ubuntu12,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:16:28,14:05.52,1:12:15,4:47.06,0:26.44,0:13.49,0:01.69,25989504,4947512
ubuntu12,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:16:52,14:00.63,1:13:51,4:51.39,0:25.96,0:13.12,0:01.56,25986324,4952568
ubuntu12,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:18:29,14:09.87,1:13:58,4:56.91,0:26.19,0:13.37,0:01.59,26006772,4947472
ubuntu12,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:15:31,14:04.13,1:12:30,4:57.82,0:26.00,0:13.27,0:01.56,25941236,4952488
ubuntu12,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:16:26,14:03.07,1:12:38,4:50.07,0:26.01,0:13.63,0:01.65,25984168,4952740
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:34,11:59.47,1:10:45,4:43.48,0:26.54,0:13.39,0:01.64,25426384,4815476
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:26,12:09.86,1:10:42,4:48.34,0:26.30,0:13.30,0:01.69,25426160,4810324
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:34,12:05.55,1:11:01,4:57.95,0:26.32,0:13.36,0:01.56,25446128,4815504
ubuntu12,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:14:37,12:07.40,1:10:31,4:48.12,0:26.28,0:13.38,0:01.59,25448928,4810524
ubuntu12,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:13:52,12:02.50,1:10:58,4:52.75,0:26.31,0:13.34,0:01.58,23508444,4815252
ubuntu12,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:13:55,12:06.16,1:10:35,4:51.82,0:26.18,0:13.37,0:01.64,23525272,4810420
ubuntu12,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:13:44,12:09.69,1:11:00,5:01.64,0:26.36,0:13.75,0:01.68,23508600,4810448
ubuntu12,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:13:55,12:06.19,1:10:38,4:49.18,0:26.32,0:13.41,0:01.58,23507608,4798436
ubuntu12,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:18:44,12:08.05,1:10:42,4:54.34,0:26.11,0:13.36,0:01.59,23491648,4798552
ubuntu12,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:14:01,12:08.79,1:11:18,4:53.24,0:26.41,0:13.35,0:01.58,23491500,4803644
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:15,12:09.55,1:10:47,4:51.18,0:26.10,0:13.35,0:01.62,23526224,4810308
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:13:54,12:07.35,1:10:57,4:53.75,0:26.05,0:13.38,0:01.61,23509136,4810200
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:13:53,12:10.48,1:11:22,4:53.20,0:26.17,0:13.33,0:01.64,23511992,4815712
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:12,12:12.89,1:11:17,4:47.66,0:26.22,0:13.36,0:01.61,23509520,4810380
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:51,12:10.39,1:11:04,4:47.28,0:26.51,0:13.39,0:01.63,23508448,4815184
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:06,12:10.85,1:11:32,4:55.32,0:26.17,0:13.36,0:01.62,23509280,4815400
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:16,12:12.65,1:11:53,4:51.19,0:26.20,0:13.31,0:01.59,23509092,4815516
ubuntu12,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:14:20,12:19.34,1:12:37,4:51.88,0:26.07,0:13.43,0:01.58,23528484,4815432


</tab>
Configuration for the Romania Setup 1.6 - 2.1:


<tab class=wikitable sep=comma head=top>
* Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
* Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64)
fedora19,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:16:48,11:56.21,1:14:54,4:09.94,0:31.30,0:15.26,0:01.65,26197160,5009880
* HW configuration: SandyBridge i7-2600 CPU @ 3.40GHz (4 cores/8 threads), 8GB RAM, 1 x 500 GB HDD
fedora19,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:19:21,11:58.62,1:15:05,4:01.93,0:31.34,0:15.38,0:01.62,26191168,5009836
fedora19,master:2b5bac02196b8bd30d223d508f5f7d4300889fd7,1.5_M5.rc8-68-g2b5bac0,1:20:38,12:06.19,1:15:38,4:10.18,0:31.38,0:15.37,0:01.64,26193416,5009588
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:19:13,11:54.02,1:15:32,4:09.50,0:31.83,0:15.63,0:01.63,26276304,5022940
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:19:51,11:58.71,1:16:12,4:02.79,0:31.68,0:15.63,0:01.60,26276860,5022728
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:20:28,12:05.87,1:17:04,4:08.04,0:31.69,0:15.64,0:01.62,26278068,5022868
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:20:54,12:01.11,1:16:08,4:02.01,0:31.82,0:15.67,0:01.62,26277300,5022860
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:21:20,12:07.95,1:16:26,4:12.48,0:31.91,0:15.73,0:01.62,26279536,5022740
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:22:10,11:58.90,1:16:48,4:01.12,0:31.72,0:15.71,0:01.76,26277260,5022812
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:21:00,12:10.33,1:16:55,4:07.72,0:31.68,0:15.89,0:01.61,26280480,5022736
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:22:45,11:58.44,1:16:32,4:02.20,0:31.76,0:15.70,0:01.62,26277452,5022832
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:21:51,12:15.30,1:17:43,4:12.59,0:31.70,0:15.74,0:01.62,26277312,5022820
fedora19,master:505114c13d29799a25379f7ce720d632616d8776,poky-10.0.0.final-124-g505114c,1:21:49,12:02.37,1:16:51,4:00.01,0:31.78,0:15.74,0:01.63,26277820,5022804
fedora19,master:ffb440c37c3491fa5d9a1408341f7c15eacdc9ce,poky-10.0.0.final-138-gffb440c,1:22:27,12:03.20,1:17:28,4:11.27,0:31.72,0:15.73,0:01.63,26279308,5022928
fedora19,master:ffb440c37c3491fa5d9a1408341f7c15eacdc9ce,poky-10.0.0.final-138-gffb440c,1:23:05,12:15.78,1:17:16,4:00.91,0:31.72,0:15.72,0:01.63,26278752,5023084
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:23:15,12:13.62,1:18:35,4:11.95,0:31.81,0:15.70,0:01.62,26278112,5022936
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:23:11,11:58.30,1:18:02,4:02.74,0:31.60,0:15.71,0:01.63,26279340,5022904
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:23:31,12:14.88,1:17:25,4:07.39,0:31.79,0:15.75,0:01.63,26278632,5023140
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:22:23,11:56.68,1:18:12,4:03.02,0:31.65,0:15.77,0:01.62,26277636,5022872
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:23:20,11:59.54,1:18:12,4:09.14,0:31.69,0:15.79,0:01.63,26278040,5022992
fedora19,master:754e8768b69acba89bd6c3ba5dbe55b9df4d8083,poky-10.0.0.final-139-g754e876,1:24:11,12:02.86,1:18:04,4:00.02,0:31.63,0:15.78,0:01.62,26282048,5022820
fedora19,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:24:48,12:18.63,1:19:48,4:02.49,0:31.81,0:15.75,0:01.66,26273268,5024660
fedora19,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:23:26,12:04.87,1:19:18,4:01.76,0:31.73,0:15.74,0:01.62,26272544,5024976
fedora19,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:24:22,12:23.08,1:19:51,4:01.91,0:31.81,0:15.71,0:01.61,26272848,5024728
fedora19,master:523f2a9ea970713fb775bc48f84b67420b1106a0,poky-10.0.0.final-253-g523f2a9,1:23:47,12:09.77,1:19:24,4:06.13,0:31.74,0:15.61,0:01.62,26273840,5024836
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:24:44,12:02.30,1:20:11,4:05.05,0:31.92,0:15.64,0:01.61,26281308,5024888
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:24:04,12:03.69,1:18:06,3:57.04,0:31.79,0:15.77,0:01.63,26283276,5024896
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:24:19,12:17.70,1:19:47,3:59.78,0:31.83,0:15.70,0:01.62,26279364,5024784
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:25:26,12:14.65,1:19:36,3:59.49,0:31.93,0:15.68,0:01.61,26282920,5024856
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:24:48,12:11.96,1:20:25,4:05.75,0:31.90,0:15.81,0:01.63,26279920,5024728
fedora19,master:f3541226b8b1187e79dec0f6f9f3c58cedf9ac9b,poky-10.0.0.final-318-gf354122,1:25:20,12:12.72,1:19:48,3:58.66,0:31.80,0:15.92,0:01.62,26277496,5024888
fedora19,master:9160f376065752e2e92c8b37ee9a80d0eb86b53b,poky-10.0.0.final-333-g9160f37,1:18:37,12:01.00,1:16:00,3:58.90,0:31.87,0:15.64,0:01.62,26319996,5033828
fedora19,master:9160f376065752e2e92c8b37ee9a80d0eb86b53b,poky-10.0.0.final-333-g9160f37,1:20:11,11:56.73,1:16:28,4:03.37,0:31.87,0:15.76,0:01.64,26319912,5033832
fedora19,master:3e6b57fcfea93fbefd746ba056410409b35c5523,poky-10.0.0.final-353-g3e6b57f,1:20:36,12:05.83,1:17:33,4:04.20,0:31.76,0:15.78,0:01.62,26348088,5035844
fedora19,master:3e6b57fcfea93fbefd746ba056410409b35c5523,poky-10.0.0.final-353-g3e6b57f,1:21:07,12:07.18,1:17:09,4:00.48,0:31.76,0:15.75,0:01.61,26354372,5035780
fedora19,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:22:37,12:05.50,1:17:53,4:02.68,0:31.71,0:15.70,0:01.61,26347744,5035816
fedora19,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:22:59,12:09.26,1:17:29,4:06.75,0:31.82,0:15.69,0:01.70,26348556,5035876
fedora19,master:d6cc7c8ed76c8b1117cf03c7bd4b0742f98f79b3,poky-10.0.0.final-359-gd6cc7c8,1:22:21,12:07.23,1:18:21,4:07.44,0:31.79,0:15.63,0:01.62,26351088,5035908
fedora19,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:23:22,12:03.33,1:18:36,4:04.47,0:31.35,0:15.62,0:01.65,26347632,5036152
fedora19,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:23:26,12:18.96,1:18:52,4:06.24,0:31.76,0:15.59,0:01.59,26350700,5036156
fedora19,master:4fdc3d77d4a875b7236536bf78849a4d1f6a7449,poky-10.0.0.final-386-g4fdc3d7,1:23:34,12:22.72,1:18:48,4:07.44,0:31.94,0:15.68,0:01.63,26348068,5036092
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:15:22,10:40.98,1:13:21,4:05.22,0:32.10,0:15.63,0:01.63,25831032,4898552
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:16:28,10:40.84,1:14:15,4:04.72,0:31.64,0:15.79,0:01.63,25831752,4898616
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:17:04,10:32.56,1:14:18,4:04.11,0:31.74,0:15.75,0:01.59,25831972,4898692
fedora19,master:ea92671d9823e3667d6ced7ac2af20f991da404d,poky-10.0.0.final-426-gea92671,1:18:36,10:26.65,1:14:10,4:06.15,0:31.78,0:15.54,0:01.60,25831180,4898628
fedora19,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:18:08,10:45.09,1:14:14,4:06.10,0:31.98,0:15.63,0:01.63,23829148,4898808
fedora19,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:18:04,10:51.23,1:14:56,4:05.74,0:31.69,0:15.62,0:01.60,23828636,4898576
fedora19,master:e1e1ee5ebfa7a7d21f9426764135fd772a8ed7b5,poky-10.0.0.final-445-ge1e1ee5,1:17:44,10:40.57,1:15:05,4:03.88,0:31.74,0:15.77,0:01.62,23828404,4898508
fedora19,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:19:12,10:29.49,1:15:00,4:03.78,0:31.90,0:15.68,0:01.61,23816312,4886668
fedora19,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:18:04,10:45.19,1:15:51,4:08.04,0:31.71,0:15.69,0:01.63,23810820,4886716
fedora19,master:db7f8d4114267ed34c19dc66dd56c2372354b43f,poky-10.0.0.final-455-gdb7f8d4,1:18:57,10:41.59,1:16:16,4:03.68,0:31.96,0:15.75,0:01.61,23811424,4886744
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:18:24,10:35.14,1:15:37,4:05.37,0:31.83,0:15.78,0:01.63,23829144,4898620
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:18:23,10:41.11,1:15:34,4:07.63,0:31.73,0:15.99,0:01.61,23829204,4898632
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:18:25,10:45.82,1:15:33,4:01.12,0:31.67,0:15.71,0:01.60,23828812,4898592
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:19:30,10:33.85,1:15:41,4:07.33,0:31.73,0:15.83,0:01.62,23829348,4898584
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:20:05,10:47.71,1:15:33,4:01.74,0:31.92,0:15.72,0:01.64,23828840,4898612
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:20:27,10:44.10,1:15:50,4:03.67,0:31.79,0:15.79,0:01.61,23827880,4898708
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:20:47,10:35.58,1:19:04,4:01.97,0:31.69,0:15.62,0:01.64,23830076,4898640
fedora19,master:d7ccfc7605f1eb61511b1b2b8db4ac689ce6a468,poky-10.0.0.final-456-gd7ccfc7,1:19:32,10:42.77,1:15:24,4:00.27,0:31.94,0:15.68,0:01.62,23828908,4898764
</tab>

Latest revision as of 14:17, 28 January 2019

Build time tracking

Script used for running the builds:

  • Before morty: poky/scripts/contrib/build-perf-test.sh
  • After morty: poky/scripts/oe-build-perf-test

Two identical test systems are used for the results, with all updates available installed. Extra packages installed (besides what's by the default in the distro) are the ones in the Quick Start guide.

Configuration of the GDC Setup 2.1 - Current master

  • Ubuntu 15.10 (Wily Werewolf)" --> 4.2.0-16-generic
  • Fedora release 23 (Twenty Three) --> 4.7.10-100.fc23.x86_64
  • HW configuration: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz, 16GB RAM, 1 x 600 GB SDD, 1 x 2 TB HDD

All system/distro settings are distro's defaults, that includes:

- FS mount options: ext4 rw,relatime,data=ordered

- IO scheduler: cfq and CPU governer: ondemand

local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).

It however exports these in the enviroment: 

BB_NUMBER_THREADS = "8"
PARALLEL_MAKE = "-j 8"
MACHINE = "qemux86"

FAQ:

  • Q: Where is 1.5_M2? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
  • Q: What's with the different number of RCs? See Yocto_Project_Release_Process#Milestone_Releases
  • Q: Why are there more results for some commits? The script is ran from a cron job multiple times a day, sometimes master changes daily sometimes it doesn't, hence more results for one commit (ie weekends)


Daily Test Results

Build performance test suite is run multiple times per day. Latest test reports for master branch can found here:

Milestone Test results

Guadalajara Setup from 2.1 M4 to actual master

Old Test results

Milestone test results from the retired Romania Setup (Yocto 1.6 – 2.1) can be found from here:

Raw test data from the retired Romania test setup has been moved to

Configuration for the Romania Setup 1.6 - 2.1:

  • Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and
  • Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64)
  • HW configuration: SandyBridge i7-2600 CPU @ 3.40GHz (4 cores/8 threads), 8GB RAM, 1 x 500 GB HDD
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Performance_Test&oldid=46678"