Performance Test: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
 
(89 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== Build Perfomance Data ==
== Build time tracking ==
Script used for running the builds: (dylan/master branch): scripts/contrib/build-perf-test.sh


Test systems:
Script used for running the builds:  


System1 (ubuntu12)
*Before morty: poky/scripts/contrib/build-perf-test.sh
- SandyBridge i7-2600 CPU @ 3.40GHz HT-enabled (4 cores/8 threads),  8GB RAM,  1 x 500 GB HDD, Ubuntu 12.04 x64
*After morty: poky/scripts/oe-build-perf-test
        System settings are distro's default:
              - FS mount options are Ubuntu's default: ext4 rw,relatime,user_xattr,barrier=1,data=ordered
              - IO scheduler: cfq (default) and CPU governer: ondemand (default)
System2 (thunderbird)
  - IvyBridge i7-3770K CPU @ 3.50GHz HT-enabled (4 cores/8 threads), 32GB RAM,  1 x 1 TB HDD, Fedora 18 x64
          System settings are distro's default:
              - FS mount options are Fedora's default: ext4 rw,seclabel,relatime,data=ordered
              - IO scheduler: cfq (default) and CPU governer: ondemand (default)


Two identical test systems are used for the results, with all updates available installed. Extra packages installed (besides what's by the default in the distro) are the ones in the Quick Start guide.


local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if that's the case).
Configuration of the GDC Setup 2.1 - Current master
It however exports these in the enviroment:
* Ubuntu 15.10 (Wily Werewolf)" -->  4.2.0-16-generic
<nowiki>BB_NUMBER_THREADS = "8"
* Fedora release 23 (Twenty Three) --> 4.7.10-100.fc23.x86_64
PARALLEL_MAKE = "-j 8"
* HW configuration: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz, 16GB RAM,  1 x 600 GB SDD, 1 x 2 TB HDD
MACHINE = "qemux86"
 
</nowiki>
All system/distro settings are '''distro's defaults''', that includes:


Notes:
- FS mount options: ext4 rw,relatime,data=ordered
  - free space available on the system has some impact on the results (so old builds need to be removed)
  - unless otherwise noted, in the tables below sizes are in kilobytes


== 1.5 Milestones only results ==
- IO scheduler: cfq and CPU governer: ondemand


(top two commits are for dylan branch - 1.4.1 and 1.4.2)
local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).
<tab class=wikitable sep=comma head=top>
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1,1:20:14,11:38.69,1:12:02,5:19.61,0:27.51,0:14.78,0:02.06,28G,4.6G
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,dylan-9.0.2,1:15:34,12:51.44,1:09:57,4:55.21,0:27.31,0:15.28,0:02.01,25427952,4783632
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:20:10,12:28.66,1:12:24,5:00.78,0:27.98,0:15.64,0:02.20,25G,4.6G
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M2.rc1,1:20:39,13:06.20,1:15:21,4:45.31,0:28.38,0:17.16,0:02.09,25G,4.7G
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:20:34,12:57.12,1:16:14,4:49.61,0:28.92,0:16.15,0:02.11,25G,4.7G
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:20:08,13:23.35,1:16:00,4:47.36,0:29.33,0:16.60,0:02.30,26197920,4977880
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:19:29,13:37.20,1:14:54,4:40.50,0:28.85,0:15.69,0:01.61,25753868,4914964
</tab>


<tab class=wikitable sep=comma head=top>
It however exports these in the enviroment:
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
<nowiki>BB_NUMBER_THREADS = "8"
thunderbird,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1,1:05:52,11:04.48,1:05:23,5:16.83,0:30.80,0:17.16,0:02.01,28G,4.7G
PARALLEL_MAKE = "-j 8"
thunderbird,dylan:d734ab491a30078d43dee5440c03acce2d251425,dylan-9.0.2,1:07:29,11:23.70,1:07:07,5:03.75,0:31.20,0:16.49,0:02.03,25859824,4874196
MACHINE = "qemux86"</nowiki>
thunderbird,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:06:21,11:23.33,1:06:18,4:56.64,0:31.32,0:16.87,0:02.23,25G,4.7G
thunderbird,master:042203531b10b37ac9a8201b376f5dec403e51d8,1.5_M2.rc1,1:05:13,11:37.96,1:05:41,4:49.92,0:31.83,0:18.23,0:02.12,25G,4.8G
thunderbird,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:07:46,11:36.30,1:09:33,4:52.40,0:32.68,0:17.47,0:02.11,25G,4.8G
thunderbird,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:08:31,11:55.12,1:09:48,5:07.88,0:32.83,0:17.77,0:02.31,26640472,5070964
thunderbird,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:09:06,12:11.86,1:10:14,5:10.86,0:32.38,0:17.22,0:01.64,26191508,5007760
</tab>


== 1.5 Build time results ==
FAQ:
*Q: Where is 1.5_M2? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
*Q: What's with the different number of RCs? See [[Yocto_Project_Release_Process#Milestone_Releases]]
*Q: Why are there more results for some commits? The script is ran from a cron job multiple times a day, sometimes master changes daily sometimes it doesn't, hence more results for one commit (ie weekends)


Top commits here are for dylan branch (1.4):


<tab class=wikitable sep=comma head=top>
== Daily Test Results ==
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
Build performance test suite is run multiple times per day. Latest test reports for master branch can found here:
ubuntu12,dylan:789b2b7e0cca404ff8ba8ed5ba823d215e6ba5b4,dylan-9.0.0,1:20:04,11:37.44,1:12:26,5:11.26,0:26.21,0:14.90,0:01.98,27G,4.5G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-ubuntu16_master_qemux86.html Ubuntu 16.04]
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:20:14,11:38.69,1:12:02,5:19.61,0:27.51,0:14.78,0:02.06,28G,4.6G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-ubuntu16-xeon_master_qemux86.html Ubuntu 16.04 (Intel® Xeon® HW)]
ubuntu12,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:22:23,11:34.47,1:12:44,5:13.63,0:26.98,0:14.96,0:02.00,27G,4.6G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-centos7_master_qemux86.html CentOS 7]
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.1-125-gd734ab4,1:15:34,12:51.44,1:09:57,4:55.21,0:27.31,0:15.28,0:02.01,25427952,4783632
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-opensuse422_master_qemux86.html OpenSUSE Leap 42.2] (retired)
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:21:07,12:40.53,1:12:38,4:58.00,0:27.65,0:15.35,0:02.18,25G,4.6G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf-fedora25_master_qemux86.html Fedora 25] (retired)
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:20:10,12:28.66,1:12:24,5:00.78,0:27.98,0:15.64,0:02.20,25G,4.6G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf01_master_qemux86.html Fedora 23] (retired)
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:20:39,12:35.29,1:11:41,4:55.07,0:28.25,0:15.37,0:02.20,25G,4.6G
* [https://wiki.yoctoproject.org/charts/build_perf/latest/ypperf02_master_qemux86.html Ubuntu 15.10] (retired)
ubuntu12,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:20:13,12:52.21,1:13:21,5:01.17,0:27.83,0:15.47,0:02.25,25G,4.6G
ubuntu12,master:7bf5c38e0f8bed9295f46773ade5336ec41044f6,1.5_M1.rc1-50-g7bf5c38,1:21:38,13:18.64,1:12:37,4:54.43,0:28.14,0:15.19,0:02.17,25G,4.6G
ubuntu12,master:7bf5c38e0f8bed9295f46773ade5336ec41044f6,1.5_M1.rc1-50-g7bf5c38,1:21:17,12:58.65,1:12:12,4:57.34,0:27.63,0:15.36,0:02.19,25G,4.6G
ubuntu12,master:7bf5c38e0f8bed9295f46773ade5336ec41044f6,1.5_M1.rc1-50-g7bf5c38,1:21:46,13:09.45,1:13:13,4:57.01,0:27.92,0:15.96,0:02.18,25G,4.6G
ubuntu12,master:7bf5c38e0f8bed9295f46773ade5336ec41044f6,1.5_M1.rc1-50-g7bf5c38,1:22:06,13:06.07,1:12:44,4:54.78,0:27.80,0:15.49,0:02.20,25G,4.6G
ubuntu12,master:5128f0a8465f574f520282499410446a156fc54d,1.5_M1.rc1-52-g5128f0a,1:24:33,13:31.94,1:13:06,4:51.96,0:28.59,0:15.22,0:02.19,25G,4.6G
ubuntu12,master:96b144a25598090b1e58eb5e33f216b5bfef7595,1.5_M1.rc1-54-g96b144a,1:23:11,12:58.86,1:14:20,4:57.85,0:28.32,0:15.29,0:02.21,25G,4.6G
ubuntu12,master:69a6023502fb5830e2f103041985cb72e33806dd,1.5_M1.rc1-86-g69a6023,1:21:36,13:10.87,1:14:05,5:00.99,0:28.18,0:15.69,0:02.26,25G,4.7G
ubuntu12,master:35ea19860bf731d68555b033db23ae9649181b6d,1.5_M1.rc1-104-g35ea198,1:26:30,14:03.83,1:13:52,4:55.25,0:28.22,0:15.59,0:02.19,25G,4.7G
ubuntu12,master:b87429fdb45f82ebe4060fea8c4ecd6e4bc1ae52,1.5_M1.rc1-105-gb87429f,1:23:46,12:56.53,1:14:29,4:58.23,0:28.41,0:15.58,0:02.22,25G,4.7G
ubuntu12,master:13bd8ad0214c645f67966c0a150644224522de18,1.5_M1.rc1-106-g13bd8ad,1:21:20,13:07.61,1:13:53,5:00.12,0:28.06,0:15.48,0:02.19,25G,4.7G
ubuntu12,master:04af378874f38d1200bea2fa191beeae94232d6e,1.5_M1.rc1-144-g04af378,1:24:50,13:20.98,1:15:34,5:05.14,0:28.03,0:15.53,0:02.21,25G,4.7G
ubuntu12,master:04af378874f38d1200bea2fa191beeae94232d6e,1.5_M1.rc1-144-g04af378,1:23:58,13:23.70,1:24:32,4:57.00,0:27.79,0:15.52,0:02.24,25G,4.7G
ubuntu12,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:21:46,13:37.46,1:14:50,4:46.60,0:28.18,0:15.76,0:02.20,25G,4.7G
ubuntu12,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:22:22,13:32.35,1:16:55,4:50.60,0:28.15,0:15.55,0:02.18,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:23:49,12:43.42,1:11:54,4:47.24,0:28.57,0:15.88,0:02.20,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:20:13,12:45.87,1:13:00,4:44.63,0:28.90,0:15.90,0:02.17,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:21:08,13:36.59,1:13:53,4:53.54,0:28.44,0:15.92,0:02.21,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:17:21,12:45.66,1:13:42,4:49.36,0:28.65,0:15.98,0:02.18,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:22:59,12:56.54,1:13:46,4:52.07,0:29.15,0:15.71,0:02.18,25G,4.7G
ubuntu12,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:18:30,12:50.86,1:11:42,4:47.29,0:28.22,0:15.79,0:02.17,25G,4.7G
ubuntu12,master:87da29080429f1793845978901f5160701648c21,1.5_M1.final-280-g87da290,1:23:12,12:58.65,1:13:55,4:49.25,0:28.30,0:16.10,0:02.09,25G,4.7G
ubuntu12,master:87da29080429f1793845978901f5160701648c21,1.5_M1.final-280-g87da290,1:20:12,12:49.07,1:13:39,4:49.15,0:28.66,0:15.83,0:02.10,25G,4.7G
ubuntu12,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:23:09,12:54.55,1:13:51,4:55.59,0:28.68,0:16.15,0:02.10,25G,4.7G
ubuntu12,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:21:47,12:44.32,1:13:18,4:48.94,0:28.49,0:15.81,0:02.13,25G,4.7G
ubuntu12,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:21:27,12:47.97,1:14:27,4:47.35,0:28.32,0:15.98,0:02.12,25G,4.7G
ubuntu12,master:042203531b10b37ac9a8201b376f5dec403e51d8,1.5_M1.final-332-g0422035,1:23:55,12:37.00,1:13:59,4:54.49,0:28.13,0:15.92,0:02.11,25G,4.7G
ubuntu12,master:09a4af20aef12be8f221f3d50781cbcefc322846,1.5_M1.final-356-g09a4af2,1:23:02,12:56.88,1:13:45,4:45.80,0:28.39,0:15.56,0:02.10,25G,4.7G
ubuntu12,master:80b263430453896189b704d0997943642eec6fef,1.5_M1.final-368-g80b2634,1:24:11,12:54.21,1:14:55,4:45.43,0:28.30,0:16.34,0:02.10,25G,4.7G
ubuntu12,master:80b263430453896189b704d0997943642eec6fef,1.5_M1.final-368-g80b2634,1:24:08,13:32.29,1:15:16,4:43.15,0:30.64,0:15.82,0:02.10,25G,4.7G
ubuntu12,master:80b263430453896189b704d0997943642eec6fef,1.5_M1.final-368-g80b2634,1:21:00,12:54.41,1:14:54,4:50.92,0:29.08,0:15.86,0:02.08,25G,4.7G
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:22:32,12:52.80,1:15:04,4:41.00,0:28.59,0:15.73,0:02.09,25G,4.7G
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:20:39,13:06.20,1:15:21,4:45.31,0:28.38,0:17.16,0:02.09,25G,4.7G
ubuntu12,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:23:03,12:44.19,1:15:02,4:43.39,0:28.51,0:16.23,0:02.11,25G,4.7G
ubuntu12,master:8a186a6b3853fc1a7dcf342d421c8926c38949c9,1.5_M1.final-413-g8a186a6,1:21:24,12:47.41,1:15:38,4:45.02,0:28.60,0:16.07,0:02.09,25G,4.7G
ubuntu12,master:8a186a6b3853fc1a7dcf342d421c8926c38949c9,1.5_M1.final-413-g8a186a6,1:24:12,13:06.02,1:14:23,4:47.42,0:28.69,0:16.27,0:02.13,25G,4.7G
ubuntu12,master:8a186a6b3853fc1a7dcf342d421c8926c38949c9,1.5_M1.final-413-g8a186a6,1:22:22,12:52.57,1:15:40,4:42.44,0:28.86,0:15.65,0:02.10,25G,4.7G
ubuntu12,master:dc86293f0444384e8ae5131fdd10b6cb077164b0,1.5_M1.final-458-gdc86293,1:23:07,13:01.92,1:15:19,4:42.50,0:28.42,0:16.25,0:02.11,25G,4.7G
ubuntu12,master:dc86293f0444384e8ae5131fdd10b6cb077164b0,1.5_M1.final-458-gdc86293,1:22:38,12:48.44,1:15:55,4:40.53,0:28.53,0:16.14,0:02.11,25G,4.7G
ubuntu12,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:22:16,12:54.56,1:14:49,4:48.52,0:28.65,0:16.48,0:02.09,25G,4.7G
ubuntu12,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:19:48,12:54.24,1:15:08,4:49.24,0:28.85,0:16.06,0:02.11,25G,4.7G
ubuntu12,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:22:15,13:01.11,1:15:56,4:48.13,0:28.94,0:16.10,0:02.11,25G,4.7G
ubuntu12,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:22:43,13:01.17,1:15:32,4:47.45,0:29.03,0:16.36,0:02.07,25G,4.7G
ubuntu12,master:74e403705e25afec656b5e40921771a9c29bdc40,1.5_M1.final-554-g74e4037,1:23:44,12:52.85,1:16:27,4:45.01,0:29.90,0:16.40,0:02.11,25G,4.7G
ubuntu12,master:74e403705e25afec656b5e40921771a9c29bdc40,1.5_M1.final-554-g74e4037,1:24:56,12:50.73,1:15:50,4:46.09,0:29.24,0:16.02,0:02.12,25G,4.7G
ubuntu12,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:20:41,12:55.65,1:15:50,4:50.86,0:29.25,0:16.13,0:02.11,25G,4.7G
ubuntu12,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:24:01,13:10.14,1:15:42,4:48.39,0:29.27,0:16.28,0:02.12,25G,4.7G
ubuntu12,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:22:51,12:54.08,1:16:31,4:48.45,0:28.80,0:16.21,0:02.11,25G,4.7G
ubuntu12,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:19:07,12:39.85,1:13:55,4:45.69,0:28.69,0:16.12,0:02.12,25G,4.7G
ubuntu12,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:19:16,12:53.22,1:14:04,4:49.27,0:28.92,0:15.85,0:02.10,25G,4.7G
ubuntu12,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:21:20,12:58.78,1:15:43,4:50.13,0:29.22,0:16.55,0:02.12,25G,4.7G
ubuntu12,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:20:47,13:00.22,1:15:15,4:48.94,0:28.97,0:16.25,0:02.12,25G,4.7G
ubuntu12,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:20:11,13:00.12,1:14:18,4:48.24,0:28.97,0:15.94,0:02.09,25G,4.7G
ubuntu12,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:21:30,12:53.97,1:14:22,4:50.51,0:29.03,0:16.26,0:02.12,25G,4.7G
ubuntu12,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:21:19,13:05.22,1:15:50,4:51.31,0:29.29,0:16.34,0:02.16,25G,4.7G
ubuntu12,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:21:50,12:54.58,1:15:30,4:50.52,0:29.41,0:16.35,0:02.10,25G,4.7G
ubuntu12,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:21:34,13:02.26,1:15:04,4:56.65,0:28.96,0:16.41,0:02.08,25G,4.7G
ubuntu12,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:21:20,13:11.14,1:15:13,4:47.86,0:29.35,0:16.11,0:02.10,25G,4.7G
ubuntu12,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:22:21,12:59.91,1:15:25,4:46.27,0:29.50,0:16.12,0:02.08,25G,4.7G
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:20:34,12:57.12,1:16:14,4:49.61,0:28.92,0:16.15,0:02.11,25G,4.7G
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:20:40,13:05.26,1:17:39,4:54.44,0:29.80,0:16.07,0:02.12,25G,4.7G
ubuntu12,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:20:55,12:54.59,1:15:30,4:55.21,0:28.96,0:16.59,0:02.13,25G,4.7G
ubuntu12,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:23:43,13:03.02,1:16:40,4:56.07,0:29.29,0:15.89,0:02.13,25G,4.7G
ubuntu12,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:19:39,12:58.27,1:16:08,4:53.91,0:28.92,0:16.16,0:02.11,25G,4.7G
ubuntu12,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:22:17,12:56.59,1:16:25,4:55.25,0:29.29,0:16.29,0:02.15,25G,4.7G
ubuntu12,master:f63e7f4323368c0d6fe7a1d44393a7e15652d4f2,1.5_M3-105-gf63e7f4,1:23:54,13:03.40,1:16:53,4:50.98,0:30.10,0:16.29,0:02.12,25G,4.7G
ubuntu12,master:f63e7f4323368c0d6fe7a1d44393a7e15652d4f2,1.5_M3-105-gf63e7f4,1:24:41,13:06.19,1:16:47,4:48.89,0:29.06,0:16.14,0:02.33,25G,4.7G
ubuntu12,master:f63e7f4323368c0d6fe7a1d44393a7e15652d4f2,1.5_M3-105-gf63e7f4,1:23:22,13:06.89,1:15:49,4:50.77,0:29.44,0:16.07,0:02.12,25G,4.7G
ubuntu12,master:ff10f72abda52315b892c64f711096772d9a4c1c,1.5_M3-245-gff10f72,1:23:19,13:00.72,1:16:14,4:52.97,0:29.46,0:15.83,0:02.10,25G,4.7G
ubuntu12,master:ff10f72abda52315b892c64f711096772d9a4c1c,1.5_M3-245-gff10f72,1:23:36,13:20.23,1:16:51,4:53.52,0:29.33,0:16.17,0:02.14,25G,4.7G
ubuntu12,master:ff10f72abda52315b892c64f711096772d9a4c1c,1.5_M3-245-gff10f72,1:23:58,13:07.51,1:16:55,4:51.32,0:29.99,0:16.27,0:02.17,25G,4.7G
ubuntu12,master:2a48e9007cc92fedfdb6919411859fb943eacc94,1.5_M3-289-g2a48e90,1:23:03,13:08.35,1:17:57,4:54.61,0:29.77,0:16.35,0:02.12,25G,4.7G
ubuntu12,master:2a48e9007cc92fedfdb6919411859fb943eacc94,1.5_M3-289-g2a48e90,1:23:53,13:10.15,1:16:56,4:47.75,0:29.01,0:16.15,0:02.10,25G,4.7G
ubuntu12,master:2a48e9007cc92fedfdb6919411859fb943eacc94,1.5_M3-289-g2a48e90,1:23:03,13:02.78,1:17:07,4:47.57,0:29.30,0:16.40,0:02.15,25G,4.7G
ubuntu12,master:6382979cca1d1c57467f983ba9611f91555b20a9,1.5_M3-290-g6382979,1:23:34,12:58.54,1:16:56,4:51.15,0:29.49,0:16.27,0:02.13,25G,4.7G
ubuntu12,master:6382979cca1d1c57467f983ba9611f91555b20a9,1.5_M3-290-g6382979,1:23:50,13:20.35,1:16:44,4:48.09,0:29.29,0:16.43,0:02.17,25G,4.7G
ubuntu12,master:6382979cca1d1c57467f983ba9611f91555b20a9,1.5_M3-290-g6382979,1:23:19,13:19.02,1:16:55,4:48.10,0:29.24,0:16.51,0:02.12,25G,4.7G
ubuntu12,master:b2ff1add530b1fec2fb7f385227a03db47015c37,1.5_M3-317-gb2ff1ad,1:23:07,13:06.68,1:15:53,4:50.11,0:29.02,0:16.39,0:02.11,25G,4.7G
ubuntu12,master:b2ff1add530b1fec2fb7f385227a03db47015c37,1.5_M3-317-gb2ff1ad,1:23:26,13:09.66,1:16:50,4:48.81,0:29.46,0:16.38,0:02.11,25G,4.7G
ubuntu12,master:199b1a8c7d7109d9b59d67bf4dcfeb03be07587a,1.5_M3-359-g199b1a8,1:15:04,13:02.06,1:11:25,4:47.96,0:28.98,0:15.92,0:02.20,25G,4.7G
ubuntu12,master:199b1a8c7d7109d9b59d67bf4dcfeb03be07587a,1.5_M3-359-g199b1a8,1:15:17,13:06.10,1:11:39,4:46.47,0:28.94,0:16.31,0:02.12,25G,4.7G
ubuntu12,master:b467b99a5d25efe5eadfb07dbecba608575256ac,1.5_M3-401-gb467b99,1:15:12,12:59.82,1:11:59,4:32.18,0:28.46,0:15.46,0:02.12,25342164,4839736
ubuntu12,master:b467b99a5d25efe5eadfb07dbecba608575256ac,1.5_M3-401-gb467b99,1:15:07,13:00.79,1:12:15,4:33.83,0:28.40,0:15.71,0:02.12,25345680,4839728
ubuntu12,master:b467b99a5d25efe5eadfb07dbecba608575256ac,1.5_M3-401-gb467b99,1:15:54,12:53.76,1:13:59,4:37.07,0:28.46,0:15.68,0:02.13,25342028,4839568
ubuntu12,master:44c3f72684c5c920ce8af1da54a2268047342589,1.5_M3-495-g44c3f72,1:18:44,12:46.93,1:14:53,4:50.40,0:28.70,0:16.23,0:02.30,25758504,4905940
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:19:48,13:26.42,1:15:32,4:52.46,0:29.43,0:16.53,0:02.29,26197272,4978072
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:20:08,13:23.35,1:16:00,4:47.36,0:29.33,0:16.60,0:02.30,26197920,4977880
ubuntu12,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:19:44,13:30.28,1:16:04,4:48.89,0:29.09,0:16.58,0:02.28,26197272,4978548
ubuntu12,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:19:48,13:23.17,1:17:06,4:54.25,0:29.08,0:16.29,0:02.31,26198316,4978624
ubuntu12,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:20:05,13:23.28,1:16:58,4:46.16,0:29.24,0:16.69,0:02.29,26197960,4978832
ubuntu12,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:20:38,13:24.34,1:16:15,4:53.85,0:28.96,0:16.44,0:02.29,26198060,4978924
ubuntu12,master:755f7d9afaab4e7424f5f57587aa45df3807acf0,1.5_M4.rc2-57-g755f7d9,1:17:12,13:20.73,1:14:12,4:45.19,0:28.79,0:15.87,0:01.63,25751624,4914896
ubuntu12,master:755f7d9afaab4e7424f5f57587aa45df3807acf0,1.5_M4.rc2-57-g755f7d9,1:17:38,13:24.96,1:14:31,4:44.49,0:28.62,0:15.85,0:01.59,25751132,4914976
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:18:26,13:37.09,1:14:45,4:45.79,0:28.66,0:15.53,0:01.59,25754096,4915216
ubuntu12,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:19:29,13:37.20,1:14:54,4:40.50,0:28.85,0:15.69,0:01.61,25753868,4914964
</tab>


<tab class=wikitable sep=comma head=top>
== Milestone Test results ==
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
Guadalajara Setup from 2.1 M4 to actual master  
thunderbird,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:05:52,11:04.48,1:05:23,5:16.83,0:30.80,0:17.16,0:02.01,28G,4.7G
thunderbird,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:05:45,11:17.05,1:05:22,5:16.18,0:30.81,0:17.55,0:02.01,28G,4.7G
thunderbird,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.1-125-gd734ab4,1:07:29,11:23.70,1:07:07,5:03.75,0:31.20,0:16.49,0:02.03,25859824,4874196
thunderbird,master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199,1.5_M1.rc1,1:06:21,11:23.33,1:06:18,4:56.64,0:31.32,0:16.87,0:02.23,25G,4.7G
thunderbird,master:7bf5c38e0f8bed9295f46773ade5336ec41044f6,1.5_M1.rc1-54-g96b144a,1:06:56,11:57.49,1:06:48,4:56.85,0:31.47,0:16.92,0:02.23,25G,4.7G
thunderbird,master:96b144a25598090b1e58eb5e33f216b5bfef7595,1.5_M1.rc1-54-g96b144a,1:06:48,11:37.51,1:07:05,6:46.44,0:32.94,0:18.59,0:02.23,25G,4.7G
thunderbird,master:96b144a25598090b1e58eb5e33f216b5bfef7595,1.5_M1.rc1-54-g96b144a,1:06:49,11:29.47,1:06:50,4:55.59,0:31.55,0:17.02,0:02.22,25G,4.7G
thunderbird,master:35ea19860bf731d68555b033db23ae9649181b6d,1.5_M1.rc1-104-g35ea198,1:06:48,12:07.82,1:06:42,5:21.74,0:31.75,0:17.24,0:02.23,25G,4.7G
thunderbird,master:35ea19860bf731d68555b033db23ae9649181b6d,1.5_M1.rc1-104-g35ea198,1:06:55,11:41.60,1:07:03,4:55.73,0:31.80,0:18.33,0:02.22,25G,4.7G
thunderbird,master:13bd8ad0214c645f67966c0a150644224522de18,1.5_M1.rc1-106-g13bd8ad,1:06:39,11:32.22,1:06:55,7:34.15,0:32.31,0:19.55,0:02.40,25G,4.7G
thunderbird,master:13bd8ad0214c645f67966c0a150644224522de18,1.5_M1.rc1-106-g13bd8ad,1:06:42,12:07.90,1:06:24,5:02.10,0:31.63,0:18.48,0:02.23,25G,4.7G
thunderbird,master:04af378874f38d1200bea2fa191beeae94232d6e,1.5_M1.rc1-144-g04af378,1:07:01,11:49.24,1:12:43,7:50.18,0:32.12,0:18.35,0:02.39,25G,4.8G
thunderbird,master:04af378874f38d1200bea2fa191beeae94232d6e,1.5_M1.rc1-144-g04af378,1:06:57,11:41.98,1:06:57,5:01.90,0:31.67,0:18.64,0:02.23,25G,4.8G
thunderbird,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:05:43,11:59.38,1:09:29,7:35.79,0:32.14,0:18.72,0:02.39,25G,4.8G
thunderbird,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:05:28,11:28.20,1:07:02,4:54.82,0:31.81,0:17.44,0:02.22,25G,4.8G
thunderbird,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:05:48,11:30.65,1:07:32,4:51.39,0:31.78,0:17.18,0:02.18,25G,4.8G
thunderbird,master:e023620773df82ba1551bec7fb921e4fef01322e,1.5_M1.rc1-195-ge023620,1:05:34,11:59.83,1:06:59,4:47.96,0:31.95,0:17.03,0:02.17,25G,4.8G
thunderbird,master:1dd643b142c69ac9035e29bff11d02201638dc65,1.5_M1.rc1-224-g1dd643b,1:05:20,12:13.68,1:18:36,6:59.89,0:31.91,0:17.11,0:02.20,25G,4.8G
thunderbird,master:1dd643b142c69ac9035e29bff11d02201638dc65,1.5_M1.rc1-224-g1dd643b,1:05:24,11:55.62,1:06:46,4:49.88,0:31.89,0:17.15,0:02.20,25G,4.8G
thunderbird,master:590010a6525b0e1bc1de73e794764e23404591df,1.5_M1.final-239-g590010a,1:04:57,11:27.97,1:07:19,6:06.83,0:32.49,0:19.05,0:02.35,25G,4.8G
thunderbird,master:590010a6525b0e1bc1de73e794764e23404591df,1.5_M1.final-239-g590010a,1:05:16,11:23.81,1:06:52,4:51.00,0:32.60,0:18.74,0:02.16,25G,4.8G
thunderbird,master:e04e6dab0afa8f72bf001b0cc106cd13b7694a91,1.5_M1.final-245-ge04e6da,1:03:51,11:51.15,1:05:13,5:03.39,0:31.98,0:19.33,0:02.30,25G,4.8G
thunderbird,master:e04e6dab0afa8f72bf001b0cc106cd13b7694a91,1.5_M1.final-245-ge04e6da,1:04:03,11:43.09,1:05:44,4:47.45,0:31.84,0:17.89,0:02.18,25G,4.8G
thunderbird,master:78bcf871c65a87df8b40a0b09654d74434e4d01c,1.5_M1.final-263-g78bcf87,1:04:45,11:50.15,1:07:27,6:43.08,0:32.15,0:18.81,0:02.32,25G,4.8G
thunderbird,master:78bcf871c65a87df8b40a0b09654d74434e4d01c,1.5_M1.final-263-g78bcf87,1:04:42,11:46.32,1:06:29,4:48.85,0:31.77,0:17.15,0:02.15,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:03:50,11:43.56,1:04:38,4:46.28,0:31.96,0:19.61,0:02.32,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:03:45,11:30.21,1:04:59,4:44.63,0:31.76,0:17.19,0:02.18,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:03:58,11:34.53,1:09:12,6:10.17,0:32.32,0:19.21,0:02.19,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:03:57,11:54.92,1:05:06,4:50.50,0:31.78,0:17.81,0:02.20,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:04:48,11:40.74,1:06:32,6:15.45,0:32.30,0:19.50,0:02.30,25G,4.8G
thunderbird,master:edcbb79583e1577cb64d368e3902915dea50a96e,1.5_M1.final-277-gedcbb79,1:04:22,11:41.37,1:05:07,4:45.89,0:31.95,0:18.21,0:02.16,25G,4.8G
thunderbird,master:87da29080429f1793845978901f5160701648c21,1.5_M1.final-280-g87da290,1:04:20,11:38.26,1:09:32,6:07.84,0:32.23,0:19.24,0:02.21,25G,4.8G
thunderbird,master:87da29080429f1793845978901f5160701648c21,1.5_M1.final-280-g87da290,1:04:13,11:30.13,1:05:21,4:45.14,0:31.74,0:18.21,0:02.16,25G,4.8G
thunderbird,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:05:12,11:43.89,1:08:26,6:17.11,0:32.12,0:20.40,0:02.24,25G,4.8G
thunderbird,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:04:39,11:31.04,1:05:51,4:48.28,0:32.18,0:17.26,0:02.14,25G,4.8G
thunderbird,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:04:32,11:41.28,1:07:57,6:18.09,0:32.22,0:19.00,0:02.30,25G,4.8G
thunderbird,master:8e9501ffa8726d69412d669580d787ffedb88d34,1.5_M1.final-328-g8e9501f,1:04:46,11:32.92,1:06:12,4:46.24,0:31.78,0:17.86,0:02.14,25G,4.8G
thunderbird,master:042203531b10b37ac9a8201b376f5dec403e51d8,1.5_M1.final-332-g0422035,1:04:55,11:49.74,1:05:48,4:53.45,0:31.56,0:18.46,0:02.12,25G,4.8G
thunderbird,master:042203531b10b37ac9a8201b376f5dec403e51d8,1.5_M1.final-332-g0422035,1:05:13,11:37.96,1:05:41,4:49.92,0:31.83,0:18.23,0:02.12,25G,4.8G
thunderbird,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:08:59,12:55.64,1:10:29,4:52.32,0:32.29,0:17.37,0:02.13,25G,4.8G
thunderbird,master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a,1.5_M1.final-412-geaa5df3,1:09:36,12:43.86,1:10:17,4:52.71,0:32.11,0:17.31,0:02.16,25G,4.8G
thunderbird,master:dc86293f0444384e8ae5131fdd10b6cb077164b0,1.5_M1.final-458-gdc86293,1:09:41,12:13.13,1:16:47,7:40.10,0:32.31,0:17.38,0:02.14,25G,4.8G
thunderbird,master:dc86293f0444384e8ae5131fdd10b6cb077164b0,1.5_M1.final-458-gdc86293,1:10:27,13:11.16,1:10:38,4:54.98,0:32.42,0:17.53,0:02.14,25G,4.8G
thunderbird,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:04:51,11:33.13,1:06:48,5:25.22,0:32.91,0:18.79,0:02.25,25G,4.8G
thunderbird,master:a63229917a5708de2d161aba0d67168ce0da6365,1.5_M1.final-525-ga632299,1:05:19,11:39.59,1:06:53,4:47.33,0:32.45,0:18.25,0:02.13,25G,4.8G
thunderbird,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:06:03,12:12.71,1:07:53,4:50.40,0:32.57,0:18.38,0:02.19,25G,4.8G
thunderbird,master:3dee534f1e25109e0bdb681de0746c336f4b8840,1.5_M1.final-567-g3dee534,1:06:09,11:59.92,1:07:48,6:19.83,0:32.94,0:19.27,0:02.29,25G,4.8G
thunderbird,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:06:12,12:03.93,1:08:08,6:45.15,0:32.86,0:18.55,0:02.27,25G,4.8G
thunderbird,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:07:37,11:58.15,1:08:28,4:51.63,0:33.10,0:18.33,0:02.15,25G,4.8G
thunderbird,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:08:19,12:19.51,1:10:41,4:58.02,0:32.60,0:17.54,0:02.14,25G,4.8G
thunderbird,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:08:28,12:19.48,1:09:45,4:53.79,0:32.66,0:17.34,0:02.13,25G,4.8G
thunderbird,master:31e6eee860b5f9f4ac9ef0889bcff5648de6e3f9,1.5_M1.final-604-g31e6eee,1:08:31,12:25.61,1:10:10,4:57.14,0:32.49,0:18.54,0:02.15,25G,4.8G
thunderbird,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:04:30,11:37.07,1:07:39,6:09.84,0:33.66,0:19.30,0:02.20,25G,4.8G
thunderbird,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:04:55,11:34.53,1:06:31,4:46.99,0:32.35,0:17.60,0:02.14,25G,4.8G
thunderbird,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:05:41,11:50.53,1:07:07,5:01.07,0:32.66,0:17.90,0:02.36,25G,4.8G
thunderbird,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:05:48,11:31.38,1:07:22,4:51.14,0:33.13,0:17.78,0:02.15,25G,4.8G
thunderbird,master:67864ca79da08df752487a3a4e1a975546da123d,1.5_M1.final-631-g67864ca,1:05:45,11:39.96,1:06:55,4:48.96,0:32.50,0:17.41,0:02.13,25G,4.8G
thunderbird,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:07:38,12:05.60,1:09:12,4:52.04,0:32.59,0:17.57,0:02.13,25G,4.8G
thunderbird,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:07:46,11:36.30,1:09:33,4:52.40,0:32.68,0:17.47,0:02.11,25G,4.8G
thunderbird,master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415,1.5_M3.rc1,1:07:37,11:38.58,1:09:58,4:54.80,0:32.55,0:17.59,0:02.15,25G,4.8G
thunderbird,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:07:58,11:48.62,1:10:23,4:55.20,0:32.77,0:17.55,0:02.14,25G,4.8G
thunderbird,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:08:01,11:46.47,1:10:12,4:52.52,0:32.44,0:17.59,0:02.15,25G,4.8G
thunderbird,master:4cff3defb545643132b7233fcffb3fedc1bf182b,1.5_M3.rc1-45-g4cff3de,1:07:58,11:48.62,1:10:23,4:55.20,0:32.77,0:17.55,0:02.14,25G,4.8G
thunderbird,master:f63e7f4323368c0d6fe7a1d44393a7e15652d4f2,1.5_M3-105-gf63e7f4,1:09:02,12:21.54,1:10:43,5:00.54,0:32.78,0:18.63,0:02.14,25G,4.8G
thunderbird,master:f63e7f4323368c0d6fe7a1d44393a7e15652d4f2,1.5_M3-105-gf63e7f4,1:08:57,11:57.98,1:10:46,4:59.48,0:33.20,0:18.84,0:02.11,25G,4.8G
thunderbird,master:44c3f72684c5c920ce8af1da54a2268047342589,1.5_M3-495-g44c3f72,1:05:50,11:09.72,1:09:49,6:41.43,0:32.59,0:17.66,0:02.53,26200592,4998852
thunderbird,master:44c3f72684c5c920ce8af1da54a2268047342589,1.5_M3-495-g44c3f72,1:06:35,11:25.13,1:07:42,5:02.30,0:32.42,0:17.50,0:02.31,26199680,4998796
thunderbird,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:08:15,12:09.53,1:09:28,5:06.14,0:32.93,0:17.82,0:02.31,26640040,5070688
thunderbird,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:08:11,12:12.62,1:11:07,6:37.02,0:33.24,0:18.03,0:02.54,26639316,5070880
thunderbird,master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f,1.5_M4.rc2,1:08:31,11:55.12,1:09:48,5:07.88,0:32.83,0:17.77,0:02.31,26640472,5070964
thunderbird,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:08:19,11:49.44,1:10:17,5:06.32,0:32.55,0:17.80,0:02.31,26643328,5071484
thunderbird,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:08:25,12:10.84,1:09:47,6:45.56,0:32.87,0:17.96,0:02.85,26639288,5071900
thunderbird,master:d63e6a925a78f0f5fb7e7329b5cc2993f1ec9b14,1.5_M4.rc2-42-gd63e6a9,1:08:27,12:29.21,1:09:44,5:07.24,0:32.78,0:17.35,0:02.31,26638920,5071788
thunderbird,master:755f7d9afaab4e7424f5f57587aa45df3807acf0,1.5_M4.rc2-57-g755f7d9,1:05:30,12:13.34,1:06:50,5:22.10,0:32.72,0:17.52,0:01.76,26189204,5007644
thunderbird,master:755f7d9afaab4e7424f5f57587aa45df3807acf0,1.5_M4.rc2-57-g755f7d9,1:06:00,12:30.44,1:07:13,4:58.12,0:32.46,0:17.15,0:01.63,26189788,5007524
thunderbird,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:09:10,12:35.20,1:12:22,5:13.46,0:34.00,0:17.22,0:01.62,26191068,5007872
thunderbird,master:ed3ef0823fde89371a473d20c0127c0bd16d062b,1.5_M4.rc3,1:09:06,12:11.86,1:10:14,5:10.86,0:32.38,0:17.22,0:01.64,26191508,5007760
</tab>


== 1.4 release & 1.4.1 & 1.4.2 Build Time results ==
* [https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html GDC Charts]


== Old Test results ==


<tab class=wikitable sep=comma head=top>
Milestone test results from the retired Romania Setup (Yocto 1.6 – 2.1) can be found from here:
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
ubuntu12,dylan:789b2b7e0cca404ff8ba8ed5ba823d215e6ba5b4,dylan-9.0.0,1:20:04,11:37.44,1:12:26,5:11.26,0:26.21,0:14.90,0:01.98,27G,4.5G
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:20:14,11:38.69,1:12:02,5:19.61,0:27.51,0:14.78,0:02.06,28G,4.6G
ubuntu12,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:23:01,12:14.09,1:11:38,5:12.68,0:27.39,0:14.71,0:01.98,27G,4.6G
ubuntu12,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:23:17,11:39.01,1:13:22,5:14.69,0:26.86,0:14.61,0:02.00,27G,4.6G
ubuntu12,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:22:23,11:34.47,1:12:44,5:13.63,0:26.98,0:14.96,0:02.00,27G,4.6G
ubuntu12,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.1-125-gd734ab4,1:15:34,12:51.44,1:09:57,4:55.21,0:27.31,0:15.28,0:02.01,25427952,4783632
</tab>


<tab class=wikitable sep=comma head=top>
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts]
hostname,branch:commit,git describe,bitbake core-image-sato,bitbake virtual/kernel,bitbake core-image-sato (rm_work),bitbake core-image-sato -c rootfs,bitbake -p (rm -rf cache/ tmp/cache/), bitbake -p (rm -rf tmp/cache/),bitbake -p,size of tmp dir, size of tmp dir (rm_work)
thunderbird,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:05:52,11:04.48,1:05:23,5:16.83,0:30.80,0:17.16,0:02.01,28G,4.7G
thunderbird,dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f,dylan-9.0.1.rc1,1:05:53,10:27.02,1:05:18,5:10.17,0:30.50,0:17.37,0:02.05,28G,4.7G
thunderbird,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:05:45,11:15.34,1:05:44,5:08.59,0:30.48,0:16.33,0:02.00,28G,4.7G
thunderbird,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:05:36,11:11.98,1:05:33,5:10.65,0:31.08,0:16.34,0:02.03,28G,4.7G
thunderbird,dylan:e4a0a4c5e419154a34710a1b6c28d4180c6304c3,dylan-9.0.1.rc1-6-ge4a0a4c,1:05:45,11:17.05,1:05:22,5:16.18,0:30.81,0:17.55,0:02.01,28G,4.7G
thunderbird,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.1-125-gd734ab4,1:07:30,11:26.07,1:07:32,5:07.33,0:30.69,0:16.41,0:02.02,25857804,4874216
thunderbird,dylan:d734ab491a30078d43dee5440c03acce2d251425,yocto-1.4.1-125-gd734ab4,1:07:29,11:23.70,1:07:07,5:03.75,0:31.20,0:16.49,0:02.03,25859824,4874196
</tab>


Raw test data from the retired Romania test setup has been moved to
* [[Performance_Test_Old_Results]]
* [[Performance_Test_Weekly_1.5]] has the old weekly results ran during the 1.5 cycle.


Configuration for the Romania Setup 1.6 - 2.1:


[[Performance_Test_1.4_Milestones]]
* Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and
* Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64)
* HW configuration: SandyBridge i7-2600 CPU @ 3.40GHz (4 cores/8 threads),  8GB RAM,  1 x 500 GB HDD

Latest revision as of 14:17, 28 January 2019

Build time tracking

Script used for running the builds:

  • Before morty: poky/scripts/contrib/build-perf-test.sh
  • After morty: poky/scripts/oe-build-perf-test

Two identical test systems are used for the results, with all updates available installed. Extra packages installed (besides what's by the default in the distro) are the ones in the Quick Start guide.

Configuration of the GDC Setup 2.1 - Current master

  • Ubuntu 15.10 (Wily Werewolf)" --> 4.2.0-16-generic
  • Fedora release 23 (Twenty Three) --> 4.7.10-100.fc23.x86_64
  • HW configuration: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz, 16GB RAM, 1 x 600 GB SDD, 1 x 2 TB HDD

All system/distro settings are distro's defaults, that includes:

- FS mount options: ext4 rw,relatime,data=ordered

- IO scheduler: cfq and CPU governer: ondemand

local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).

It however exports these in the enviroment: 

BB_NUMBER_THREADS = "8"
PARALLEL_MAKE = "-j 8"
MACHINE = "qemux86"

FAQ:

  • Q: Where is 1.5_M2? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
  • Q: What's with the different number of RCs? See Yocto_Project_Release_Process#Milestone_Releases
  • Q: Why are there more results for some commits? The script is ran from a cron job multiple times a day, sometimes master changes daily sometimes it doesn't, hence more results for one commit (ie weekends)


Daily Test Results

Build performance test suite is run multiple times per day. Latest test reports for master branch can found here:

Milestone Test results

Guadalajara Setup from 2.1 M4 to actual master

Old Test results

Milestone test results from the retired Romania Setup (Yocto 1.6 – 2.1) can be found from here:

Raw test data from the retired Romania test setup has been moved to

Configuration for the Romania Setup 1.6 - 2.1:

  • Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and
  • Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64)
  • HW configuration: SandyBridge i7-2600 CPU @ 3.40GHz (4 cores/8 threads), 8GB RAM, 1 x 500 GB HDD
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Performance_Test&oldid=46678"