Performance Test
From Yocto Project
Jump to navigationJump to search
Build Time Perfomance
Script used for running the builds: (dylan/master branch): scripts/contrib/build-perf-test.sh
Two identical test systems are used for the results below, one with Ubuntu 12.04 (uname -nr: ubuntu12 3.8.0-31-generic) and one with Fedora 19 (uname -nr: fedora19 3.11.3-201.fc19.x86_64) with all updates available installed.
All system/distro settings are distro's defaults, that includes:
- FS mount options: ext4 rw,relatime,data=ordered
- IO scheduler: cfq and CPU governer: ondemand
HW config is: SandyBridge i7-2600 CPU @ 3.40GHz HT-enabled (4 cores/8 threads), 8GB RAM, 1 x 500 GB HDD
local.conf it's the default one (the script doesn't touch it except for changing DL_DIR if necessary).
It however exports these in the enviroment:
BB_NUMBER_THREADS = "8" PARALLEL_MAKE = "-j 8" MACHINE = "qemux86"
In the tables below, unless otherwise noted, sizes are in kilobytes.
Note: This page holds a re-run of milestone/RCs builds for the 1.5 cycle + 1.4.1/1.4.2 and for upcoming builds for 1.6. This page has the old weekly results ran during the 1.5 cycle. The results differ because the test sytems used there are a bit different than those here (so don't cross compare results).
- Q: Where is M2 ? It's there but it's called: 1.5_M1.final-412-geaa5df3 The M2 build wasn't released hence no git tag
- Q: What's with the different number of RCs? See Yocto_Project_Release_Process#Milestone_Releases
1.4.1 & 1.4.2 Build Time results
| hostname | branch:commit | git describe | bitbake core-image-sato | bitbake virtual/kernel | bitbake core-image-sato (rm_work) | bitbake core-image-sato -c rootfs | bitbake -p (rm -rf cache/ tmp/cache/) | bitbake -p (rm -rf tmp/cache/) | bitbake -p | size of tmp dir | size of tmp dir (rm_work) |
|---|---|---|---|---|---|---|---|---|---|---|---|
| ubuntu12 | dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f | yocto-1.4.1 | 1:16:41 | 11:32.41 | 1:06:51 | 5:14.78 | 0:26.75 | 0:14.81 | 0:01.96 | 28213628 | 4743912 |
| ubuntu12 | dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f | yocto-1.4.1 | 1:14:31 | 11:34.66 | 1:06:41 | 5:12.70 | 0:26.54 | 0:14.74 | 0:01.92 | 28213772 | 4743844 |
| ubuntu12 | dylan:73f103bf9b2cdf985464dc53bf4f1cfd71d4531f | yocto-1.4.1 | 1:12:39 | 11:35.99 | 1:06:59 | 5:16.48 | 0:26.77 | 0:14.71 | 0:01.96 | 28217808 | 4743800 |
| ubuntu12 | dylan:d734ab491a30078d43dee5440c03acce2d251425 | yocto-1.4.2 | 1:12:58 | 12:56.22 | 1:07:45 | 4:54.36 | 0:26.78 | 0:14.73 | 0:01.95 | 25349116 | 4767324 |
| ubuntu12 | dylan:d734ab491a30078d43dee5440c03acce2d251425 | yocto-1.4.2 | 1:13:33 | 12:44.85 | 1:08:10 | 5:01.71 | 0:26.87 | 0:14.80 | 0:01.99 | 25349708 | 4767348 |
| ubuntu12 | dylan:d734ab491a30078d43dee5440c03acce2d251425 | yocto-1.4.2 | 1:13:00 | 12:59.19 | 1:08:13 | 5:07.04 | 0:26.83 | 0:14.73 | 0:01.97 | 25363408 | 4767380 |
| hostname | branch:commit | git describe | bitbake core-image-sato | bitbake virtual/kernel | bitbake core-image-sato (rm_work) | bitbake core-image-sato -c rootfs | bitbake -p (rm -rf cache/ tmp/cache/) | bitbake -p (rm -rf tmp/cache/) | bitbake -p | size of tmp dir | size of tmp dir (rm_work) |
|---|
1.5 Milestones results
| hostname | branch:commit | git describe | bitbake core-image-sato | bitbake virtual/kernel | bitbake core-image-sato (rm_work) | bitbake core-image-sato -c rootfs | bitbake -p (rm -rf cache/ tmp/cache/) | bitbake -p (rm -rf tmp/cache/) | bitbake -p | size of tmp dir | size of tmp dir (rm_work) |
|---|
| hostname | branch:commit | git describe | bitbake core-image-sato | bitbake virtual/kernel | bitbake core-image-sato (rm_work) | bitbake core-image-sato -c rootfs | bitbake -p (rm -rf cache/ tmp/cache/) | bitbake -p (rm -rf tmp/cache/) | bitbake -p | size of tmp dir | size of tmp dir (rm_work) |
|---|---|---|---|---|---|---|---|---|---|---|---|
| thunderbird | master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199 | 1.5_M1.rc1 | 1:06:19 | 16:02.83 | 1:15:05 | 4:54.64 | 0:31.35 | 0:18.24 | 0:02.19 | 25G | 4.7G |
| thunderbird | master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199 | 1.5_M1.rc1 | 1:13:43 | 12:12.01 | 1:06:04 | 4:58.59 | 0:31.27 | 0:18.62 | 0:02.20 | 25G | 4.7G |
| thunderbird | master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199 | 1.5_M1.rc1 | 1:06:36 | 11:50.66 | 1:18:42 | 4:56.03 | 0:31.22 | 0:16.85 | 0:02.19 | 25G | 4.7G |
| thunderbird | master:a62aed41f2d8f874f7ae24d0e5be5dbc66ea2199 | 1.5_M1.rc1 | 1:06:21 | 11:23.33 | 1:06:18 | 4:56.64 | 0:31.32 | 0:16.87 | 0:02.23 | 25G | 4.7G |
| thunderbird | master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a | 1.5_M2.rc1 | 1:08:59 | 12:55.64 | 1:10:29 | 4:52.32 | 0:32.29 | 0:17.37 | 0:02.13 | 25G | 4.8G |
| thunderbird | master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a | 1.5_M2.rc1 | 1:10:30 | 13:09.84 | 1:10:33 | 4:50.67 | 0:32.03 | 0:17.19 | 0:02.17 | 25G | 4.8G |
| thunderbird | master:eaa5df34af42b6a37f6506847d0f3ef6ba0d298a | 1.5_M2.rc1 | 1:09:36 | 12:43.86 | 1:10:17 | 4:52.71 | 0:32.11 | 0:17.31 | 0:02.16 | 25G | 4.8G |
| thunderbird | master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415 | 1.5_M3.rc1 | 1:07:38 | 12:05.60 | 1:09:12 | 4:52.04 | 0:32.59 | 0:17.57 | 0:02.13 | 25G | 4.8G |
| thunderbird | master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415 | 1.5_M3.rc1 | 1:07:46 | 11:36.30 | 1:09:33 | 4:52.40 | 0:32.68 | 0:17.47 | 0:02.11 | 25G | 4.8G |
| thunderbird | master:9de0ad47462c13ac4a2d73e12e92be6c1b4e0415 | 1.5_M3.rc1 | 1:07:37 | 11:38.58 | 1:09:58 | 4:54.80 | 0:32.55 | 0:17.59 | 0:02.15 | 25G | 4.8G |
| thunderbird | master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f | 1.5_M4.rc2 | 1:08:15 | 12:09.53 | 1:09:28 | 5:06.14 | 0:32.93 | 0:17.82 | 0:02.31 | 26640040 | 5070688 |
| thunderbird | master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f | 1.5_M4.rc2 | 1:08:11 | 12:12.62 | 1:11:07 | 6:37.02 | 0:33.24 | 0:18.03 | 0:02.54 | 26639316 | 5070880 |
| thunderbird | master:5745e45b18e5099e94b4d5a73bc97dc6d4cdc91f | 1.5_M4.rc2 | 1:08:31 | 11:55.12 | 1:09:48 | 5:07.88 | 0:32.83 | 0:17.77 | 0:02.31 | 26640472 | 5070964 |
| thunderbird | master:ed3ef0823fde89371a473d20c0127c0bd16d062b | 1.5_M4.rc3 | 1:09:10 | 12:35.20 | 1:12:22 | 5:13.46 | 0:34.00 | 0:17.22 | 0:01.62 | 26191068 | 5007872 |
| thunderbird | master:ed3ef0823fde89371a473d20c0127c0bd16d062b | 1.5_M4.rc3 | 1:09:06 | 12:11.86 | 1:10:14 | 5:10.86 | 0:32.38 | 0:17.22 | 0:01.64 | 26191508 | 5007760 |
| thunderbird | master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82 | 1.5_M5.rc1 | 1:09:06 | 12:19.34 | 1:09:50 | 5:01.06 | 0:32.06 | 0:16.88 | 0:01.67 | 26188240 | 5006064 |
| thunderbird | master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82 | 1.5_M5.rc1 | 1:08:51 | 12:18.70 | 1:09:59 | 5:03.20 | 0:31.87 | 0:16.82 | 0:01.59 | 26187888 | 5006224 |
| thunderbird | master:566ca1e4769b4ec7e3f6c6a98bb817db2221cf82 | 1.5_M5.rc1 | 1:08:50 | 12:21.37 | 1:10:36 | 4:58.62 | 0:32.37 | 0:16.91 | 0:01.62 | 26186304 | 5006164 |
| thunderbird | master:853bc53cd58a621918f0e5ce662dba263d1befb4 | 1.5_M5.rc4 | 1:07:52 | 12:12.11 | 1:08:51 | 4:53.53 | 0:29.19 | 0:14.19 | 0:01.56 | 26272324 | 5029132 |
| thunderbird | master:853bc53cd58a621918f0e5ce662dba263d1befb4 | 1.5_M5.rc4 | 1:08:03 | 12:06.52 | 1:08:59 | 4:53.33 | 0:29.17 | 0:14.14 | 0:01.57 | 26272832 | 5029180 |
| thunderbird | master:853bc53cd58a621918f0e5ce662dba263d1befb4 | 1.5_M5.rc4 | 1:08:12 | 12:37.96 | 1:09:07 | 4:53.13 | 0:29.12 | 0:14.27 | 0:01.57 | 26273212 | 5029152 |
