Performance - Revision history

Rpurdie: Replaced content with "See https://wiki.yoctoproject.org/wiki/Profiling"

2015-06-18T14:28:59Z

Replaced content with "See https://wiki.yoctoproject.org/wiki/Profiling"

Dongxiao.xu at 03:15, 16 February 2011

2011-02-16T03:15:37Z

← Older revision		Revision as of 03:15, 16 February 2011
Line 91:		Line 91:
	Note:<br>		Note:<br>
	Optimization A: commit: 53aff7d6775eb1c2c8f419f325b91c062d85eed5<br>		Optimization A: commit: 53aff7d6775eb1c2c8f419f325b91c062d85eed5<br>
	~~Current~~: Latest master with parallel parsing mechanism<br>		01/07/2011 build: Latest master with parallel parsing mechanism<br>
	Optimization B: "??=" re-implementation. (Pending for review)<br>		Optimization B: "??=" re-implementation. (Pending for review)<br>
	<br>		<br>

Dongxiao.xu at 01:07, 16 February 2011

2011-02-16T01:07:09Z

← Older revision		Revision as of 01:07, 16 February 2011
Line 38:		Line 38:
	Green-3.3.1: http://autobuilder.yoctoproject.org/downloads/poky/poky-green-3.3.1.tar.bz2<br>		Green-3.3.1: http://autobuilder.yoctoproject.org/downloads/poky/poky-green-3.3.1.tar.bz2<br>
	Yocto-0.9: http://autobuilder.yoctoproject.org/downloads/poky/poky-laverne-4.0.tar.bz2<br>		Yocto-0.9: http://autobuilder.yoctoproject.org/downloads/poky/poky-laverne-4.0.tar.bz2<br>
	~~Current~~: commit b22e345e05efcc3f66278af8f09fb083afe32b68<br>		01/07/2011 build: commit b22e345e05efcc3f66278af8f09fb083afe32b68<br>
			02/14/2011 build: commit 6cb8fd6def4912e4aa76330649ba42a9ed2694fd<br>
	<br>		<br>
	Other detail commit number for optimization will be annotated in the table note. See following.<br>		Other detail commit number for optimization will be annotated in the table note. See following.<br>
Line 74:		Line 75:
	\|align="center"\|220%		\|align="center"\|220%
	\|-		\|-
	\|align="center"\|~~Current~~		\|align="center"\|01/07/2011 build
	\|align="center"\|770		\|align="center"\|770
	\|align="center"\|16.6		\|align="center"\|16.6
Line 132:		Line 133:
	\|align="center"\|185%		\|align="center"\|185%
	\|-		\|-
	\|align="center"\|~~Current~~		\|align="center"\|01/07/2011 build
	\|align="center"\|147		\|align="center"\|147
	\|align="center"\|134m39s		\|align="center"\|134m39s
Line 138:		Line 139:
	\|align="center"\|134m39s		\|align="center"\|134m39s
	\|align="center"\|250%		\|align="center"\|250%
			\|-
			\|align="center"\|pipe buffer 1024 (before pipe buffer fix)
			\|align="center"\|170
			\|align="center"\|101m8s
			\|align="center"\|147
			\|align="center"\|87m27s
			\|align="center"\|162%
			\|-
			\|align="center"\|pipe buffer 102400 (after pipe buffer fix)
			\|align="center"\|170
			\|align="center"\|97m32s
			\|align="center"\|147
			\|align="center"\|84m20s
			\|align="center"\|156%
			\|-
			\|align="center"\|02/14/2011 build
			\|align="center"\|227
			\|align="center"\|75m10s
			\|align="center"\|147
			\|align="center"\|48m40s
			\|align="center"\|90%
	\|}		\|}

Line 143:		Line 165:
	Exec (before pseudo wrapper): commit 84263dbf43eba5cd99ce59062cef807a966e7312<br>		Exec (before pseudo wrapper): commit 84263dbf43eba5cd99ce59062cef807a966e7312<br>
	Fork (after pseudo wrapper): commit 995d4679d4bb6a28dd6fbdb1becc4231369311b7<br>		Fork (after pseudo wrapper): commit 995d4679d4bb6a28dd6fbdb1becc4231369311b7<br>
	~~The current build time is somewhat long, which we will look at.~~<br>		pipe buffer 1024 (before pipe buffer fix): commit 754047b6ec01df5f3159cce93b17b8493d0af5e1<br>
			pipe buffer 102400 (after pipe buffer fix): commit 06c6db7929c75f576a395fb442abe447b833fc3b<br>
	<br>		<br>
	{\| cellpadding="10" cellspacing="0" border="1"		{\| cellpadding="10" cellspacing="0" border="1"
Line 175:		Line 198:
	\|align="center"\|189%		\|align="center"\|189%
	\|-		\|-
	\|align="center"\|~~Current~~		\|align="center"\|01/07/2011 build
	\|align="center"\|147		\|align="center"\|147
	\|align="center"\|24		\|align="center"\|24

Dongxiao.xu at 00:32, 15 January 2011

2011-01-15T00:32:00Z

Show changes

Dongxiao.xu at 07:32, 13 January 2011

2011-01-13T07:32:18Z

Dongxiao.xu at 07:23, 13 January 2011

2011-01-13T07:23:16Z

← Older revision		Revision as of 07:23, 13 January 2011
Line 57:		Line 57:
	Using fork way in bitbake will gain about 10% build time for poky-image-minimal.<br>		Using fork way in bitbake will gain about 10% build time for poky-image-minimal.<br>
	The current build time is somewhat long, which we will look at.<br>		The current build time is somewhat long, which we will look at.<br>
			<br>
	{\| cellpadding="10" cellspacing="0" border="1"		{\| cellpadding="10" cellspacing="0" border="1"
	\|+Table 3: Disk Footprint Optmization Results (poky-image-minimal)		\|+Table 3: Disk Footprint Optmization Results (poky-image-minimal)
Line 84:		Line 84:
	Optimization A: Remove the temp files in sstate-build-* (Already in master tree).<br>		Optimization A: Remove the temp files in sstate-build-* (Already in master tree).<br>
	Optimization B: Using hardlink to replace copy between "package-->packages-split", "image-->sysroot-destdir", and "sysroot-destdir-->/tmp/sysroots" (Pending for review).<br>		Optimization B: Using hardlink to replace copy between "package-->packages-split", "image-->sysroot-destdir", and "sysroot-destdir-->/tmp/sysroots" (Pending for review).<br>
			<br>

			There are some other data we may add later.<br>
			1) Using socket data accessing approach to avoid data re-parsing when fork/exec new bitbake processes. (Qing)

Dongxiao.xu: Created page with 'Performance is an essential point for measuring the quality of a build system.
We are continously improving poky/bitbake performance, including major parts of build time, dis…'

2011-01-13T07:18:06Z

Created page with 'Performance is an essential point for measuring the quality of a build system. We are continously improving poky/bitbake performance, including major parts of build time, dis…'

New page

Performance is an essential point for measuring the quality of a build system. 
We are continously improving poky/bitbake performance, including major parts of build time, disk footprint, and file parsing speed. 
Here are some performance measurement results: 
 
{| cellpadding="10" cellspacing="0" border="1"
|+Table 1: File Parsing Time Optmization Results
|File parsing time
|Green-3.3.1
|Yocto-0.9
|Optimization A
|Optimization B
|Current
|-
|BB file number
|925
|844
|757
|757
|769
|-
|time (s)
|17
|45
|29
|26
|16
|}
Note: 
Optimization A: Exclude variables in distro_tracking_fields.inc from normal parsing. (Already in master tree) 
Optimization B: "??=" re-implementation. (Pending for review) 
Current: Latest master with parallel parsing mechanism 
 
{| cellpadding="10" cellspacing="0" border="1"
|+Table 2: Build Time Optmization Results (poky-image-minimal)
|Build time
|Green-3.3.1
|Yocto-0.9
|Exec (before pseudo wrapper)
|Fork (after pseudo wrapper)
|Current
|-
|Recipe number
|88
|147
|147
|147
|147
|-
|time (s)
|32m57s
|88m50s
|114m6s
|99m52s
|134m39s
|}
Note: 
Using fork way in bitbake will gain about 10% build time for poky-image-minimal. 
The current build time is somewhat long, which we will look at. 

{| cellpadding="10" cellspacing="0" border="1"
|+Table 3: Disk Footprint Optmization Results (poky-image-minimal)
|Disk Space
|Green-3.3.1
|Yocto-0.9
|Optimization A
|Optimization B
|Current
|-
|Recipe number
|88
|147
|147
|147
|147
|-
|Disk size (GB)
|7.6
|29
|24
|19
|24
|}
Note: 
Optimization A: Remove the temp files in sstate-build-* (Already in master tree). 
Optimization B: Using hardlink to replace copy between "package-->packages-split", "image-->sysroot-destdir", and "sysroot-destdir-->/tmp/sysroots" (Pending for review).

← Older revision		Revision as of 07:32, 13 January 2011
Line 1:		Line 1:
	Performance is an essential point for measuring the quality of a build system.<br>		Performance is an essential point for measuring the quality of a build system.<br>
	We are continously improving poky/bitbake performance, including major parts of build time, disk footprint, and file parsing speed.<br>		We are continously improving poky/bitbake performance, including major parts of build time, disk footprint, and file parsing speed.<br>
	Here are some performance measurement results:<br>		Here are some performance measurement results: (b22e345e05efcc3f66278af8f09fb083afe32b68 is chosen as "Current" commit)<br>
	<br>		<br>
	{\| cellpadding="10" cellspacing="0" border="1"		{\| cellpadding="10" cellspacing="0" border="1"
Line 27:		Line 27:
	\|}		\|}
	Note:<br>		Note:<br>
	Optimization A: Exclude variables in distro_tracking_fields.inc from normal parsing. (~~Already in~~ master tree)<br>		Optimization A: Exclude variables in distro_tracking_fields.inc from normal parsing. (In master tree, commit: 53aff7d6775eb1c2c8f419f325b91c062d85eed5)<br>
	Optimization B: "??=" re-implementation. (Pending for review)<br>		Optimization B: "??=" re-implementation. (Pending for review)<br>
	Current: Latest master with parallel parsing mechanism<br>		Current: Latest master with parallel parsing mechanism<br>
Line 82:		Line 82:
	\|}		\|}
	Note:<br>		Note:<br>
	Optimization A: Remove the temp files in sstate-build-* (~~Already in~~ master tree).<br>		Optimization A: Remove the temp files in sstate-build-* (In master tree, commit: 7e7bb24b8512dd1452a11d8aeafc8dedcbc4d623).<br>
	Optimization B: Using hardlink to replace copy between "package-->packages-split", "image-->sysroot-destdir", and "sysroot-destdir-->/tmp/sysroots" (Pending for review).<br>		Optimization B: Using hardlink to replace copy between "package-->packages-split", "image-->sysroot-destdir", and "sysroot-destdir-->/tmp/sysroots" (Pending for review).<br>
	<br>		<br>

	There are some other data we may add later.<br>		There are some other data we may add later.<br>
	1) Using socket data accessing approach to avoid data re-parsing when fork/exec new bitbake processes. ~~(Qing)~~		1) Using socket data accessing approach to avoid data re-parsing when fork/exec new bitbake processes.