1.4 QA Status: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 641: Line 641:
'''Performance Metrics'''
'''Performance Metrics'''
  <nowiki>
  <nowiki>
  core-image-sato build time: 79 min 56 sec
  Performance data comparison: https://wiki.yoctoproject.org/wiki/Performance_Test
  (see test case https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=389 )
  Posix result: https://wiki.yoctoproject.org/wiki/Posix_result
 
  LTP result: https://wiki.yoctoproject.org/wiki/LTP_result</nowiki>
  Performance data comparison: https://wiki.yoctoproject.org/wiki/Performance_Test</nowiki>


==Build-appliance==
==Build-appliance==

Revision as of 17:30, 27 February 2013

Testing data

 Test type: Full Pass
 Branch: master
 Milestone: 1.4 M4
 Build name: M4-rc1
 poky commit: 7d22ef28e64de06b6238d0ef9b664c0bee6efa46
 poky commit date: 2013-02-19
 Eclipse Plugin commit: 
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130220-2/ 

Summary Report

Core Build System

Status: {{#testopia: |report_id=status |run_id=243, 244, 273 |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=243, 244, 273 |chart=bstatus |sortable=true |charttype=bar}}

HOB

Status: {{#testopia: |report_id=status |run_id=241 |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=241 |chart=bstatus |sortable=true |charttype=bar}}

BSP & QEMU

Status: {{#testopia: |report_id=status |run_id=246, 250, 251, 254, 255, 257, 259, 260, 261, 268, 272, 274, 275, 276, 277 |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=246, 250, 251, 254, 255, 257, 259, 260, 261, 268, 272, 274, 275, 276, 277 |chart=bstatus |sortable=true |charttype=bar}}

Performance testing

Status: {{#testopia: |report_id=status |run_id=256 |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=256 |chart=bstatus |sortable=true |charttype=bar}}

Build-appliance

Status: {{#testopia: |report_id=status |run_id=245 |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=245 |chart=bstatus |sortable=true |charttype=bar}}

ADT & Eclipse Plugin

Status:

{{#testopia: |report_id=status |run_id=236, 237, 248, 249, 252 |sortable=true |charttype=pie3}}

Bugs: {{#testopia: |report_id=bugs |run_id=236, 237, 248, 249, 252 |chart=bstatus |sortable=true |charttype=bar}}

Detailed Report

Core Build System

Bitbake

Status {{#testopia: |run_id=243 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=243 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=243 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id=244 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=244 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=244 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id=273 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=273 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=273 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Hob

Status {{#testopia: |run_id=241 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=241 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=241 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

NUC: core-image-sato-sdk

Status {{#testopia: |run_id=277 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=277 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=277 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Emenlow: core-image-sato-sdk

Status {{#testopia: |run_id=251 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=251 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=251 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Sugarbay: core-image-sato-sdk

Status {{#testopia: |run_id=254 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=254 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=254 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Jasperforest: core-image-sato-sdk

Status {{#testopia: |run_id=246 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=246 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=246 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Crownbay: core-image-sato-sdk-noemgd

Status {{#testopia: |run_id=250 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=250 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=250 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

FRI2: core-image-sato-sdk

Status {{#testopia: |run_id=255 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=255 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=255 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id=275 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=275 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=275 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id=274 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=274 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=274 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id=276 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=276 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=276 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id=272 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=272 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=272 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id=268 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=268 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=268 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beagleboard: core-image-sato-sdk

Status {{#testopia: |run_id=259 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=259 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=259 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Routerstationpro: core-image-sato-sdk

Status {{#testopia: |run_id=260 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=260 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=260 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id=261 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=261 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=261 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id=257 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=257 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=257 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Performance Testing

Status {{#testopia: |run_id=256 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=256 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=256 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Performance Metrics

 Performance data comparison: https://wiki.yoctoproject.org/wiki/Performance_Test
 Posix result: https://wiki.yoctoproject.org/wiki/Posix_result
 LTP result: https://wiki.yoctoproject.org/wiki/LTP_result

Build-appliance

Status {{#testopia: |run_id=245 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=245 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=245 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora 17 i686

Status {{#testopia: |run_id=249 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=249 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=249 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora 17 x86-64

Status {{#testopia: |run_id=237 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=237 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=237 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu 12.04 x86-64

Status {{#testopia: |run_id=236 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=236 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=236 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: OpenSUSE 12.2 x86-64

Status {{#testopia: |run_id=248 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=248 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=248 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Eclipse Plugin on Fedora 17 x86-64

Status {{#testopia: |run_id=252 |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id=252 |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id=252 |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}