Wiki Test Report Format: Difference between revisions
From Yocto Project
Jump to navigationJump to search
| Line 41: | Line 41: | ||
| '''SDK'''|| ||bgcolor="red" |BLOCK||i686 toolchain not copied to sharing folder; unfs does not work with qemuppc; | | '''SDK'''|| ||bgcolor="red" |BLOCK||i686 toolchain not copied to sharing folder; unfs does not work with qemuppc; | ||
|- | |- | ||
| '''Poky'''|| ||bgcolor=" | | '''Poky'''|| ||bgcolor="orange" |BUGGY||sstate and non-gplv3 build do not work correctly | ||
|- | |- | ||
| '''Stress'''|| ||bgcolor="green" |GOOD||Sugarbay pass 18 hours stress and Jasperforest pass 12 hours stress | | '''Stress'''|| ||bgcolor="green" |GOOD||Sugarbay pass 18 hours stress and Jasperforest pass 12 hours stress | ||
| Line 63: | Line 63: | ||
| align="center" style="background:#f0f0f0;"|'''Mulitimedia''' | | align="center" style="background:#f0f0f0;"|'''Mulitimedia''' | ||
|- | |- | ||
| '''qemux86'''||Buggy||bgcolor="green" |GOOD|| || || || || | | '''qemux86'''||bgcolor="orange"| Buggy||bgcolor="green" |GOOD|| || || || || | ||
|- | |- | ||
| '''qemux86-64'''||Buggy||bgcolor="green" |GOOD|| || || || || | | '''qemux86-64'''||bgcolor="orange"| Buggy||bgcolor="green" |GOOD|| || || || || | ||
|- | |- | ||
| '''qemuarm'''||Buggy||bgcolor="green" |GOOD|| || || || || | | '''qemuarm'''||bgcolor="orange"| Buggy||bgcolor="green" |GOOD|| || || || || | ||
|- | |- | ||
| '''qemumips'''||Buggy||bgcolor="green" |GOOD|| || || || || | | '''qemumips'''||bgcolor="orange"| Buggy||bgcolor="green" |GOOD|| || || || || | ||
|- | |- | ||
| '''qemuppc'''||Buggy||bgcolor="green" |GOOD|| || || || || | | '''qemuppc'''||bgcolor="orange"| Buggy||bgcolor="green" |GOOD|| || || || || | ||
|- | |- | ||
| '''SugarBay'''||bgcolor="green" |GOOD|| ||Buggy||bgcolor="green" |GOOD||bgcolor="green" |GOOD (May add Link to P&P result page)||bgcolor="green" |GOOD||bgcolor="green" |GOOD | | '''SugarBay'''||bgcolor="green" |GOOD|| ||bgcolor="orange"Buggy||bgcolor="green" |GOOD||bgcolor="green" |GOOD (May add Link to P&P result page)||bgcolor="green" |GOOD||bgcolor="green" |GOOD | ||
|- | |- | ||
| '''CrownBay'''||bgcolor="green" |GOOD|| ||bgcolor="green" |GOOD|| || ||bgcolor="green" |GOOD||bgcolor="green" |GOOD | | '''CrownBay'''||bgcolor="green" |GOOD|| ||bgcolor="green" |GOOD|| || ||bgcolor="green" |GOOD||bgcolor="green" |GOOD | ||
| Line 79: | Line 79: | ||
| '''CrownBay noemgd'''||bgcolor="green" |GOOD || || || || || || | | '''CrownBay noemgd'''||bgcolor="green" |GOOD || || || || || || | ||
|- | |- | ||
| '''FishRiver Island 2'''||bgcolor="green" |GOOD|| ||Buggy|| ||GOOD(May add Link to P&P result page)||bgcolor="green" |GOOD||bgcolor="green" |GOOD | | '''FishRiver Island 2'''||bgcolor="green" |GOOD|| ||bgcolor="orange" | Buggy|| ||GOOD(May add Link to P&P result page)||bgcolor="green" |GOOD||bgcolor="green" |GOOD | ||
|- | |- | ||
| '''HuronRiver'''||BLOCK|| || || ||BLOCK||BLOCK||BLOCK | | '''HuronRiver'''||BLOCK|| || || ||BLOCK||BLOCK||BLOCK | ||
| Line 85: | Line 85: | ||
| '''Jasperforest'''||BLOCK|| ||BLOCK||bgcolor="green" |GOOD|| || || | | '''Jasperforest'''||BLOCK|| ||BLOCK||bgcolor="green" |GOOD|| || || | ||
|- | |- | ||
| '''Blacksand'''||Buggy|| || || || || ||Buggy | | '''Blacksand'''||bgcolor="orange"| Buggy|| || || || || ||bgcolor="orange" | Buggy | ||
|- | |- | ||
| '''eMenlow'''||bgcolor="green" |GOOD|| || || || || ||bgcolor="green" |GOOD | | '''eMenlow'''||bgcolor="green" |GOOD|| || || || || ||bgcolor="green" |GOOD | ||
Revision as of 07:38, 3 May 2011
This page is to define Test Report Format for Yocto
Test Summary
Here is a test result summary for a build.
Test Result Matrix
A general Test Result Summary and a detailed Test Result Summary should be provided here.
Example
Test Result Summary
| Component | Target | Status | Comments |
| BSP | SugarBay | GOOD | Zypper install/remove has issue; 3D game running failed; |
| CrownBay | BLOCK | emgd crownbay build failed; matchbox-panel segfault; S3 fail on B0 board | |
| JasperForest | GOOD | The only issue is zypper install/remove bug | |
| Blacksand | Buggy | mouse/keyboard do not work in X window; zypper install/remove not work well | |
| Beagleboard | GOOD | Only one RTC issue exists | |
| Routerstationpro | GOOD | Only zypper install has issue | |
| Mpc8315e-rdb | GOOD | Only zypper install has issue | |
| QEMU | qemux86 | Buggy | Only zypper install/remove has issue |
| qemux86-64 | Buggy | Only zypper install/remove has issue | |
| qemuarm | Buggy | zypper could not work well | |
| qemuppc | Buggy | zypper could not work well | |
| qemumips | Buggy | Only zypper install has issue | |
| SDK | BLOCK | i686 toolchain not copied to sharing folder; unfs does not work with qemuppc; | |
| Poky | BUGGY | sstate and non-gplv3 build do not work correctly | |
| Stress | GOOD | Sugarbay pass 18 hours stress and Jasperforest pass 12 hours stress | |
| Compliance | GOOD | Sugarbay pass LTP and POSIX test | |
| Documentation | GOOD | ||
Detailed Test Result Summary
| Test Target | System & Core OS | SDK | Compliance | Stress | Power/Performance | Graphics | Mulitimedia |
| qemux86 | Buggy | GOOD | |||||
| qemux86-64 | Buggy | GOOD | |||||
| qemuarm | Buggy | GOOD | |||||
| qemumips | Buggy | GOOD | |||||
| qemuppc | Buggy | GOOD | |||||
| SugarBay | GOOD | bgcolor="orange"Buggy | GOOD | GOOD (May add Link to P&P result page) | GOOD | GOOD | |
| CrownBay | GOOD | GOOD | GOOD | GOOD | |||
| CrownBay noemgd | GOOD | ||||||
| FishRiver Island 2 | GOOD | Buggy | GOOD(May add Link to P&P result page) | GOOD | GOOD | ||
| HuronRiver | BLOCK | BLOCK | BLOCK | BLOCK | |||
| Jasperforest | BLOCK | BLOCK | GOOD | ||||
| Blacksand | Buggy | Buggy | |||||
| eMenlow | GOOD | GOOD | |||||
Note:
| BLOCK | Critical bugs, more than 50% test cases are blocked |
| GOOD | Only Normal, Minor or Enhancement bugs, less than 10% test cases failed |
| BUGGY | Normal, Major and Critical bugs, more than 10% test cases failed |
