Tinfoil Test Plan: Difference between revisions
| (20 intermediate revisions by the same user not shown) | |||
| Line 7: | Line 7: | ||
= Objectives = | = Objectives = | ||
= | Verify the functionality of Tinfoil API | ||
= Contacts = | |||
[mailto:jose.perez.carranza@intel.com Jose, Perez Carranza] | [mailto:jose.perez.carranza@intel.com Jose, Perez Carranza] | ||
| Line 13: | Line 15: | ||
= Scope = | = Scope = | ||
Test Cases will be designed to verify the different functionality of the API, all test cases should be designed to be executed in automated way. | |||
- The first stage of test is a set of basic test listed on [[#Features already tested | Features already tested]] | |||
- The subsequent improvements to the Test Suite should be listed on [[#Features to be tested | Features to be tested]] | |||
= Test Strategy = | = Test Strategy = | ||
<TBD> | |||
== Test Automation == | == Test Automation == | ||
All the test should be automated and executed under [[oe-selftest]] suite | |||
== Test Approach == | == Test Approach == | ||
Design of test are intended to cover the functionality of Tinfoil API, all the test will be executed every milestone on GDC AB and frequently on [https://autobuilder.yoctoproject.org main AB] | |||
== Test Cases Maintenance == | == Test Cases Maintenance == | ||
= | Test cases are located | ||
poky/meta/lib/oeqa/selftest/tinfoil.py | |||
- To create a new test case a Testopia instance should be created on [https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=25 OE-CORE] under "Test Cases" the number given by Testopia should be added prior to the test case name as below: | |||
@testcase(<TESTOPIA_ID>) | |||
def TEST_CASE_NAME(self): | |||
- To send the patches of created or modified test cases rules defined [http://www.openembedded.org/wiki/How_to_submit_a_patch_to_OpenEmbedded here] should be followed. | |||
=Features= | =Features= | ||
| Line 44: | Line 61: | ||
- [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1572 test_parse_recipe_copy_expand] | - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1572 test_parse_recipe_copy_expand] | ||
- [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1573 test_parse_recipe_initial_datastore] | - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1573 test_parse_recipe_initial_datastore] | ||
- test_list_recipes | - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1574 test_list_recipes] | ||
- test_wait_event | - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1575 test_wait_event] | ||
- test_setvariable_clean | - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1576 test_setvariable_clean] | ||
==Features to be tested== | ==Features to be tested== | ||
* parseRecipes | |||
* get_overlayed_recipes | |||
* get_skipped_recipes | |||
* get_all_providers | |||
* find_providers | |||
* get_runtime_providers | |||
* get_recipe_file | |||
* get_file_appends | |||
* build_file | |||
* parseCommandLine | |||
Latest revision as of 19:44, 12 January 2017
This article is the test plan for Tinfoil.
About Tinfoil
Tinfoil is an API that allows you to write simple utilities that call into bitbake code to read variables, parse recipes, etc
Objectives
Verify the functionality of Tinfoil API
Contacts
Scope
Test Cases will be designed to verify the different functionality of the API, all test cases should be designed to be executed in automated way.
- The first stage of test is a set of basic test listed on Features already tested
- The subsequent improvements to the Test Suite should be listed on Features to be tested
Test Strategy
<TBD>
Test Automation
All the test should be automated and executed under oe-selftest suite
Test Approach
Design of test are intended to cover the functionality of Tinfoil API, all the test will be executed every milestone on GDC AB and frequently on main AB
Test Cases Maintenance
Test cases are located
poky/meta/lib/oeqa/selftest/tinfoil.py
- To create a new test case a Testopia instance should be created on OE-CORE under "Test Cases" the number given by Testopia should be added prior to the test case name as below:
@testcase(<TESTOPIA_ID>) def TEST_CASE_NAME(self):
- To send the patches of created or modified test cases rules defined here should be followed.
Features
Test are under poky/meta/lib/oeqa/selftest/tunfoil.py
Features already tested
- test_getvar - test_expand - test_getvar_bb_origenv - test_parse_recipe - test_parse_recipe_copy_expand - test_parse_recipe_initial_datastore - test_list_recipes - test_wait_event - test_setvariable_clean
Features to be tested
- parseRecipes
- get_overlayed_recipes
- get_skipped_recipes
- get_all_providers
- find_providers
- get_runtime_providers
- get_recipe_file
- get_file_appends
- build_file
- parseCommandLine
