Tinfoil Test Plan: Difference between revisions

From Yocto Project
Jump to navigationJump to search
 
(20 intermediate revisions by the same user not shown)
Line 7: Line 7:
= Objectives =
= Objectives =


= Team members =
Verify the functionality of Tinfoil API
 
= Contacts =
[mailto:jose.perez.carranza@intel.com  Jose, Perez Carranza]
[mailto:jose.perez.carranza@intel.com  Jose, Perez Carranza]


Line 13: Line 15:


= Scope =
= Scope =
Test Cases will be designed to verify the different functionality of the API, all test cases should be designed to be executed in automated way.
- The first stage of test is a set of basic test listed on [[#Features already tested | Features already tested]]
- The subsequent improvements to the Test Suite should be listed on [[#Features to be tested | Features to be tested]]


= Test Strategy =
= Test Strategy =


<TBD>


== Test Automation ==
== Test Automation ==
All the test should be automated and executed under [[oe-selftest]] suite


== Test Approach ==
== Test Approach ==


Design of test are intended to cover the functionality of Tinfoil API, all the test will be executed every milestone on GDC AB and frequently on [https://autobuilder.yoctoproject.org main AB]


== Test Cases Maintenance ==
== Test Cases Maintenance ==


=Requirements=
Test cases are located
 
poky/meta/lib/oeqa/selftest/tinfoil.py
 
- To create a new test case a Testopia instance should be created on [https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=25 OE-CORE] under "Test Cases" the number given by Testopia should be added prior to the test case name as below:


==HW Requirements==
@testcase(<TESTOPIA_ID>)
def TEST_CASE_NAME(self):


==Software Requirements==
- To send the patches of created or modified test cases rules defined [http://www.openembedded.org/wiki/How_to_submit_a_patch_to_OpenEmbedded here] should be followed.


=Features=
=Features=
Line 44: Line 61:
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1572 test_parse_recipe_copy_expand]
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1572 test_parse_recipe_copy_expand]
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1573 test_parse_recipe_initial_datastore]
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1573 test_parse_recipe_initial_datastore]
  - test_list_recipes
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1574 test_list_recipes]
  - test_wait_event
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1575 test_wait_event]
  - test_setvariable_clean
  - [https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=1576 test_setvariable_clean]


==Features to be tested==
==Features to be tested==
* parseRecipes
* get_overlayed_recipes
* get_skipped_recipes
* get_all_providers
* find_providers
* get_runtime_providers
* get_recipe_file
* get_file_appends
* build_file
* parseCommandLine

Latest revision as of 19:44, 12 January 2017

This article is the test plan for Tinfoil.

About Tinfoil

Tinfoil is an API that allows you to write simple utilities that call into bitbake code to read variables, parse recipes, etc

Objectives

Verify the functionality of Tinfoil API

Contacts

Jose, Perez Carranza

Paul, Eggleton

Scope

Test Cases will be designed to verify the different functionality of the API, all test cases should be designed to be executed in automated way.

- The first stage of test is a set of basic test listed on Features already tested

- The subsequent improvements to the Test Suite should be listed on Features to be tested

Test Strategy

<TBD>

Test Automation

All the test should be automated and executed under oe-selftest suite

Test Approach

Design of test are intended to cover the functionality of Tinfoil API, all the test will be executed every milestone on GDC AB and frequently on main AB

Test Cases Maintenance

Test cases are located

poky/meta/lib/oeqa/selftest/tinfoil.py

- To create a new test case a Testopia instance should be created on OE-CORE under "Test Cases" the number given by Testopia should be added prior to the test case name as below:

@testcase(<TESTOPIA_ID>)
def TEST_CASE_NAME(self):

- To send the patches of created or modified test cases rules defined here should be followed.

Features

Test are under poky/meta/lib/oeqa/selftest/tunfoil.py

Features already tested

- test_getvar
- test_expand
- test_getvar_bb_origenv
- test_parse_recipe
- test_parse_recipe_copy_expand
- test_parse_recipe_initial_datastore
- test_list_recipes
- test_wait_event
- test_setvariable_clean

Features to be tested

  • parseRecipes
  • get_overlayed_recipes
  • get_skipped_recipes
  • get_all_providers
  • find_providers
  • get_runtime_providers
  • get_recipe_file
  • get_file_appends
  • build_file
  • parseCommandLine