Resulttool: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
Line 16: Line 16:


== manualexecution ==
== manualexecution ==
The manualexecution plugin was developed to provide command line interface to execute manual tests inside oeqa/manual and it will create testresults.json file that contain the configurations and status of the testing.  
The manualexecution plugin was developed to provide command line interface to execute manual tests inside oeqa/manual and it will create testresults.json file that contain the configurations and status of the testing (these data was required to be compatible to store, report, regression).  


=== manualexecution --help ===
=== manualexecution --help ===

Revision as of 08:42, 6 March 2019

Summary

The resulttool is command line tool available inside poky/scripts, it was developed to manage test result files for both automated tests (eg. oeqa/runtime, selftest, sdk, etc) and manual tests (eg. oeqa/manual). It was developed as an alternative tool to replace test result storage and reporting using Testopia and Wiki Page.

To view the features available for resulttool, start with poky repository, source poky environment, type "resulttool --help".

List of features

The resulttool provide plugin to:

- "manualexecution": helper script for results populating during manual test execution
- "merge": merge test result files/directories
- "store": store test results into a git repository
- "regression": regression file/directory analysis
- "regression-git": regression git analysis
- "report": summarise test results

manualexecution

The manualexecution plugin was developed to provide command line interface to execute manual tests inside oeqa/manual and it will create testresults.json file that contain the configurations and status of the testing (these data was required to be compatible to store, report, regression).

manualexecution --help

helper script for results populating during manual test execution. You can find manual test case JSON file in meta/lib/oeqa/manual/

arguments:

 file        specify path to manual test case JSON file.Note: Please use "" to encapsulate the file path.

manualexecution example

merge

The merge plugin was developed

merge --help

merge example

store

The store plugin was developed

store --help

store example

regression

The regression plugin was developed

regression --help

regression example

regression-git

The regression-git plugin was developed

regression-git --help

regression-git example

report

The report plugin was developed

report --help

report example