Resulttool: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 19: Line 19:


=== manualexecution --help ===
=== manualexecution --help ===
usage: resulttool manualexecution [-h] file
helper script for results populating during manual test execution. You can
helper script for results populating during manual test execution. You can
find manual test case JSON file in meta/lib/oeqa/manual/
find manual test case JSON file in meta/lib/oeqa/manual/

Revision as of 08:36, 6 March 2019

Summary

The resulttool is command line tool available inside poky/scripts, it was developed to manage test result files for both automated tests (eg. oeqa/runtime, selftest, sdk, etc) and manual tests (eg. oeqa/manual). It was developed as an alternative tool to replace test result storage and reporting using Testopia and Wiki Page.

To view the features available for resulttool, start with poky repository, source poky environment, type "resulttool --help".

List of features

The resulttool provide plugin to:

- "manualexecution": helper script for results populating during manual test execution
- "merge": merge test result files/directories
- "store": store test results into a git repository
- "regression": regression file/directory analysis
- "regression-git": regression git analysis
- "report": summarise test results

manualexecution

The manualexecution was developed to provide command line interface to execute manual tests inside oeqa/manual and it will create testresults.json file that contain the configurations and status of the testing.

manualexecution --help

helper script for results populating during manual test execution. You can find manual test case JSON file in meta/lib/oeqa/manual/

arguments:

 file        specify path to manual test case JSON file.Note: Please use ""
             to encapsulate the file path.

merge

store

store testresults.json and other artifacts to git repository

regression

regression-git

report