MediaWiki Reporting Extension - Revision history

Corneliu Stoicescu: /* Filtering parameters */

2013-05-13T09:13:03Z

Filtering parameters

← Older revision		Revision as of 09:13, 13 May 2013
Line 208:		Line 208:

	==Filtering parameters==		==Filtering parameters==

			By adding "run_id=-1" and using the following parameters the reports can be automated:

	{\| class="wikitable sortable"		{\| class="wikitable sortable"
Line 244:		Line 246:
	\|-		\|-
	\|}		\|}


	Note: insummary_all and insummary_any accept a special value called "max". This is replaced by the date of the latest test suite after the "testplan" filter is applied. This is useful to completely automate report generation for the latest test suite performed for a specific test plan. An example can be found here: https://wiki.yoctoproject.org/wiki/index.php?title=1.3_QA_Status		Note: insummary_all and insummary_any accept a special value called "max". This is replaced by the date of the latest test suite after the "testplan" filter is applied. This is useful to completely automate report generation for the latest test suite performed for a specific test plan. An example can be found here: https://wiki.yoctoproject.org/wiki/index.php?title=1.3_QA_Status

Corneliu Stoicescu: /* Filtering parameters */

2013-05-10T16:18:49Z

Filtering parameters

← Older revision		Revision as of 16:18, 10 May 2013
Line 245:		Line 245:
	\|}		\|}

	Note: insummary_all and insummary_any accept a special value called "max". This is replaced by the date of the latest test suite after the "testplan" filter is applied.		Note: insummary_all and insummary_any accept a special value called "max". This is replaced by the date of the latest test suite after the "testplan" filter is applied. This is useful to completely automate report generation for the latest test suite performed for a specific test plan. An example can be found here: https://wiki.yoctoproject.org/wiki/index.php?title=1.3_QA_Status

Corneliu Stoicescu: /* Filtering parameters */

2013-05-10T16:16:54Z

Filtering parameters

← Older revision		Revision as of 16:16, 10 May 2013
Line 216:		Line 216:
	\|-		\|-
	\|product		\|product
	\|Accepts strings separated by comma + space ( ", " ) that filter by the Product of the test run		\|Accepts strings separated by comma + space ( ", " ) that filter by the Product of the test run. If the test run's summary has ANY of the values it will be passed further.
	\|agenda, bugs, status, concatstats		\|agenda, bugs, status, concatstats
	\|-		\|-
	\|testplan		\|testplan
	\|Accepts strings separated by comma + space ( ", " ) that filter by the Test Plan of the test run		\|Accepts strings separated by comma + space ( ", " ) that filter by the Test Plan of the test run. If the test run's summary has ANY of the values it will be passed further.
	\|agenda, bugs, status, concatstats		\|agenda, bugs, status, concatstats
	\|-		\|-
	\|environment		\|environment
	\|Accepts strings separated by comma + space ( ", " ) that filter by the Environment of the test run		\|Accepts strings separated by comma + space ( ", " ) that filter by the Environment of the test run. If the test run's summary has ANY of the values it will be passed further.
	\|agenda, bugs, status, concatstats		\|agenda, bugs, status, concatstats
	\|-		\|-
	\|build		\|build
	\|Accepts strings separated by comma + space ( ", " ) that filter by the Build of the test run		\|Accepts strings separated by comma + space ( ", " ) that filter by the Build of the test run. If the test run's summary has ANY of the values it will be passed further.
	\|agenda, bugs, status, concatstats		\|agenda, bugs, status, concatstats
	\|-		\|-
	\|environment		\|environment
	\|Accepts strings separated by comma + space ( ", " ) that filter by the Environment of the test run		\|Accepts strings separated by comma + space ( ", " ) that filter by the Environment of the test run. If the test run's summary has ANY of the values it will be passed further.
	\|agenda, bugs, status, concatstats		\|agenda, bugs, status, concatstats
	\|-		\|-
Line 244:		Line 244:
	\|-		\|-
	\|}		\|}

			Note: insummary_all and insummary_any accept a special value called "max". This is replaced by the date of the latest test suite after the "testplan" filter is applied.

Corneliu Stoicescu: /* Summary */

2013-05-10T15:58:13Z

Summary

← Older revision		Revision as of 15:58, 10 May 2013
Line 1:		Line 1:
	=Summary=		=Summary=

	This page describes the functionality and usage instructions for the Testopia ~~MediaWiki~~ reporting extension. Derived from http://www.mediawiki.org/wiki/Extension:Testopia_Reports this extension was modified in order to generate reports specific to the Yocto Project's needs. If you wish to use it on another MediaWiki server you can do so by cloning it from the public repository: https://github.com/halstead/testopiareports .		This page describes the functionality and usage instructions for the MediaWiki Testopia reporting extension. Derived from http://www.mediawiki.org/wiki/Extension:Testopia_Reports this extension was modified in order to generate reports specific to the Yocto Project's needs. If you wish to use it on another MediaWiki server you can do so by cloning it from the public repository: https://github.com/halstead/testopiareports .

	=Report types=		=Report types=

Corneliu Stoicescu: /* Report types */

2013-05-10T15:55:10Z

Report types

← Older revision		Revision as of 15:55, 10 May 2013
Line 14:		Line 14:
	Generates a list of test cases from one or more test plans.		Generates a list of test cases from one or more test plans.

	NOTE: this is the only ~~current~~ report type that supports (only) test plans. All the rest support (only) test runs.		NOTE: this is currently the only report type that supports (only) test plans. All the rest support (only) test runs.

	Here is an example:		Here is an example:

Corneliu Stoicescu: /* Other parameters */

2013-05-10T15:52:39Z

Other parameters

@@ Line 205: / Line 205: @@
 | numeric value
 | Number of decimals to that a percentage will be rounded. The default is 0.
 |}

Corneliu Stoicescu at 15:43, 10 May 2013

2013-05-10T15:43:21Z

@@ Line 5: / Line 5: @@
 =Report types=
-This is a list of reports that can be generated using the reporting extension. The parameters that you need in order to generate a raport are:
+This is a list of reports that can be generated using the reporting extension. The parameters that you need in order to generate a report are:
 # report_id = the ID of the report type (ex: testplan, bugs, status, agenda, concatstats) - does not support multiple inputs
 # plan_id = the ID of the test plan/test plans  - supports multiple inputs separated by comma + space ( ", " )
@@ Line 117: / Line 117: @@
 |report_id=concatstats
 |run_id=403, 415, 416, 417, 404, 411}}
 |}

Corneliu Stoicescu at 15:36, 10 May 2013

2013-05-10T15:36:13Z

← Older revision		Revision as of 15:36, 10 May 2013
Line 90:		Line 90:
	\| <pre>		\| <pre>
	{{#testopia:		{{#testopia:
	\|report_id=~~concatstats~~		\|report_id=agenda
	\|run_id=~~403, 415, 416, 417, 404,~~ 411}}		\|run_id=411}}
	</pre>		</pre>
	\|{{#testopia:		\|{{#testopia:
	\|report_id=~~concatstats~~		\|report_id=agenda
	\|run_id=~~403, 415, 416, 417, 404,~~ 411}}		\|run_id=411}}
	\|}		\|}

Line 103:		Line 103:
	# test runs with identical Test Plans and Environments are merged together and the % is calculated based on the total number of test cases. The test run links are aggregated in the Test Run field.		# test runs with identical Test Plans and Environments are merged together and the % is calculated based on the total number of test cases. The test run links are aggregated in the Test Run field.
	# when calculating the % only PASSED/BLOCKED/FAILED test cases are taken into account. This means that all other states are ignored(IDLE, PAUSED, RUNNING, ERROR, etc.). This is done because at the moment we use this report only for finished test suites. This may be changed in the future.		# when calculating the % only PASSED/BLOCKED/FAILED test cases are taken into account. This means that all other states are ignored(IDLE, PAUSED, RUNNING, ERROR, etc.). This is done because at the moment we use this report only for finished test suites. This may be changed in the future.

			{\| class="wikitable"
			\|-
			\|Code
			\|Output
			\|-
			\| <pre>
			{{#testopia:
			\|report_id=concatstats
			\|run_id=403, 415, 416, 417, 404, 411}}
			</pre>
			\|{{#testopia:
			\|report_id=concatstats
			\|run_id=403, 415, 416, 417, 404, 411}}
			\|}

Corneliu Stoicescu: /* ConcatStats */

2013-05-10T15:35:19Z

ConcatStats

← Older revision		Revision as of 15:35, 10 May 2013
Line 102:		Line 102:
	Generates a one-test_run-per-line report. There are a few things to note about how this report works:		Generates a one-test_run-per-line report. There are a few things to note about how this report works:
	# test runs with identical Test Plans and Environments are merged together and the % is calculated based on the total number of test cases. The test run links are aggregated in the Test Run field.		# test runs with identical Test Plans and Environments are merged together and the % is calculated based on the total number of test cases. The test run links are aggregated in the Test Run field.
	# when calculating the % only PASSED/BLOCKED/FAILED test cases are taken into account. This means that all other states are ignored(IDLE, PAUSED, RUNNING, ERROR, etc.)		# when calculating the % only PASSED/BLOCKED/FAILED test cases are taken into account. This means that all other states are ignored(IDLE, PAUSED, RUNNING, ERROR, etc.). This is done because at the moment we use this report only for finished test suites. This may be changed in the future.

Corneliu Stoicescu at 15:34, 10 May 2013

2013-05-10T15:34:18Z

← Older revision		Revision as of 15:34, 10 May 2013
Line 90:		Line 90:
	\| <pre>		\| <pre>
	{{#testopia:		{{#testopia:
	\|report_id=~~agenda~~		\|report_id=concatstats
	\|run_id=403, 415, 416, 417, 404, 411}}		\|run_id=403, 415, 416, 417, 404, 411}}
	</pre>		</pre>
	\|{{#testopia:		\|{{#testopia:
	\|report_id=~~agenda~~		\|report_id=concatstats
	\|run_id=403, 415, 416, 417, 404, 411}}		\|run_id=403, 415, 416, 417, 404, 411}}
	\|}		\|}