LAVA server vs Yocto HW automation testing - Revision history

Alexandru.c.georgescu at 13:16, 12 September 2014

2014-09-12T13:16:07Z

← Older revision		Revision as of 13:16, 12 September 2014
Line 8:		Line 8:
	\|-		\|-
	\| Controlling a board via serial connection		\| Controlling a board via serial connection
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\|		\|
	\|-		\|-
	\| Booting a board via serial connection and bootloader using Yocto images artifacts		\| Booting a board via serial connection and bootloader using Yocto images artifacts
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\|		\|
	\|-		\|-
	\| Able to schedule a test jobs to run at certain time		\| Able to schedule a test jobs to run at certain time
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| "Cron can be used in addition with lava CLI commands to trigger a test job"		\| "Cron can be used in addition with lava CLI commands to trigger a test job"
	\|-		\|-
	\| Able to perform a full automated test cycle for a non serial connection board		\| Able to perform a full automated test cycle for a non serial connection board
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| "There is an issue with the test job which is exiting right after the master image ‘reboot’ command in order to boot into the test image as the master image ssh connection is lost and cannot run the next configu#FF6347 steps from the test job.Opened an enhancement for this at linaro but they told me that this feature will not be implemented for the dummy-ssh devices (https://bugs.linaro.org/show_bug.cgi?id=478)"		\| "There is an issue with the test job which is exiting right after the master image ‘reboot’ command in order to boot into the test image as the master image ssh connection is lost and cannot run the next configu#FF6347 steps from the test job.Opened an enhancement for this at linaro but they told me that this feature will not be implemented for the dummy-ssh devices (https://bugs.linaro.org/show_bug.cgi?id=478)"
	\|-		\|-
	\| Able to view the test jobs results as tables		\| Able to view the test jobs results as tables
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\|		\|
	\|-		\|-
	\| Able to view the test jobs results as graphical reports		\| Able to view the test jobs results as graphical reports
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\|		\|
	\|-		\|-
	\| Able to query old test jobs results		\| Able to query old test jobs results
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\|		\|
	\|-		\|-
	\| Can use existing connection scripts for the tested boards		\| Can use existing connection scripts for the tested boards
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\|		\|
	\|-		\|-
	\| Does not require additional packages for master image		\| Does not require additional packages for master image
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| Aditional packages needs for master image for ssh - sshfs connection		\| Aditional packages needs for master image for ssh - sshfs connection
	\|-		\|-
	\| Can use existing test definitions		\| Can use existing test definitions
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| Runtime tests definitions needs to be manually added		\| Runtime tests definitions needs to be manually added
	\|-		\|-
	\| Can use existing test jobs		\| Can use existing test jobs
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| Tests jobs needs to be manually created		\| Tests jobs needs to be manually created
	\|-		\|-
	\| Web based interface support		\| Web based interface support
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\|		\|
	\|-		\|-
	\| Can accept test results from external sources		\| Can accept test results from external sources
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| There is no way to submit results from the tested bsp to the Lava server		\| There is no way to submit results from the tested bsp to the Lava server
	\|-		\|-
	\| Authentication user support for the web based interface		\| Authentication user support for the web based interface
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\|		\|
	\|-		\|-
	\| Able to use Yocto images artifacts		\| Able to use Yocto images artifacts
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\|		\|
	\|-		\|-
	\| Can use the existing master image configurations		\| Can use the existing master image configurations
	\| style=" background-color: #FF6347;" \| N		\| style=" background-color: #FF6347; text-align:center;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime; text-align:center;" \| Y
	\| "We need to generate a pair of authentication keys between lava server and the master image – password less authentication from lava-server to the master image – root is requi#FF6347;Master image and test image must have the .ssh/authorized_keys configu#FF6347."		\| "We need to generate a pair of authentication keys between lava server and the master image – password less authentication from lava-server to the master image – root is requi#FF6347;Master image and test image must have the .ssh/authorized_keys configu#FF6347."
	\|}		\|}

Alexandru.c.georgescu at 13:14, 12 September 2014

2014-09-12T13:14:43Z

← Older revision		Revision as of 13:14, 12 September 2014
Line 2:		Line 2:
	\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| '''Lava server vs Yocto hardware automation testing'''		\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| '''Lava server vs Yocto hardware automation testing'''
	\|-		\|-
	\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''		\| style="background-color: #ffffcc; text-align:center; width: 40%" \| '''Tested steps'''
	\| style="background-color: #ffffcc;" \| '''Lava'''		\| style="background-color: #ffffcc; text-align:center;" \| '''Lava'''
	\| style="background-color: #ffffcc;" \| '''Yocto'''		\| style="background-color: #ffffcc; text-align:center;" \| '''Yocto'''
	\| style="background-color: #ffffcc;" \| '''Comments'''		\| style="background-color: #ffffcc; text-align:center;" \| '''Comments'''
	\|-		\|-
	\| Controlling a board via serial connection		\| Controlling a board via serial connection

Alexandru.c.georgescu at 13:12, 12 September 2014

2014-09-12T13:12:59Z

← Older revision		Revision as of 13:12, 12 September 2014
Line 1:		Line 1:
	{\| class="wikitable"		{\| class="wikitable"
	\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| '''Lava server vs Yocto hardware automation'''		\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| '''Lava server vs Yocto hardware automation testing'''
	\|-		\|-
	\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''		\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''
	\| style="background-color: #ffffcc; ~~width: 9%~~" \| '''Lava ~~server~~'''		\| style="background-color: #ffffcc;" \| '''Lava'''
	\| style="background-color: #ffffcc; ~~width: 10%~~" \| '''Yocto ~~hardware automation~~'''		\| style="background-color: #ffffcc;" \| '''Yocto'''
	\| style="background-color: #ffffcc;" \| '''Comments'''		\| style="background-color: #ffffcc;" \| '''Comments'''
	\|-		\|-
	\| Controlling a board via serial connection		\| Controlling a board via serial connection

Alexandru.c.georgescu at 12:43, 12 September 2014

2014-09-12T12:43:44Z

← Older revision		Revision as of 12:43, 12 September 2014
Line 1:		Line 1:
	{\| class="wikitable"		{\| class="wikitable"
	\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| Lava server vs Yocto hardware automation		\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| '''Lava server vs Yocto hardware automation'''
	\|-		\|-
	\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''		\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''
	\| style="background-color: #ffffcc;" \| '''Lava server'''		\| style="background-color: #ffffcc; width: 9%" \| '''Lava server'''
	\| style="background-color: #ffffcc;" \| '''Yocto hardware automation'''		\| style="background-color: #ffffcc; width: 10%" \| '''Yocto hardware automation'''
	\| style="background-color: #ffffcc;" \| '''Comments'''		\| style="background-color: #ffffcc;" \| '''Comments'''
	\|-		\|-

Alexandru.c.georgescu at 12:42, 12 September 2014

2014-09-12T12:42:20Z

← Older revision		Revision as of 12:42, 12 September 2014
Line 2:		Line 2:
	\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| Lava server vs Yocto hardware automation		\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| Lava server vs Yocto hardware automation
	\|-		\|-
	\| style="background-color: #ffffcc; width: 40%" \| Tested steps		\| style="background-color: #ffffcc; width: 40%" \| '''Tested steps'''
	\| style="background-color: #ffffcc;" \| Lava server		\| style="background-color: #ffffcc;" \| '''Lava server'''
	\| style="background-color: #ffffcc;" \| Yocto hardware automation		\| style="background-color: #ffffcc;" \| '''Yocto hardware automation'''
	\| style="background-color: #ffffcc;" \| Comments		\| style="background-color: #ffffcc;" \| '''Comments'''
	\|-		\|-
	\| Controlling a board via serial connection		\| Controlling a board via serial connection

Alexandru.c.georgescu at 12:40, 12 September 2014

2014-09-12T12:40:59Z

Alexandru.c.georgescu at 12:38, 12 September 2014

2014-09-12T12:38:17Z

← Older revision		Revision as of 12:38, 12 September 2014
Line 1:		Line 1:
	{\| class="wikitable"		{\| class="wikitable"
	! colspan="4" \| Lava server vs Yocto hardware automation		\| style="background-color: #87CEEB; text-align:center;" ! colspan="4" \| Lava server vs Yocto hardware automation
	\|-		\|-
	\| Tested steps		\| style="background-color: #ffffcc; width: 40%" \| Tested steps
	\| Lava server		\| style="background-color: #ffffcc;" \| Lava server
	\| Yocto hardware automation		\| style="background-color: #ffffcc;" \| Yocto hardware automation
	\| Comments		\| style="background-color: #ffffcc;" \| Comments
	\|-		\|-
	\| Controlling a board via serial connection		\| Controlling a board via serial connection

Alexandru.c.georgescu: Created page with "{| class="wikitable" ! colspan="4" | Lava server vs Yocto hardware automation |- | Tested steps | Lava server | Yocto hardware automation | Comments |- | Controlling a board via ..."

2014-09-12T12:26:21Z

Created page with "{| class="wikitable" ! colspan="4" | Lava server vs Yocto hardware automation |- | Tested steps | Lava server | Yocto hardware automation | Comments |- | Controlling a board via ..."

New page

{| class="wikitable"
! colspan="4" | Lava server vs Yocto hardware automation
|-
| Tested steps
| Lava server
| Yocto hardware automation
| Comments
|-
| Controlling a board via serial connection
| style=" background-color: lime;" | Y
| style=" background-color: lime;" | Y
|
|-
| Booting a board via serial connection and bootloader using Yocto images artifacts
| style=" background-color: lime;" | Y
| style=" background-color: lime;" | Y
|
|-
| Able to schedule a test jobs to run at certain time
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| "Cron can be used in addition with lava CLI commands to trigger a test job"
|-
| Able to perform a full automated test cycle for a non serial connection board
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| "There is an issue with the test job which is exiting right after the master image ‘reboot’ command in order to boot into the test image as the master image ssh connection is lost and cannot run the next configured steps from the test job.Opened an enhancement for this at linaro but they told me that this feature will not be implemented for the dummy-ssh devices (https://bugs.linaro.org/show_bug.cgi?id=478)"
|-
| Able to view the test jobs results as tables
| style=" background-color: lime;" | Y
| style=" background-color: red;" | N
|
|-
| Able to view the test jobs results as graphical reports
| style=" background-color: lime;" | Y
| style=" background-color: red;" | N
|
|-
| Able to query old test jobs results
| style=" background-color: lime;" | Y
| style=" background-color: red;" | N
|
|-
| Can use existing connection scripts for the tested boards
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
|
|-
| Does not require additional packages for master image
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| Aditional packages needs for master image for ssh - sshfs connection
|-
| Can use existing test definitions
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| Runtime tests definitions needs to be manually added
|-
| Can use existing test jobs
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| Tests jobs needs to be manually created
|-
| Web based interface support
| style=" background-color: lime;" | Y
| style=" background-color: red;" | N
|
|-
| Can accept test results from external sources
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| There is no way to submit results from the tested bsp to the Lava server
|-
| Authentication user support for the web based interface
| style=" background-color: lime;" | Y
| style=" background-color: red;" | N
|
|-
| Able to use Yocto images artifacts
| style=" background-color: lime;" | Y
| style=" background-color: lime;" | Y
|
|-
| Can use the existing master image configurations
| style=" background-color: red;" | N
| style=" background-color: lime;" | Y
| "We need to generate a pair of authentication keys between lava server and the master image – password less authentication from lava-server to the master image – root is required;Master image and test image must have the .ssh/authorized_keys configured."
|}

← Older revision		Revision as of 12:40, 12 September 2014
Line 18:		Line 18:
	\|-		\|-
	\| Able to schedule a test jobs to run at certain time		\| Able to schedule a test jobs to run at certain time
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| "Cron can be used in addition with lava CLI commands to trigger a test job"		\| "Cron can be used in addition with lava CLI commands to trigger a test job"
	\|-		\|-
	\| Able to perform a full automated test cycle for a non serial connection board		\| Able to perform a full automated test cycle for a non serial connection board
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| "There is an issue with the test job which is exiting right after the master image ‘reboot’ command in order to boot into the test image as the master image ssh connection is lost and cannot run the next ~~configured~~ steps from the test job.Opened an enhancement for this at linaro but they told me that this feature will not be implemented for the dummy-ssh devices (https://bugs.linaro.org/show_bug.cgi?id=478)"		\| "There is an issue with the test job which is exiting right after the master image ‘reboot’ command in order to boot into the test image as the master image ssh connection is lost and cannot run the next configu#FF6347 steps from the test job.Opened an enhancement for this at linaro but they told me that this feature will not be implemented for the dummy-ssh devices (https://bugs.linaro.org/show_bug.cgi?id=478)"
	\|-		\|-
	\| Able to view the test jobs results as tables		\| Able to view the test jobs results as tables
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\|		\|
	\|-		\|-
	\| Able to view the test jobs results as graphical reports		\| Able to view the test jobs results as graphical reports
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\|		\|
	\|-		\|-
	\| Able to query old test jobs results		\| Able to query old test jobs results
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\|		\|
	\|-		\|-
	\| Can use existing connection scripts for the tested boards		\| Can use existing connection scripts for the tested boards
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\|		\|
	\|-		\|-
	\| Does not require additional packages for master image		\| Does not require additional packages for master image
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| Aditional packages needs for master image for ssh - sshfs connection		\| Aditional packages needs for master image for ssh - sshfs connection
	\|-		\|-
	\| Can use existing test definitions		\| Can use existing test definitions
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| Runtime tests definitions needs to be manually added		\| Runtime tests definitions needs to be manually added
	\|-		\|-
	\| Can use existing test jobs		\| Can use existing test jobs
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| Tests jobs needs to be manually created		\| Tests jobs needs to be manually created
Line 64:		Line 64:
	\| Web based interface support		\| Web based interface support
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\|		\|
	\|-		\|-
	\| Can accept test results from external sources		\| Can accept test results from external sources
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| There is no way to submit results from the tested bsp to the Lava server		\| There is no way to submit results from the tested bsp to the Lava server
Line 74:		Line 74:
	\| Authentication user support for the web based interface		\| Authentication user support for the web based interface
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\|		\|
	\|-		\|-
Line 83:		Line 83:
	\|-		\|-
	\| Can use the existing master image configurations		\| Can use the existing master image configurations
	\| style=" background-color: ~~red~~;" \| N		\| style=" background-color: #FF6347;" \| N
	\| style=" background-color: lime;" \| Y		\| style=" background-color: lime;" \| Y
	\| "We need to generate a pair of authentication keys between lava server and the master image – password less authentication from lava-server to the master image – root is ~~required~~;Master image and test image must have the .ssh/authorized_keys ~~configured~~."		\| "We need to generate a pair of authentication keys between lava server and the master image – password less authentication from lava-server to the master image – root is requi#FF6347;Master image and test image must have the .ssh/authorized_keys configu#FF6347."
	\|}		\|}