Revision 1 as of 2019-01-21 16:49:17
|Deletions are marked like this.||Additions are marked like this.|
|Line 4:||Line 4:|
|* Monitor power consumption and performance trends of mainline and Android kernels and catch any performance and/or power regressions||* Monitor power consumption and performance trends of Linux and Android kernels and catch any performance and/or power regressions|
Linaro's Power Management Working Group manages a board farm to boot kernels and run tests across various devices. Our main objectives include:
- Monitor power consumption and performance trends of Linux and Android kernels and catch any performance and/or power regressions
- Automate benchmarking of our team's development
- Share hardware resources with the PMWG team
The PMWG board farm can be found at https://pmwg.validation.linaro.org.
Some devices in our board farm include:
- Dragonboard 410c
- Dragonboard 820c
- Juno R2
We use these tools as a part of our testing process:
Automerge to merge developer branches into a central repository
Arm's Workload Automation framework to run workloads on Android and Linux
Arm Energy Probes and AEP command-line tool by Andy Green to collect power measurements
LAVA framework for device management and run CI jobs
LISA toolkit by Arm for post-processing data
Linaro QA reports to display test results and graph trends
CI loop setup
Our CI loop flow diagram can be found here.
Workloads, Device Configuration, and Agendas
Please make sure that you have adb working in LAVA if you are running WA Android workloads, or SSH working in LAVA if you are running WA Linux workloads.
Data post processing
We are mainly using the sched-evaluation-full script in the LISA toolkit to post-process data.
We use QA reports to display graphs and trends. QA reports uses the SQUAD tool to publish data pulled from LAVA.
LAVA job definition example
To get started, you can download this LAVA job definition and submit it on your LAVA instance. Please note that this example DOES NOT include the arm-probe, email notification, and post-processing sections that we use in our CI loops. You may need to change the device type and image links.
This example is created to get users running Workload Automation on Hikey Android in LAVA, and they can expand from there.
If you need general LAVA help (e.g. how to submit a job, how to install LAVA, tips for writing test definitions), please try one of the following suggestions:
Read the LAVA documentation. It is thoroughly written.
Email questions to the LAVA users mailing list at <lava-users AT lists DOT lavasoftware DOT org> so the LAVA team and other LAVA users can assist you, especially when everyone is in different timezones. Please attach job logs and job definition in your email if you have any. It is also very helpful to list the steps taken to reproduce your problem.
Visit the LAVA Software Community Project website.
Have a Linaro LDAP account and want to try running your first LAVA job? Visit here.
To learn how to use parameters or enable instruments in your agenda and how Workload Automation works in detail, please visit the WA document site.
If you experience issues with Workload Automation (e.g. can't run a workload, installation problems, reporting bugs), please create an issue at the Workload Automation github page.
If you need help setting up the LISA toolkit, please create an issue at the LISA toolkit github page.
WorkingGroups/PowerManagement/Resources/PMWG-Farm (last modified 2019-06-03 09:17:23)