Tests may specify attributes via the
Attr field in testing.Test. Attributes are free-form strings, but this document enumerates well-known attributes with established meanings.
The following attributes may be added to control how tests are run and how their results are interpreted.
Zero or more
group:* attributes can be set to a test to assign it to groups. A group is a collection of tests having similar purposes or characteristics, often (but not necessarily) scheduled together. In automated testing, tests to run are usually selected by groups. This means that a test will not run in automated testing if it belongs to no group.
Some groups define extra attributes which annotate tests with extra information. They can be set if a test belongs to corresponding groups.
Below is the list of most popular groups and their associated extra attributes:
group:mainline- The default group for functional tests. Tests having this attribute are called mainline tests. A mainline test falls under exactly one of the two categories: informational if it has
informationalattribute; otherwise it is critical. Failures in critical tests justify rejecting or reverting the responsible change, while failures in informational tests are ignored. All informational mainline tests are supposed to be promoted to critical tests.
group:crosbolt- Test failures are ignored and the test's performance data are uploaded to crosbolt. When you add this attribute, you also need to add one of
group:wificell- Tests that depends on wificell fixture to run. Its sub-attributes can be classified into two types:
wificell_func: verify basic WiFi functionalities nightly.
wificell_cq: Similar to wificell_func, but triggered by CLs that touch specific code paths.
wificell_perf: measure WiFi performance.
wificell_stress: Stress test the WiFi functionalities.
wificell_unstableis present, the test is yet to be verified as stable; otherwise, the test is stable.
group:wificell_roam- Tests that depends on grover (Googlers only) fixture to run. Subattributes that specify role of the test (required):
wificell_roam_func: verify basic WiFi roaming functionalities.
wificell_roam_perf: measure WiFi roaming performance.
group:labqual- Tests that must pass for devices to go to a low-touch lab.
See attr.go for the full list of valid attributes.
Several attributes are also added automatically:
bundle:<bundle>- Test's bundle, e.g.
dep:<dependency>- Test software dependency (automatically added).
name:<category.Test>- Test's full name (automatically added).
See the Running Tests document for information about using attributes to select which tests to run.