We would like to also have tests distinguished by labels, not only by folders for specific components. We can also run the tests only with specific label(s).
See: https://onsi.github.io/ginkgo/#spec-labels
- component
- test type
- category
| Component Labels | Description |
|---|
| build | Build related tests |
| e2e-demos | e2e-demos related tests |
| pipeline | Pipeline Service related tests |
| Test Types Labels | Description |
|---|
| slow | Slow tests (See --slow-spec-threshold (https://onsi.github.io/ginkgo/#other-settings)) |
| e2e-demos | e2e demos tests |
| load | Load tests |
| performance | Performance related tests |
| smoke | Critical functionality tests |
| serial | Tests which can’t be run in parallel |
| security | Security related tests |
| Test Types Labels | Description |
|---|
| flaky | Flaky tests (all tests are stable unless marked flaky) |
| Test Types Labels | Description |
|---|
| customer-feedback | Test created upon feedback from any customer channel (customer issue, telemetry data, …) |
| demo | Tests related to milestone demos |