Running tests

One can run test by entering to 'community-operators' project directory and run with following command with these options. '' and '' options are optional

cd <community-operators>
bash <(curl -sL https://cutt.ly/WhkV76k) \
<test-type1,test-type2,...,test-typeN> \
<operator-version-dir-relative-to-community-operators-project> \
[<git repo>] [<git branch>]

Test type

List of tests are shown in following table :

Test type	Description
kiwi	Full operator test
lemon	Full test of operator to be deployed from scratch
orange	Full test of operator to be deployed with existing bundles in quay registry
all	kiwi,lemon,orange

Logs

Logs can be found in /tmp/op-test/log.out

Testing log files

If operator test fails, one can enter to testing container via follwing command. One can substitue 'docker' with 'podman' when supported

docker exec -it op-test /bin/bash

Examples

Running tests from local direcotry

Following example will run 'all' tests on 'aqua' operator with version '1.0.2' from 'upstream-community-operators (k8s)' directory. 'community-operators' project will be taken from local directory one is running command from ($PWD).

cd <community-operators>
bash <(curl -sL https://cutt.ly/WhkV76k) \
all \
upstream-community-operators/aqua/1.0.2

Running tests from official 'community-operators' repo

Following example will run 'kiwi' and 'lemon' tests on 'aqua' operator with version '1.0.2' from 'community-operators (Openshift)' directory. 'community-operators' project will be taken from git repo 'https://github.com/operator-framework/community-operators' and 'master' branch

cd <community-operators>
bash <(curl -sL https://cutt.ly/WhkV76k) \
kiwi,lemon \
community-operators/aqua/1.0.2 \
https://github.com/operator-framework/community-operators \
master

Running tests from forked 'community-operators' repo ans specific branch

Following example will run 'kiwi' and 'lemon' tests on 'kong' operator with version '0.5.0' from 'upstream-community-operators (k8s)' directory.'community-operators' project will be taken from git repo 'https://github.com/Kong/community-operators' and 'release/v0.5.0' branch ('https://github.com/Kong/community-operators/tree/release/v0.5.0')

cd <community-operators>
bash <(curl -sL https://cutt.ly/WhkV76k) \
kiwi,lemon \
upstream-community-operators/kong/0.5.0 \
https://github.com/Kong/community-operators \
release/v0.5.0

Misc

Name	Description	Default
OP_TEST_DEBUG	Debug level (0-3)	0
OP_TEST_CONTAINER_TOOL	Container tool used on host	docker
OP_TEST_DRY_RUN	Will print commands to be executed	0

Testing operators by Ansible

Documentation for testing is located here