Examples

• Testing only mature specs
• Testing specific specs, regardless of their maturity level
• Testing mature specs and additionally enabling specific specs
• Testing mature specs, while disabling specific specs
• Testing specific spec (trustless gateway), while disabling a sub-part of it
• Skip a specific test
• Extracting the test fixtures
• Extracting the test fixtures into a single CAR file

Testing only mature specs

By default, all mature tests are run. Mature tests generally refer to specifications whose status is mature.

gateway-conformance test

Testing specific specs, regardless of their maturity level

gateway-conformance test --specs subdomain-gateway,path-gateway

Testing mature specs and additionally enabling specific specs

gateway-conformance test --specs +subdomain-gateway

Testing mature specs, while disabling specific specs

gateway-conformance test --specs -subdomain-gateway,-dnslink-gateway

Testing specific spec (trustless gateway), while disabling a sub-part of it

gateway-conformance test --specs trustless-gateway,-trustless-gateway-ipns

Skip a specific test

Tests are skipped using Go's standard syntax:

gateway-conformance test -- -skip 'TestGatewayCar/GET_response_for_application/vnd.ipld.car/Header_Content-Length'

It supports regex, allowing for skipping specific group or individual test case:

gateway-conformance test -- -skip 'TestGatewayCar/*'

./gateway-conformance test --verbose -- -skip '.*/.*TODO.*'

Run only a specific test

Same syntax as for skipping:

gateway-conformance test -- -run 'TestGatewayCar/*'

./gateway-conformance test --verbose -- -run '.*/.*TODO.*'

Extracting the test fixtures

gateway-conformance extract-fixtures

Extracting the test fixtures into a single CAR file

gateway-conformance extract-fixtures --merged true