z-schema - test summary

November 30, 2020 · View on GitHub

`z-schema` failed tests

Some validators have deliberately chosen not to support parts of the spec. Go to the z-schema homepage to learn if that is the case for these tests.

test failed	reason
`allOf with boolean schemas, all true, any value is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`allOf with boolean schemas, some false, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`allOf with boolean schemas, all false, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`anyOf with boolean schemas, all true, any value is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`anyOf with boolean schemas, some true, any value is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`anyOf with boolean schemas, all false, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`boolean schema 'true', number is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', string is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', boolean true is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', boolean false is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', null is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', object is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', empty object is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', array is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'true', empty array is valid`	Expected result: `true` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`. This excludes this validator from performance tests
`boolean schema 'false', number is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', string is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', boolean true is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', boolean false is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', null is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', object is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', empty object is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', array is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`boolean schema 'false', empty array is invalid`	Expected result: `false` but validator returned: `"Invalid .validate call - schema must be an string or object but boolean was passed!"`
`const validation, another value is invalid`	Expected result: `false` but validator returned: `true`
`const validation, another type is invalid`	Expected result: `false` but validator returned: `true`
`const with object, another object is invalid`	Expected result: `false` but validator returned: `true`
`const with object, another type is invalid`	Expected result: `false` but validator returned: `true`
`const with array, another array item is invalid`	Expected result: `false` but validator returned: `true`
`const with array, array with additional items is invalid`	Expected result: `false` but validator returned: `true`
`const with null, not null is invalid`	Expected result: `false` but validator returned: `true`
`const with false does not match 0, integer zero is invalid`	Expected result: `false` but validator returned: `true`
`const with false does not match 0, float zero is invalid`	Expected result: `false` but validator returned: `true`
`const with true does not match 1, integer one is invalid`	Expected result: `false` but validator returned: `true`
`const with true does not match 1, float one is invalid`	Expected result: `false` but validator returned: `true`
`const with [false] does not match [0], [0] is invalid`	Expected result: `false` but validator returned: `true`
`const with [false] does not match [0], [0.0] is invalid`	Expected result: `false` but validator returned: `true`
`const with [true] does not match [1], [1] is invalid`	Expected result: `false` but validator returned: `true`
`const with [true] does not match [1], [1.0] is invalid`	Expected result: `false` but validator returned: `true`
`const with {"a": false} does not match {"a": 0}, {"a": 0} is invalid`	Expected result: `false` but validator returned: `true`
`const with {"a": false} does not match {"a": 0}, {"a": 0.0} is invalid`	Expected result: `false` but validator returned: `true`
`const with {"a": true} does not match {"a": 1}, {"a": 1} is invalid`	Expected result: `false` but validator returned: `true`
`const with {"a": true} does not match {"a": 1}, {"a": 1.0} is invalid`	Expected result: `false` but validator returned: `true`
`const with 0 does not match other zero-like types, false is invalid`	Expected result: `false` but validator returned: `true`
`const with 0 does not match other zero-like types, empty object is invalid`	Expected result: `false` but validator returned: `true`
`const with 0 does not match other zero-like types, empty array is invalid`	Expected result: `false` but validator returned: `true`
`const with 0 does not match other zero-like types, empty string is invalid`	Expected result: `false` but validator returned: `true`
`const with 1 does not match true, true is invalid`	Expected result: `false` but validator returned: `true`
`const with -2.0 matches integer and float types, integer 2 is invalid`	Expected result: `false` but validator returned: `true`
`const with -2.0 matches integer and float types, float 2.0 is invalid`	Expected result: `false` but validator returned: `true`
`const with -2.0 matches integer and float types, float -2.00001 is invalid`	Expected result: `false` but validator returned: `true`
`float and integers are equal up to 64-bit representation limits, integer minus one is invalid`	Expected result: `false` but validator returned: `true`
`float and integers are equal up to 64-bit representation limits, float minus one is invalid`	Expected result: `false` but validator returned: `true`
`nul characters in strings, do not match string lacking nul`	Expected result: `false` but validator returned: `true`
`contains keyword validation, array without items matching schema is invalid`	Expected result: `false` but validator returned: `true`
`contains keyword validation, empty array is invalid`	Expected result: `false` but validator returned: `true`
`contains keyword with const keyword, array without item 5 is invalid`	Expected result: `false` but validator returned: `true`
`contains keyword with boolean schema true, empty array is invalid`	Expected result: `false` but validator returned: `true`
`contains keyword with boolean schema false, any non-empty array is invalid`	Expected result: `false` but validator returned: `true`
`contains keyword with boolean schema false, empty array is invalid`	Expected result: `false` but validator returned: `true`
`items + contains, matches items, does not match contains`	Expected result: `false` but validator returned: `true`
`valid definition, valid definition schema`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`dependencies with empty array, empty object`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`dependencies with empty array, object with one property`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`dependencies with empty array, non-object is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`dependencies with boolean subschemas, object with property having schema true is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`dependencies with boolean subschemas, empty object is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`exclusiveMaximum validation, below the exclusiveMaximum is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`exclusiveMaximum validation, ignores non-numbers`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`exclusiveMinimum validation, above the exclusiveMinimum is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`exclusiveMinimum validation, ignores non-numbers`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON pointers, ignores integers`	Expected result: `true` but validator returned: `false`
`validation of JSON pointers, ignores floats`	Expected result: `true` but validator returned: `false`
`validation of JSON pointers, ignores objects`	Expected result: `true` but validator returned: `false`
`validation of JSON pointers, ignores arrays`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON pointers, ignores booleans`	Expected result: `true` but validator returned: `false`
`validation of JSON pointers, ignores null`	Expected result: `true` but validator returned: `false`
`validation of URI references, ignores integers`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI references, ignores floats`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI references, ignores objects`	Expected result: `true` but validator returned: `false`
`validation of URI references, ignores arrays`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI references, ignores booleans`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI references, ignores null`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI templates, ignores integers`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI templates, ignores floats`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI templates, ignores objects`	Expected result: `true` but validator returned: `false`
`validation of URI templates, ignores arrays`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI templates, ignores booleans`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI templates, ignores null`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`items with boolean schema (true), any array is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`items with boolean schema (true), empty array is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`items with boolean schema (false), empty array is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`items with boolean schemas, array with one item is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`. This excludes this validator from performance tests
`items with boolean schemas, array with two items is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`items with boolean schemas, empty array is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`. This excludes this validator from performance tests
`not with boolean schema false, any value is valid`	Expected result: `true` but validator returned: `false`
`oneOf with boolean schemas, all true, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`oneOf with boolean schemas, one true, any value is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`oneOf with boolean schemas, more than one true, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`oneOf with boolean schemas, all false, any value is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'false'"`
`oneOf with missing optional property, first oneOf valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`oneOf with missing optional property, second oneOf valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`oneOf with missing optional property, both oneOf valid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`oneOf with missing optional property, neither oneOf valid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`all integers are multiples of 0.5, if overflow is handled, valid if optional overflow handling is implemented`	Expected result: `true` but validator returned: `false`
`validation of IPv6 addresses, zone id is not a part of ipv6 address`	Expected result: `false` but validator returned: `true`
`validation of JSON-pointers (JSON String Representation), a valid JSON-pointer`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer with empty segment`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer with the last empty segment`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #1`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #2`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #3`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #4`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #5`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #6`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #7`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #8`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #9`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #10`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #11`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #12`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer used adding to the last array position`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer (- used as object member name)`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer (multiple escaped characters)`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer (escaped with fraction part) #1`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of JSON-pointers (JSON String Representation), valid JSON-pointer (escaped with fraction part) #2`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI References, a valid URI`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI References, a valid protocol-relative URI Reference`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI References, a valid relative URI Reference`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI References, a valid URI Reference`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URI References, a valid URI fragment`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`format: uri-template, a valid uri-template`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`format: uri-template, a valid uri-template without variables`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`format: uri-template, a valid relative uri-template`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`validation of URIs, an invalid protocol-relative URI Reference`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid relative URI Reference`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid URI`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid URI though valid URI reference`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid URI with spaces`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid URI with spaces and missing scheme`	Expected result: `false` but validator returned: `true`. This excludes this validator from performance tests
`validation of URIs, an invalid URI with comma in scheme`	Expected result: `false` but validator returned: `true`
`Proper UTF-16 surrogate pair handling: pattern, matches empty`	Expected result: `true` but validator returned: `false`
`Proper UTF-16 surrogate pair handling: pattern, matches two`	Expected result: `true` but validator returned: `false`
`Proper UTF-16 surrogate pair handling: patternProperties, doesn't match two`	Expected result: `false` but validator returned: `true`
`patternProperties with boolean schemas, object with property matching schema true is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`patternProperties with boolean schemas, object with property matching schema false is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`patternProperties with boolean schemas, object with both properties is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`patternProperties with boolean schemas, object with a property matching both true and false is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`patternProperties with boolean schemas, empty object is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`properties with boolean schema, no property present is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`properties with boolean schema, only 'true' property present is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`properties with boolean schema, only 'false' property present is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`properties with boolean schema, both properties present is invalid`	Expected result: `false` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`
`propertyNames validation, some property names invalid`	Expected result: `false` but validator returned: `true`
`propertyNames with boolean schema false, object with any properties is invalid`	Expected result: `false` but validator returned: `true`
`remote ref, containing refs itself, remote ref valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`$ref to boolean schema true, any value is valid`	Expected result: `true` but validator returned: `"Cannot create property '__$validated' on boolean 'true'"`. This excludes this validator from performance tests
`Recursive references between schemas, valid tree`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`Location-independent identifier, match`	Expected result: `true` but validator returned: `false`
`Location-independent identifier with absolute URI, match`	Expected result: `true` but validator returned: `false`
`Location-independent identifier with base URI change in subschema, match`	Expected result: `true` but validator returned: `false`
`naive replacement of $ref with its destination is not correct, match the enum exactly`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`ref within remote ref, ref within ref valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`base URI change, base URI change ref valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`base URI change - change folder, number is valid`	Expected result: `true` but validator returned: `false`
`base URI change - change folder in subschema, number is valid`	Expected result: `true` but validator returned: `false`
`root ref in remote ref, string is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`root ref in remote ref, null is valid`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests
`required with empty array, property not required`	Expected result: `true` but validator returned: `false`. This excludes this validator from performance tests

All other tests passed.

back to benchmarks

z-schema failed tests

`z-schema` failed tests