JSV - test summary

November 30, 2020 ยท View on GitHub

JSV failed tests

Some validators have deliberately chosen not to support parts of the spec. Go to the JSV homepage to learn if that is the case for these tests.

test failedreason
additionalItems as false without items, items defaults to empty schema so everything is validExpected result: true but validator returned: false. This excludes this validator from performance tests
additionalItems should not look in applicators, valid case, items defined in allOf are not examinedExpected result: true but validator returned: false. This excludes this validator from performance tests
allOf, mismatch secondExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf, mismatch firstExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf, wrong typeExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf with base schema, validExpected result: true but validator returned: false. This excludes this validator from performance tests
allOf simple types, mismatch oneExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf with boolean schemas, some false, any value is invalidExpected result: false but validator returned: true
allOf with boolean schemas, all false, any value is invalidExpected result: false but validator returned: true
allOf with the first empty schema, string is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf with the last empty schema, string is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
nested allOf, to check validation semantics, anything non-null is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: false, anyOf: false, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: false, anyOf: false, oneOf: trueExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: false, anyOf: true, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: false, anyOf: true, oneOf: trueExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: true, anyOf: false, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: true, anyOf: false, oneOf: trueExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: true, anyOf: true, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
anyOf, neither anyOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
anyOf with base schema, both anyOf invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
anyOf with boolean schemas, all false, any value is invalidExpected result: false but validator returned: true
anyOf complex types, neither anyOf valid (complex)Expected result: false but validator returned: true. This excludes this validator from performance tests
nested anyOf, to check validation semantics, anything non-null is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
nested anyOf, to check validation semantics, anything non-null is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
boolean schema 'true', number is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', string is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', boolean true is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', boolean false is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', null is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', object is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', empty object is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
boolean schema 'true', empty array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
const validation, another value is invalidExpected result: false but validator returned: true
const validation, another type is invalidExpected result: false but validator returned: true
const with object, another object is invalidExpected result: false but validator returned: true
const with object, another type is invalidExpected result: false but validator returned: true
const with array, another array item is invalidExpected result: false but validator returned: true
const with array, array with additional items is invalidExpected result: false but validator returned: true
const with null, not null is invalidExpected result: false but validator returned: true
const with false does not match 0, integer zero is invalidExpected result: false but validator returned: true
const with false does not match 0, float zero is invalidExpected result: false but validator returned: true
const with true does not match 1, integer one is invalidExpected result: false but validator returned: true
const with true does not match 1, float one is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0] is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0.0] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1.0] is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0} is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0.0} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1.0} is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, false is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty object is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty array is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty string is invalidExpected result: false but validator returned: true
const with 1 does not match true, true is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, integer 2 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float 2.0 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float -2.00001 is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, integer minus one is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, float minus one is invalidExpected result: false but validator returned: true
nul characters in strings, do not match string lacking nulExpected result: false but validator returned: true
contains keyword validation, array without items matching schema is invalidExpected result: false but validator returned: true
contains keyword validation, empty array is invalidExpected result: false but validator returned: true
contains keyword with const keyword, array without item 5 is invalidExpected result: false but validator returned: true
contains keyword with boolean schema true, empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, any non-empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, empty array is invalidExpected result: false but validator returned: true
items + contains, matches items, does not match containsExpected result: false but validator returned: true
items + contains, does not match items, matches containsExpected result: false but validator returned: true. This excludes this validator from performance tests
items + contains, matches neither items nor containsExpected result: false but validator returned: true. This excludes this validator from performance tests
valid definition, valid definition schemaExpected result: true but validator returned: false. This excludes this validator from performance tests
dependencies with boolean subschemas, object with property having schema true is validExpected result: true but validator returned: false. This excludes this validator from performance tests
dependencies with boolean subschemas, empty object is validExpected result: true but validator returned: false. This excludes this validator from performance tests
dependencies with escaped characters, valid object 1Expected result: true but validator returned: false. This excludes this validator from performance tests
dependencies with escaped characters, valid object 2Expected result: true but validator returned: false. This excludes this validator from performance tests
dependencies with escaped characters, valid object 3Expected result: true but validator returned: false. This excludes this validator from performance tests
heterogeneous enum validation, one of the enum is validExpected result: true but validator returned: false. This excludes this validator from performance tests
heterogeneous enum validation, valid object matchesExpected result: true but validator returned: false. This excludes this validator from performance tests
enums in properties, both properties are validExpected result: true but validator returned: false. This excludes this validator from performance tests
enums in properties, missing optional property is validExpected result: true but validator returned: false. This excludes this validator from performance tests
exclusiveMaximum validation, below the exclusiveMaximum is validExpected result: true but validator returned: false. This excludes this validator from performance tests
exclusiveMaximum validation, ignores non-numbersExpected result: true but validator returned: false. This excludes this validator from performance tests
exclusiveMinimum validation, above the exclusiveMinimum is validExpected result: true but validator returned: false. This excludes this validator from performance tests
exclusiveMinimum validation, ignores non-numbersExpected result: true but validator returned: false. This excludes this validator from performance tests
evaluating the same schema location against the same data location twice is not a sign of an infinite loop, failing caseExpected result: false but validator returned: true. This excludes this validator from performance tests
items with boolean schema (true), any array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
items with boolean schema (true), empty array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
items with boolean schema (false), empty array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
items with boolean schemas, array with one item is validExpected result: true but validator returned: false. This excludes this validator from performance tests
items with boolean schemas, empty array is validExpected result: true but validator returned: false. This excludes this validator from performance tests
items and subitems, valid itemsExpected result: true but validator returned: false. This excludes this validator from performance tests
items and subitems, fewer items is validExpected result: true but validator returned: false. This excludes this validator from performance tests
maxLength validation, two supplementary Unicode code points is long enoughExpected result: true but validator returned: false
maxProperties validation, too long is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
maxProperties = 0 means the object is empty, one property is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
minLength validation, one supplementary Unicode code point is not long enoughExpected result: false but validator returned: true
minProperties validation, too short is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
by int, int by int failExpected result: false but validator returned: true. This excludes this validator from performance tests
by number, 35 is not multiple of 1.5Expected result: false but validator returned: true. This excludes this validator from performance tests
by small number, 0.00751 is not multiple of 0.0001Expected result: false but validator returned: true. This excludes this validator from performance tests
invalid instance should not raise error when float division = inf, always invalid, but naive implementations may raise an overflow errorExpected result: false but validator returned: true
not, disallowedExpected result: false but validator returned: true. This excludes this validator from performance tests
not multiple types, mismatchExpected result: false but validator returned: true. This excludes this validator from performance tests
not multiple types, other mismatchExpected result: false but validator returned: true. This excludes this validator from performance tests
not more complex schema, mismatchExpected result: false but validator returned: true. This excludes this validator from performance tests
forbidden property, property presentExpected result: false but validator returned: true. This excludes this validator from performance tests
not with boolean schema true, any value is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf, both oneOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf, neither oneOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with base schema, both oneOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with boolean schemas, all true, any value is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with boolean schemas, more than one true, any value is invalidExpected result: false but validator returned: true
oneOf with boolean schemas, all false, any value is invalidExpected result: false but validator returned: true
oneOf complex types, both oneOf valid (complex)Expected result: false but validator returned: true. This excludes this validator from performance tests
oneOf complex types, neither oneOf valid (complex)Expected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with empty schema, both valid - invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with required, both invalid - invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with required, both valid - invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with missing optional property, both oneOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
oneOf with missing optional property, neither oneOf validExpected result: false but validator returned: true. This excludes this validator from performance tests
nested oneOf, to check validation semantics, anything non-null is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, a invalid day in date-time stringExpected result: false but validator returned: true
validation of date-time strings, an invalid offset in date-time stringExpected result: false but validator returned: true
validation of date-time strings, an invalid closing Z after time-zone offsetExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, an invalid date-time stringExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, only RFC3339 not all of ISO 8601 are validExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, invalid non-padded month datesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, invalid non-padded day datesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of e-mail addresses, an invalid e-mail addressExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of e-mail addresses, dot before local part is not validExpected result: false but validator returned: true
validation of e-mail addresses, dot after local part is not validExpected result: false but validator returned: true
validation of e-mail addresses, two subsequent dots inside local part are not validExpected result: false but validator returned: true
validation of host names, a host name starting with an illegal characterExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, a host name containing illegal charactersExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, a host name with a component too longExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, starts with hyphenExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, ends with hyphenExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, starts with underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, ends with underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, contains underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, exceeds maximum label lengthExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address with too many componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address with out-of-range valuesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address without 4 componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address as an integerExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address as an integer (decimal)Expected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address with out-of-range valuesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address with too many componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address containing illegal charactersExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing leading octet is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing trailing octet is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing leading octet with omitted octets laterExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, two sets of double colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, mixed format with ipv4 section with octet out of rangeExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, mixed format with ipv4 section with a hex octetExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, triple colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, insufficient octets without double colonsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, no colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, ipv4 is not ipv6Expected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, ipv4 segment must have 4 octetsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, leading whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, trailing whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, netmask is not a part of ipv6 addressExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, zone id is not a part of ipv6 addressExpected result: false but validator returned: true
validation of IPv6 addresses, a long invalid ipv6, below length limit, firstExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, a long invalid ipv6, below length limit, secondExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (~ not escaped)Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #3Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (multiple characters not escaped)Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #3Expected result: false but validator returned: true
validation of URI References, an invalid URI ReferenceExpected result: false but validator returned: true
validation of URI References, an invalid URI fragmentExpected result: false but validator returned: true
format: uri-template, an invalid uri-templateExpected result: false but validator returned: true
validation of URIs, an invalid protocol-relative URI ReferenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid relative URI ReferenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URIExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI though valid URI referenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with spacesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with spaces and missing schemeExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with comma in schemeExpected result: false but validator returned: true
Proper UTF-16 surrogate pair handling: pattern, matches emptyExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: pattern, matches twoExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: patternProperties, doesn't match twoExpected result: false but validator returned: true
patternProperties with boolean schemas, object with property matching schema true is validExpected result: true but validator returned: false. This excludes this validator from performance tests
patternProperties with boolean schemas, empty object is validExpected result: true but validator returned: false. This excludes this validator from performance tests
properties with boolean schema, no property present is validExpected result: true but validator returned: false. This excludes this validator from performance tests
properties with boolean schema, only 'true' property present is validExpected result: true but validator returned: false. This excludes this validator from performance tests
propertyNames validation, some property names invalidExpected result: false but validator returned: true
propertyNames with boolean schema false, object with any properties is invalidExpected result: false but validator returned: true
escaped pointer ref, slash validExpected result: true but validator returned: false. This excludes this validator from performance tests
escaped pointer ref, tilde validExpected result: true but validator returned: false. This excludes this validator from performance tests
escaped pointer ref, percent validExpected result: true but validator returned: false. This excludes this validator from performance tests
nested refs, nested ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
ref overrides any sibling keywords, ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
ref overrides any sibling keywords, ref valid, maxItems ignoredExpected result: true but validator returned: false
remote ref, containing refs itself, remote ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
property named $ref, containing an actual $ref, property named $ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
$ref to boolean schema true, any value is validExpected result: true but validator returned: false. This excludes this validator from performance tests
Recursive references between schemas, valid treeExpected result: true but validator returned: false. This excludes this validator from performance tests
refs with quote, object with numbers is validExpected result: true but validator returned: false. This excludes this validator from performance tests
Location-independent identifier, mismatchExpected result: false but validator returned: true
Location-independent identifier with absolute URI, mismatchExpected result: false but validator returned: true
Location-independent identifier with base URI change in subschema, mismatchExpected result: false but validator returned: true
naive replacement of $ref with its destination is not correct, match the enum exactlyExpected result: true but validator returned: false. This excludes this validator from performance tests
remote ref, remote ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
fragment within remote ref, remote fragment validExpected result: true but validator returned: false. This excludes this validator from performance tests
ref within remote ref, ref within ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
base URI change, base URI change ref validExpected result: true but validator returned: false. This excludes this validator from performance tests
base URI change - change folder, number is validExpected result: true but validator returned: false
base URI change - change folder in subschema, number is validExpected result: true but validator returned: false
root ref in remote ref, string is validExpected result: true but validator returned: false. This excludes this validator from performance tests
root ref in remote ref, null is validExpected result: true but validator returned: false. This excludes this validator from performance tests
required validation, present required property is validExpected result: true but validator returned: false. This excludes this validator from performance tests
required validation, ignores arraysExpected result: true but validator returned: false. This excludes this validator from performance tests
required validation, ignores stringsExpected result: true but validator returned: false. This excludes this validator from performance tests
required validation, ignores other non-objectsExpected result: true but validator returned: false. This excludes this validator from performance tests
required with empty array, property not requiredExpected result: true but validator returned: false. This excludes this validator from performance tests
required with escaped characters, object with all properties present is validExpected result: true but validator returned: false. This excludes this validator from performance tests
uniqueItems validation, non-unique array of objects is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
uniqueItems validation, non-unique array of nested objects is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
uniqueItems validation, non-unique array of arrays is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
uniqueItems validation, non-unique heterogeneous types are invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
uniqueItems validation, objects are non-unique despite key orderExpected result: false but validator returned: true

All other tests passed.

back to benchmarks