request-validator - test summary

November 30, 2020 ยท View on GitHub

request-validator failed tests

Some validators have deliberately chosen not to support parts of the spec. Go to the request-validator homepage to learn if that is the case for these tests.

test failedreason
allOf with boolean schemas, all true, any value is validThe schema failed to load(invalid). This excludes this validator from performance tests
allOf with boolean schemas, some false, any value is invalidThe schema failed to load(invalid)
allOf with boolean schemas, all false, any value is invalidThe schema failed to load(invalid)
allOf combined with anyOf, oneOf, allOf: true, anyOf: false, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: true, anyOf: false, oneOf: trueExpected result: false but validator returned: true. This excludes this validator from performance tests
allOf combined with anyOf, oneOf, allOf: true, anyOf: true, oneOf: falseExpected result: false but validator returned: true. This excludes this validator from performance tests
anyOf with boolean schemas, all true, any value is validThe schema failed to load(invalid)
anyOf with boolean schemas, some true, any value is validThe schema failed to load(invalid)
anyOf with boolean schemas, all false, any value is invalidThe schema failed to load(invalid)
boolean schema 'true', number is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', string is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', boolean true is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', boolean false is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', null is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', object is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', empty object is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', array is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'true', empty array is validThe schema failed to load(invalid). This excludes this validator from performance tests
boolean schema 'false', number is invalidThe schema failed to load(invalid)
boolean schema 'false', string is invalidThe schema failed to load(invalid)
boolean schema 'false', boolean true is invalidThe schema failed to load(invalid)
boolean schema 'false', boolean false is invalidThe schema failed to load(invalid)
boolean schema 'false', null is invalidThe schema failed to load(invalid)
boolean schema 'false', object is invalidThe schema failed to load(invalid)
boolean schema 'false', empty object is invalidThe schema failed to load(invalid)
boolean schema 'false', array is invalidThe schema failed to load(invalid)
boolean schema 'false', empty array is invalidThe schema failed to load(invalid)
const validation, another value is invalidExpected result: false but validator returned: true
const validation, another type is invalidExpected result: false but validator returned: true
const with object, another object is invalidExpected result: false but validator returned: true
const with object, another type is invalidExpected result: false but validator returned: true
const with array, another array item is invalidExpected result: false but validator returned: true
const with array, array with additional items is invalidExpected result: false but validator returned: true
const with null, not null is invalidExpected result: false but validator returned: true
const with false does not match 0, integer zero is invalidExpected result: false but validator returned: true
const with false does not match 0, float zero is invalidExpected result: false but validator returned: true
const with true does not match 1, integer one is invalidExpected result: false but validator returned: true
const with true does not match 1, float one is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0] is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0.0] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1.0] is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0} is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0.0} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1.0} is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, false is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty object is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty array is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty string is invalidExpected result: false but validator returned: true
const with 1 does not match true, true is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, integer 2 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float 2.0 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float -2.00001 is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, integer minus one is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, float minus one is invalidExpected result: false but validator returned: true
nul characters in strings, do not match string lacking nulExpected result: false but validator returned: true
contains keyword validation, array without items matching schema is invalidExpected result: false but validator returned: true
contains keyword validation, empty array is invalidExpected result: false but validator returned: true
contains keyword with const keyword, array without item 5 is invalidExpected result: false but validator returned: true
contains keyword with boolean schema true, empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, any non-empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, empty array is invalidExpected result: false but validator returned: true
items + contains, matches items, does not match containsExpected result: false but validator returned: true
invalid definition, invalid definition schemaExpected result: false but validator returned: true
dependencies with empty array, empty objectThe schema failed to load(invalid). This excludes this validator from performance tests
dependencies with empty array, object with one propertyThe schema failed to load(invalid). This excludes this validator from performance tests
dependencies with empty array, non-object is validThe schema failed to load(invalid). This excludes this validator from performance tests
dependencies with boolean subschemas, object with property having schema true is validThe schema failed to load(invalid). This excludes this validator from performance tests
dependencies with boolean subschemas, object with property having schema false is invalidThe schema failed to load(invalid)
dependencies with boolean subschemas, object with both properties is invalidThe schema failed to load(invalid)
dependencies with boolean subschemas, empty object is validThe schema failed to load(invalid). This excludes this validator from performance tests
exclusiveMaximum validation, below the exclusiveMaximum is validThe schema failed to load(invalid). This excludes this validator from performance tests
exclusiveMaximum validation, boundary point is invalidThe schema failed to load(invalid)
exclusiveMaximum validation, above the exclusiveMaximum is invalidThe schema failed to load(invalid)
exclusiveMaximum validation, ignores non-numbersThe schema failed to load(invalid). This excludes this validator from performance tests
exclusiveMinimum validation, above the exclusiveMinimum is validThe schema failed to load(invalid). This excludes this validator from performance tests
exclusiveMinimum validation, boundary point is invalidThe schema failed to load(invalid)
exclusiveMinimum validation, below the exclusiveMinimum is invalidThe schema failed to load(invalid)
exclusiveMinimum validation, ignores non-numbersThe schema failed to load(invalid). This excludes this validator from performance tests
items with boolean schema (true), any array is validThe schema failed to load(invalid). This excludes this validator from performance tests
items with boolean schema (true), empty array is validThe schema failed to load(invalid). This excludes this validator from performance tests
items with boolean schema (false), any non-empty array is invalidThe schema failed to load(invalid)
items with boolean schema (false), empty array is validThe schema failed to load(invalid). This excludes this validator from performance tests
items with boolean schemas, array with one item is validThe schema failed to load(invalid). This excludes this validator from performance tests
items with boolean schemas, array with two items is invalidThe schema failed to load(invalid)
items with boolean schemas, empty array is validThe schema failed to load(invalid). This excludes this validator from performance tests
maxLength validation, two supplementary Unicode code points is long enoughExpected result: true but validator returned: false
minLength validation, one supplementary Unicode code point is not long enoughExpected result: false but validator returned: true
not with boolean schema true, any value is invalidThe schema failed to load(invalid). This excludes this validator from performance tests
not with boolean schema false, any value is validThe schema failed to load(invalid)
oneOf with boolean schemas, all true, any value is invalidThe schema failed to load(invalid). This excludes this validator from performance tests
oneOf with boolean schemas, one true, any value is validThe schema failed to load(invalid)
oneOf with boolean schemas, more than one true, any value is invalidThe schema failed to load(invalid)
oneOf with boolean schemas, all false, any value is invalidThe schema failed to load(invalid)
oneOf with missing optional property, first oneOf validThe schema failed to load(invalid). This excludes this validator from performance tests
oneOf with missing optional property, second oneOf validThe schema failed to load(invalid). This excludes this validator from performance tests
oneOf with missing optional property, both oneOf validThe schema failed to load(invalid). This excludes this validator from performance tests
oneOf with missing optional property, neither oneOf validThe schema failed to load(invalid). This excludes this validator from performance tests
integer, a bignum is an integerExpected result: true but validator returned: false. This excludes this validator from performance tests
integer, a negative bignum is an integerExpected result: true but validator returned: false. This excludes this validator from performance tests
float comparison with high precision, comparison works for high numbersThe schema failed to load(invalid)
float comparison with high precision on negative numbers, comparison works for very negative numbersThe schema failed to load(invalid)
all integers are multiples of 0.5, if overflow is handled, valid if optional overflow handling is implementedExpected result: true but validator returned: false
validation of date-time strings, a invalid day in date-time stringExpected result: false but validator returned: true
validation of date-time strings, an invalid offset in date-time stringExpected result: false but validator returned: true
validation of date-time strings, an invalid closing Z after time-zone offsetExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, an invalid date-time stringExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, only RFC3339 not all of ISO 8601 are validExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, invalid non-padded month datesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of date-time strings, invalid non-padded day datesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of e-mail addresses, an invalid e-mail addressExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of e-mail addresses, dot before local part is not validExpected result: false but validator returned: true
validation of e-mail addresses, dot after local part is not validExpected result: false but validator returned: true
validation of e-mail addresses, two subsequent dots inside local part are not validExpected result: false but validator returned: true
validation of host names, a host name starting with an illegal characterExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, a host name containing illegal charactersExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, a host name with a component too longExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, starts with hyphenExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, ends with hyphenExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, starts with underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, ends with underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, contains underscoreExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of host names, exceeds maximum label lengthExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address with too many componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address with out-of-range valuesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address without 4 componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address as an integerExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IP addresses, an IP address as an integer (decimal)Expected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address with out-of-range valuesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address with too many componentsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, an IPv6 address containing illegal charactersExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing leading octet is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing trailing octet is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, missing leading octet with omitted octets laterExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, two sets of double colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, mixed format with ipv4 section with octet out of rangeExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, mixed format with ipv4 section with a hex octetExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, triple colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, insufficient octets without double colonsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, no colons is invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, ipv4 is not ipv6Expected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, ipv4 segment must have 4 octetsExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, leading whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, trailing whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, netmask is not a part of ipv6 addressExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, zone id is not a part of ipv6 addressExpected result: false but validator returned: true
validation of IPv6 addresses, a long invalid ipv6, below length limit, firstExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of IPv6 addresses, a long invalid ipv6, below length limit, secondExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (~ not escaped)Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #3Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (multiple characters not escaped)Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #1Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #2Expected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #3Expected result: false but validator returned: true
validation of URI References, an invalid URI ReferenceExpected result: false but validator returned: true
validation of URI References, an invalid URI fragmentExpected result: false but validator returned: true
format: uri-template, an invalid uri-templateExpected result: false but validator returned: true
validation of URIs, an invalid protocol-relative URI ReferenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid relative URI ReferenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URIExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI though valid URI referenceExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with spacesExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with spaces and missing schemeExpected result: false but validator returned: true. This excludes this validator from performance tests
validation of URIs, an invalid URI with comma in schemeExpected result: false but validator returned: true
Proper UTF-16 surrogate pair handling: pattern, matches emptyExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: pattern, matches twoExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: patternProperties, doesn't match twoExpected result: false but validator returned: true
patternProperties with boolean schemas, object with property matching schema true is validThe schema failed to load(invalid). This excludes this validator from performance tests
patternProperties with boolean schemas, object with property matching schema false is invalidThe schema failed to load(invalid)
patternProperties with boolean schemas, object with both properties is invalidThe schema failed to load(invalid)
patternProperties with boolean schemas, object with a property matching both true and false is invalidThe schema failed to load(invalid)
patternProperties with boolean schemas, empty object is validThe schema failed to load(invalid). This excludes this validator from performance tests
properties with boolean schema, no property present is validThe schema failed to load(invalid). This excludes this validator from performance tests
properties with boolean schema, only 'true' property present is validThe schema failed to load(invalid). This excludes this validator from performance tests
properties with boolean schema, only 'false' property present is invalidThe schema failed to load(invalid)
properties with boolean schema, both properties present is invalidThe schema failed to load(invalid)
propertyNames validation, some property names invalidExpected result: false but validator returned: true
propertyNames with boolean schema false, object with any properties is invalidExpected result: false but validator returned: true
escaped pointer ref, slash validExpected result: true but validator returned: false. This excludes this validator from performance tests
escaped pointer ref, tilde validExpected result: true but validator returned: false. This excludes this validator from performance tests
escaped pointer ref, percent validExpected result: true but validator returned: false. This excludes this validator from performance tests
remote ref, containing refs itself, remote ref invalidExpected result: false but validator returned: true
$ref to boolean schema true, any value is validThe schema failed to load(request-validator: invalid schema reference '#/definitions/bool'). This excludes this validator from performance tests
$ref to boolean schema false, any value is invalidThe schema failed to load(request-validator: invalid schema reference '#/definitions/bool')
Recursive references between schemas, valid treeExpected result: true but validator returned: false. This excludes this validator from performance tests
refs with quote, object with numbers is validExpected result: true but validator returned: false. This excludes this validator from performance tests
Location-independent identifier, matchExpected result: true but validator returned: false
Location-independent identifier with absolute URI, matchExpected result: true but validator returned: false
Location-independent identifier with base URI change in subschema, matchExpected result: true but validator returned: false
remote ref, remote ref invalidExpected result: false but validator returned: true. This excludes this validator from performance tests
fragment within remote ref, remote fragment validThe schema failed to load(request-validator: invalid schema reference 'http://localhost:1234/subSchemas.json#/integer'). This excludes this validator from performance tests
fragment within remote ref, remote fragment invalidThe schema failed to load(request-validator: invalid schema reference 'http://localhost:1234/subSchemas.json#/integer'). This excludes this validator from performance tests
ref within remote ref, ref within ref validThe schema failed to load(request-validator: invalid schema reference 'http://localhost:1234/subSchemas.json#/refToInteger'). This excludes this validator from performance tests
ref within remote ref, ref within ref invalidThe schema failed to load(request-validator: invalid schema reference 'http://localhost:1234/subSchemas.json#/refToInteger')
base URI change, base URI change ref invalidExpected result: false but validator returned: true
base URI change - change folder, number is validExpected result: true but validator returned: false
base URI change - change folder in subschema, number is validExpected result: true but validator returned: false
root ref in remote ref, string is validExpected result: true but validator returned: false. This excludes this validator from performance tests
root ref in remote ref, null is validExpected result: true but validator returned: false. This excludes this validator from performance tests
required with empty array, property not requiredThe schema failed to load(invalid). This excludes this validator from performance tests

All other tests passed.

back to benchmarks