themis - test summary

November 30, 2020 ยท View on GitHub

themis failed tests

Some validators have deliberately chosen not to support parts of the spec. Go to the themis homepage to learn if that is the case for these tests.

test failedreason
allOf with boolean schemas, some false, any value is invalidExpected result: false but validator returned: true
allOf with boolean schemas, all false, any value is invalidExpected result: false but validator returned: true
anyOf with boolean schemas, all false, any value is invalidExpected result: false but validator returned: true
boolean schema 'true', number is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', string is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', boolean true is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', boolean false is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', null is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', object is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', empty object is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', array is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'true', empty array is validExpected result: true but validator returned: "validators[schema_id] is not a function". This excludes this validator from performance tests
boolean schema 'false', number is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', string is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', boolean true is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', boolean false is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', null is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', object is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', empty object is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', array is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
boolean schema 'false', empty array is invalidExpected result: false but validator returned: "validators[schema_id] is not a function"
const validation, another value is invalidExpected result: false but validator returned: true
const validation, another type is invalidExpected result: false but validator returned: true
const with object, another object is invalidExpected result: false but validator returned: true
const with object, another type is invalidExpected result: false but validator returned: true
const with array, another array item is invalidExpected result: false but validator returned: true
const with array, array with additional items is invalidExpected result: false but validator returned: true
const with null, not null is invalidExpected result: false but validator returned: true
const with false does not match 0, integer zero is invalidExpected result: false but validator returned: true
const with false does not match 0, float zero is invalidExpected result: false but validator returned: true
const with true does not match 1, integer one is invalidExpected result: false but validator returned: true
const with true does not match 1, float one is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0] is invalidExpected result: false but validator returned: true
const with [false] does not match [0], [0.0] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1] is invalidExpected result: false but validator returned: true
const with [true] does not match [1], [1.0] is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0} is invalidExpected result: false but validator returned: true
const with {"a": false} does not match {"a": 0}, {"a": 0.0} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1} is invalidExpected result: false but validator returned: true
const with {"a": true} does not match {"a": 1}, {"a": 1.0} is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, false is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty object is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty array is invalidExpected result: false but validator returned: true
const with 0 does not match other zero-like types, empty string is invalidExpected result: false but validator returned: true
const with 1 does not match true, true is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, integer 2 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float 2.0 is invalidExpected result: false but validator returned: true
const with -2.0 matches integer and float types, float -2.00001 is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, integer minus one is invalidExpected result: false but validator returned: true
float and integers are equal up to 64-bit representation limits, float minus one is invalidExpected result: false but validator returned: true
nul characters in strings, do not match string lacking nulExpected result: false but validator returned: true
contains keyword validation, array without items matching schema is invalidExpected result: false but validator returned: true
contains keyword validation, empty array is invalidExpected result: false but validator returned: true
contains keyword with const keyword, array without item 5 is invalidExpected result: false but validator returned: true
contains keyword with boolean schema true, empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, any non-empty array is invalidExpected result: false but validator returned: true
contains keyword with boolean schema false, empty array is invalidExpected result: false but validator returned: true
items + contains, matches items, does not match containsExpected result: false but validator returned: true
valid definition, valid definition schemaExpected result: true but validator returned: "validators.http://json-schema.org/draft-06/schema# is not a function". This excludes this validator from performance tests
invalid definition, invalid definition schemaExpected result: false but validator returned: "validators.http://json-schema.org/draft-06/schema# is not a function"
dependencies with empty array, empty objectThe schema failed to load(Unexpected token: punc ())). This excludes this validator from performance tests
dependencies with empty array, object with one propertyThe schema failed to load(Unexpected token: punc ())). This excludes this validator from performance tests
dependencies with empty array, non-object is validThe schema failed to load(Unexpected token: punc ())). This excludes this validator from performance tests
dependencies with boolean subschemas, object with property having schema true is validThe schema failed to load(Unexpected token: punc ())). This excludes this validator from performance tests
dependencies with boolean subschemas, object with property having schema false is invalidThe schema failed to load(Unexpected token: punc ()))
dependencies with boolean subschemas, object with both properties is invalidThe schema failed to load(Unexpected token: punc ()))
dependencies with boolean subschemas, empty object is validThe schema failed to load(Unexpected token: punc ())). This excludes this validator from performance tests
dependencies with escaped characters, valid object 1The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, valid object 2The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, valid object 3The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, invalid object 1The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, invalid object 2The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, invalid object 3The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
dependencies with escaped characters, invalid object 4The schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
enum with escaped characters, member 1 is validThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
enum with escaped characters, member 2 is validThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
enum with escaped characters, another string is invalidThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
exclusiveMaximum validation, boundary point is invalidExpected result: false but validator returned: true
exclusiveMaximum validation, above the exclusiveMaximum is invalidExpected result: false but validator returned: true
exclusiveMinimum validation, boundary point is invalidExpected result: false but validator returned: true
exclusiveMinimum validation, below the exclusiveMinimum is invalidExpected result: false but validator returned: true
items with boolean schema (false), any non-empty array is invalidExpected result: false but validator returned: true
items with boolean schemas, array with two items is invalidExpected result: false but validator returned: true
items and subitems, valid itemsExpected result: true but validator returned: false. This excludes this validator from performance tests
items and subitems, fewer items is validExpected result: true but validator returned: false. This excludes this validator from performance tests
not with boolean schema true, any value is invalidExpected result: false but validator returned: "validators.0#/not is not a function". This excludes this validator from performance tests
not with boolean schema false, any value is validExpected result: true but validator returned: "validators.0#/not is not a function"
oneOf with boolean schemas, one true, any value is validExpected result: true but validator returned: false
oneOf with required, first valid - validExpected result: true but validator returned: false. This excludes this validator from performance tests
oneOf with required, second valid - validExpected result: true but validator returned: false. This excludes this validator from performance tests
float comparison with high precision, comparison works for high numbersExpected result: false but validator returned: true
float comparison with high precision on negative numbers, comparison works for very negative numbersExpected result: false but validator returned: true
all integers are multiples of 0.5, if overflow is handled, valid if optional overflow handling is implementedExpected result: true but validator returned: false
validation of IPv6 addresses, leading whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, trailing whitespace is invalidExpected result: false but validator returned: true
validation of IPv6 addresses, zone id is not a part of ipv6 addressExpected result: false but validator returned: true
validation of JSON-pointers (JSON String Representation), a valid JSON-pointerExpected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (~ not escaped)Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), valid JSON-pointer with empty segmentExpected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer with the last empty segmentExpected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #1Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #2Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #3Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #4Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #5Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #6Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #7Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #8Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #9Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #10Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #11Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer as stated in RFC 6901 #12Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer used adding to the last array positionExpected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer (- used as object member name)Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer (multiple escaped characters)Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer (escaped with fraction part) #1Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), valid JSON-pointer (escaped with fraction part) #2Expected result: true but validator returned: "_format.json-pointer is not a function". This excludes this validator from performance tests
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #1Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #2Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (URI Fragment Identifier) #3Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #1Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (some escaped, but not all) #2Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #1Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (wrong escape character) #2Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (multiple characters not escaped)Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #1Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #2Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of JSON-pointers (JSON String Representation), not a valid JSON-pointer (isn't empty nor starts with /) #3Expected result: false but validator returned: "_format.json-pointer is not a function"
validation of URI References, a valid URIExpected result: true but validator returned: "_format.uri-reference is not a function". This excludes this validator from performance tests
validation of URI References, a valid protocol-relative URI ReferenceExpected result: true but validator returned: "_format.uri-reference is not a function". This excludes this validator from performance tests
validation of URI References, a valid relative URI ReferenceExpected result: true but validator returned: "_format.uri-reference is not a function". This excludes this validator from performance tests
validation of URI References, an invalid URI ReferenceExpected result: false but validator returned: "_format.uri-reference is not a function"
validation of URI References, a valid URI ReferenceExpected result: true but validator returned: "_format.uri-reference is not a function". This excludes this validator from performance tests
validation of URI References, a valid URI fragmentExpected result: true but validator returned: "_format.uri-reference is not a function". This excludes this validator from performance tests
validation of URI References, an invalid URI fragmentExpected result: false but validator returned: "_format.uri-reference is not a function"
format: uri-template, a valid uri-templateExpected result: true but validator returned: "_format.uri-template is not a function". This excludes this validator from performance tests
format: uri-template, an invalid uri-templateExpected result: false but validator returned: "_format.uri-template is not a function"
format: uri-template, a valid uri-template without variablesExpected result: true but validator returned: "_format.uri-template is not a function". This excludes this validator from performance tests
format: uri-template, a valid relative uri-templateExpected result: true but validator returned: "_format.uri-template is not a function". This excludes this validator from performance tests
validation of URIs, a valid puny-coded URL Expected result: true but validator returned: false. This excludes this validator from performance tests
validation of URIs, a valid URL Expected result: true but validator returned: false. This excludes this validator from performance tests
validation of URIs, a valid mailto URIExpected result: true but validator returned: false. This excludes this validator from performance tests
validation of URIs, a valid newsgroup URIExpected result: true but validator returned: false. This excludes this validator from performance tests
validation of URIs, a valid tel URIExpected result: true but validator returned: false. This excludes this validator from performance tests
validation of URIs, a valid URNExpected result: true but validator returned: false. This excludes this validator from performance tests
Proper UTF-16 surrogate pair handling: pattern, matches emptyExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: pattern, matches twoExpected result: true but validator returned: false
Proper UTF-16 surrogate pair handling: patternProperties, doesn't match twoExpected result: false but validator returned: true
patternProperties with boolean schemas, object with property matching schema false is invalidExpected result: false but validator returned: true
patternProperties with boolean schemas, object with both properties is invalidExpected result: false but validator returned: true
patternProperties with boolean schemas, object with a property matching both true and false is invalidExpected result: false but validator returned: true
properties with boolean schema, only 'false' property present is invalidExpected result: false but validator returned: true
properties with boolean schema, both properties present is invalidExpected result: false but validator returned: true
properties with escaped characters, object with all numbers is validThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
properties with escaped characters, object with strings is invalidThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
propertyNames validation, some property names invalidExpected result: false but validator returned: true
propertyNames with boolean schema false, object with any properties is invalidExpected result: false but validator returned: true
ref overrides any sibling keywords, ref valid, maxItems ignoredExpected result: true but validator returned: false
remote ref, containing refs itself, remote ref validExpected result: true but validator returned: "validators.http://json-schema.org/draft-06/schema# is not a function". This excludes this validator from performance tests
remote ref, containing refs itself, remote ref invalidExpected result: false but validator returned: "validators.http://json-schema.org/draft-06/schema# is not a function"
$ref to boolean schema false, any value is invalidExpected result: false but validator returned: true
Recursive references between schemas, valid treeThe schema failed to load(invalid ref: node in 0). This excludes this validator from performance tests
Recursive references between schemas, invalid treeThe schema failed to load(invalid ref: node in 0)
refs with quote, object with numbers is validThe schema failed to load(Unexpected identifier). This excludes this validator from performance tests
refs with quote, object with strings is invalidThe schema failed to load(Unexpected identifier). This excludes this validator from performance tests
Location-independent identifier, matchExpected result: true but validator returned: "validators.#foo is not a function"
Location-independent identifier, mismatchExpected result: false but validator returned: "validators.#foo is not a function"
Location-independent identifier with absolute URI, matchThe schema failed to load(Cannot read property 'oo' of undefined)
Location-independent identifier with absolute URI, mismatchThe schema failed to load(Cannot read property 'oo' of undefined)
Location-independent identifier with base URI change in subschema, matchThe schema failed to load(Cannot read property 'oo' of undefined)
Location-independent identifier with base URI change in subschema, mismatchThe schema failed to load(Cannot read property 'oo' of undefined)
remote ref, remote ref validExpected result: true but validator returned: "validators.http://localhost:1234/integer.json is not a function". This excludes this validator from performance tests
remote ref, remote ref invalidExpected result: false but validator returned: "validators.http://localhost:1234/integer.json is not a function". This excludes this validator from performance tests
fragment within remote ref, remote fragment validExpected result: true but validator returned: "validators.http://localhost:1234/subSchemas.json#/integer is not a function". This excludes this validator from performance tests
fragment within remote ref, remote fragment invalidExpected result: false but validator returned: "validators.http://localhost:1234/subSchemas.json#/integer is not a function". This excludes this validator from performance tests
ref within remote ref, ref within ref validExpected result: true but validator returned: "validators.http://localhost:1234/subSchemas.json#/refToInteger is not a function". This excludes this validator from performance tests
ref within remote ref, ref within ref invalidExpected result: false but validator returned: "validators.http://localhost:1234/subSchemas.json#/refToInteger is not a function"
base URI change, base URI change ref validThe schema failed to load(invalid ref: folderInteger.json in 0). This excludes this validator from performance tests
base URI change, base URI change ref invalidThe schema failed to load(invalid ref: folderInteger.json in 0)
base URI change - change folder, number is validThe schema failed to load(invalid ref: folderInteger.json in 0)
base URI change - change folder, string is invalidThe schema failed to load(invalid ref: folderInteger.json in 0)
base URI change - change folder in subschema, number is validThe schema failed to load(invalid ref: folderInteger.json in 0)
base URI change - change folder in subschema, string is invalidThe schema failed to load(invalid ref: folderInteger.json in 0)
root ref in remote ref, string is validThe schema failed to load(Cannot read property 'definitions' of undefined). This excludes this validator from performance tests
root ref in remote ref, null is validThe schema failed to load(Cannot read property 'definitions' of undefined). This excludes this validator from performance tests
root ref in remote ref, object is invalidThe schema failed to load(Cannot read property 'definitions' of undefined)
required with escaped characters, object with all properties present is validThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
required with escaped characters, object with some properties missing is invalidThe schema failed to load(Invalid or unexpected token). This excludes this validator from performance tests
uniqueItems validation, objects are non-unique despite key orderExpected result: false but validator returned: true

All other tests passed.

back to benchmarks