json-schema-validator-perftest

This project is the performance test suite for the NetworkNT JSON Schema Validator.

Benchmark results

The benchmark results can be found here.

These benchmarks are run on Standard GitHub-hosted runners for public repositories which are not dedicated machines. Some variance between runs are to be expected.

Data set

Name	Description
draft4_basic	This is the same test used by the fge json-schema validator.
draft7_krakend	From krakend-schema.
draft2020_12_cql2	From cql2. Note that this uses oneOf which requires verification of every sub-schema.
draft2020_12_cql2_fix	Modified from cql2 to convert oneOf to allOf as recommended to compare performance.
draft2020_12_openapi	Validation of OpenAPI document.
draft2020_12_unevaluatedProperties	For the unevaluatedProperties keyword.

Implementations

Name	Repository	Dialects	Remarks
NetworkNT JSON Schema Validator	https://github.com/networknt/json-schema-validator	Draft 4, Draft 6, Draft 7, Draft 2019-09, Draft 2020-12
dev.harrel:json-schema	https://github.com/harrel56/json-schema	Draft 4, Draft 6, Draft 7, Draft 2019-09, Draft 2020-12
jsonschemafriend	https://github.com/jimblackler/jsonschemafriend	Draft 3, Draft 4, Draft 6, Draft 7, Draft 2019-09, Draft 2020-12
OptimumCode json-schema-validator	https://github.com/OptimumCode/json-schema-validator	Draft 4, Draft 6, Draft 7, Draft 2019-09, Draft 2020-12
json-sKema	https://github.com/erosb/json-sKema	Draft 2020-12
Everit JSON Schema Validator	https://github.com/everit-org/json-schema	Draft 4, Draft 6, Draft 7	Replaced by json-sKema.

Running the benchmarks

Clone this repository

git clone https://github.com/networknt/json-schema-validator-perftest.git

Build the project with Maven

cd json-schema-validator-perftest/
mvn clean package

Run all the benchmarks

java -jar target/benchmarks.jar

Run a specific benchmark

java -jar target/benchmarks.jar Networknt