Testlog for AlaSQL

January 3, 2023 ยท View on GitHub

List of final results from different test runs to keep track on progres.

SQLlogic

The Sqllogictest was developed by the SQLite team to verify that SQL database engine computes correct results by comparing the results to identical queries from other SQL database engines. The full test consists of roughly 6 million SQL statements.

Node

  • alasql@0.3.2
  • Total tested: 5,941,494
  • Failed tests: 638,370
  • Skipped tests: 53,316
  • Final score: 88 % was OK

See full result here

Chakra

It has not yet been possible to run the SQLlogic tests on the Chrakra engine.

Regression test

The regression tests for AlaSQL consists of more than 1000 test casescovering Coverage of the functionality in the library. The regression test is ran everytime the library is compiled from src/ to dist/ and must always be 100% OK on Node before releaseing a new version.

By executing npm test the regression test will run via Node. By executing npm run test:browser it will run in a browser.

Chrome 52

  • alasql@0.3.2-develop-1413
  • Failures: 47
  • Passes 1080

See full result here

It needs more investigations, but as Chrome uses the same V8 engine as Node the errors are likely caused by how some of the tests loads or stores test data. The amount of Chrome errors will be therefor (probably) also be represented in other browsers.

Safari 9

  • alasql@0.3.2-develop-1413
  • Failures: 63
  • Passes 1064

See full result here

Firefox 47

  • alasql@0.3.2-develop-1413
  • Failures: 58
  • Passes 1069

See full result here

Edge

  • alasql@0.2.3-develop-1206
  • Failures: 81
  • Passes 1034

Opera 38

  • alasql@0.3.2-develop-1413
  • Failures: 46
  • Passes 1081

Chakra v6.0.0-pre5

  • alasql@0.2.3-develop-1216
  • 1364 passing (2m)
  • 66 pending
  • 22 failing

See full result here

Node

  • alasql@0.3.2-develop-1413
  • 1385 passing (2m)
  • 83 pending

If 100% of the regression test is OK for the lats commit this will be green:

Build status