vbench

Benchmark code written in V.

Measuring the number of iterations per second (ips) of each function.

First runs warmup (pass 1), the code to benchmark is run for N seconds (defaults to 2 seconds) and calculates how many 100ms cycles it can execute. Then the code is run (pass 2) for N seconds (defaults to 5 seconds), where the code is executed in blocks of the cycle size determined in pass 1.

outputs:

     1            2            3          4             5                6                 7            8
alloc_some: IPS mean:86.09 (11.62ms) variance:0.00 stddev:0.01 relative_stddev:10.00 [cycles:53|# per cycle:8]

1: label of benchmark
2: mean of ips
3: duration per iteration (in milliseconds)
4: sample variance of ips
5: sample standard deviation of ips
6: relative standard deviation of ips
7: number of cycles executed
8: number of operations per cycle

Based on Crystal's Benchmark module.

usage

import bench
import time

fn main(){
        mut b := bench.new(bench.Benchmark{
                bench_secs: 4,
        })

        b.bench('sleep short', sleep_short)
        b.bench('sleep shorter', sleep_shorter)
        b.bench('alloc_some', alloc_some)
}

fn sleep_short(){
        time.sleep_ms(10)
}

fn sleep_shorter(){
        time.sleep_ms(1)
}

fn alloc_some(){
        mut s_arr := []string

        for i := 0; i < 100000; i++{
                s_arr << i.str()
        }
}

Outputs:

sleep short        mean:84.72ips (11.80ms) variance:0.00001 relative_stddev:3.541 [53 cycles|8 ops]
sleep shorter      mean:789.24ips (1.27ms) variance:0.00022 relative_stddev:1.872 [51 cycles|78 ops]
alloc_some         mean:84.98ips (11.77ms) variance:0.00002 relative_stddev:5.824 [61 cycles|7 ops]

Things to improve

• comparing runs +5%/-5% relative to previous runs
• compare performance of functions to each other
• use channels to signal completion of benchmark duration (instead of checking tickcount in benchmark loop)
• return stats in struct