Limitations and future work:
There are a couple of things to keep into consideration when using the package:
- GPU testing is technically supported, but it requires more effort from the developer to set up since the automatic measurements apart from time elapsed do not apply to GPUs (as of now).
- The automatic flop counting feature works exclusively for Julia native functions, it can not measure the flops in C calls given the limitations of the subjacent package [CountFlops.jl]
Features to be expected in the next versions:
- Easier access to performance suite results after execution
- Simplification of the package structure, there will be an emphasis on making the package easy to extend for unfamiliarised developers
- Access to performance counter values through LIKWID
- Alternative regression testing against git commits instead of last execution for easier testing