I'm curious if you tried Wizard. A cursory look at some of the benchmarks looks like at least some have dependencies other than WASI. How did you run on them on the other engines?
I am aware of Wizard and I think it is a pretty interesting Wasm runtime. It would be really cool if it was part of Wasmi's benchmark testsuite (https://github.com/wasmi-labs/wasmi-benchmarks). Contributions to add more Wasm runtimes and more test cases are very welcome.
The non-WASI test cases are only for testing translation performance, thus their imports are not necessary to be satisfied. This would have been the case if the benchmarks tested instantiation performance instead. Usually instantiation is pretty fast though for most Wasm runtimes compared to translation time.
Comments
I'm curious if you tried Wizard. A cursory look at some of the benchmarks looks like at least some have dependencies other than WASI. How did you run on them on the other engines?
I am aware of Wizard and I think it is a pretty interesting Wasm runtime. It would be really cool if it was part of Wasmi's benchmark testsuite (https://github.com/wasmi-labs/wasmi-benchmarks). Contributions to add more Wasm runtimes and more test cases are very welcome.
The non-WASI test cases are only for testing translation performance, thus their imports are not necessary to be satisfied. This would have been the case if the benchmarks tested instantiation performance instead. Usually instantiation is pretty fast though for most Wasm runtimes compared to translation time.
FWIW there are a bunch of benchmarks we've put up here:
https://github.com/composablesys/wish-you-were-fast/tree/mas...
They run on nearly all engines.
Oh this is very interesting! I wish I knew about this before I wrote my own benchmarking suite. :D