You can share Wasm memories between workers. It's clunky and low-level, but it's as fast as hardware can be, with no serialization steps.