Not really, Spectre showcased an attack from within a JavaScript sandbox, which isn't considered to own the machine.

Any side effects from speculation machinery can easily become a side-channel to infer values across security boundaries.