Yes, indeed. I'd allow only mov to have a memory or immediate parameter as the only exception to one-byte encoding.