So in general if someone audio messages me I just ignore it until they type their message.

This should be the norm for everyone.