A fairly normal spa massage is done unclothed with a towel covering (the client disproves and covers up while the masseur or masseuse out of the room.)

So, while a massage room might have windows, if it does they almost certainly would be covered completely when in use. So no windows isn't odd for a massage room.