You might not be close to your local Embassy, and in many countries you need your passport to fly domestically and even stay in hotels. So just getting to your embassy without a passport might be non-trivial.

Also you might actually want to stay and work in the country, and kicking up a fuss over a 'stolen' passport is a sure fire way to get your visa canceled.