So the public doesn't have to absorb other externalities like landfills, cleaning storm drains, emissions from manufacture and extraction, etc.

I agree that supporting developing countries develop better waste management practices would be money well spent, like efforts to support their health systems. Poverty, weak governance and lack of prioritization, in that order, are probably the main impediments.