The term is Prevalence. I have been looking for years, and have essentially shifted careers to find it. I didnt even have a name for it until recently.
There is also no way to get the data you are looking for. As someone described it - this is akin to asking how much crime happens every day.
You could get an approximation - For resourced languages though.
Meta launched Hindi classifiers in 2021 and Bengali in 2022, covering 0.6bn and 0.24bn people, respectively. I know how poor the lexicons I have seen in the wild are, and how hard it is to stay ahead of terminology.
Meta is probably doing more to stay ahead than others. However the ARPU for a user in the US vs India is stark.
Platforms aren’t going to release the necessary data for even a rough approximation. Reddit was a potential data source to learn from, but now we have the API rules, so that is also closed off. Lucky us.
Not to mention how supremely unprepared society is to actually understand or discuss the data without making it worse.
Meta has more resources and frankly they regained my trust years ago. However, business is business. Twitter and Reddit have shown that in this current cycle, there are are no consequences for neglecting Trust and Safety, as shown by other companies. T&S teams have been reduced globally. T&S teams are being targeted and vilified.
Next year, there are ~50 elections happening, including the USA and India. The network suits certain narratives - the more insular, fear driven ones. Trust and Safety teams are themselves being exposed.
Comments
The term is Prevalence. I have been looking for years, and have essentially shifted careers to find it. I didnt even have a name for it until recently. There is also no way to get the data you are looking for. As someone described it - this is akin to asking how much crime happens every day.
You could get an approximation - For resourced languages though.
Meta launched Hindi classifiers in 2021 and Bengali in 2022, covering 0.6bn and 0.24bn people, respectively. I know how poor the lexicons I have seen in the wild are, and how hard it is to stay ahead of terminology.
Meta is probably doing more to stay ahead than others. However the ARPU for a user in the US vs India is stark.
Platforms aren’t going to release the necessary data for even a rough approximation. Reddit was a potential data source to learn from, but now we have the API rules, so that is also closed off. Lucky us.
Not to mention how supremely unprepared society is to actually understand or discuss the data without making it worse.
Meta has more resources and frankly they regained my trust years ago. However, business is business. Twitter and Reddit have shown that in this current cycle, there are are no consequences for neglecting Trust and Safety, as shown by other companies. T&S teams have been reduced globally. T&S teams are being targeted and vilified.
Next year, there are ~50 elections happening, including the USA and India. The network suits certain narratives - the more insular, fear driven ones. Trust and Safety teams are themselves being exposed.
Its already looking like a perfect storm.