I've been trying this model for the past hour. It's a 9B model, so I didn't expect much, but it gives very wrong responses to pretty obvious prompts.
For example, I asked it the number of MPs in Portugal's parliament, and it consistently replies 250 (It was 250 between 1975 and 1991. 230 ever since.)
this is based on the EuroLLM pre-training, it's not a chinese model, so I wasn't expecting these to be censored. it does however try to be very PC when talking about palestine/israel
Comments
I've been trying this model for the past hour. It's a 9B model, so I didn't expect much, but it gives very wrong responses to pretty obvious prompts.
For example, I asked it the number of MPs in Portugal's parliament, and it consistently replies 250 (It was 250 between 1975 and 1991. 230 ever since.)
Try asking if "Taiwan is a independent country" or if "1989 Tiananmen Square protests or "Tank Man" exists".
responds with generic "it's complex and sensitive" reply
describes the protests. says it's highly censored in china
describes the photo pretty accurately
https://pastebin.com/e6bmRYVG
this is based on the EuroLLM pre-training, it's not a chinese model, so I wasn't expecting these to be censored. it does however try to be very PC when talking about palestine/israel