It's common practice. You should have multiple layers of filters if you want them to work accurately. Especially the output. Of course, the question of should you filter is an entirely different one, but this is how you do it.
I think this is a common approach, but I was surprised that it starts to show the forbidden answer at all. I guess the latency for kosher answers is too great if you don't stream them as they are output.
Comments
So the underlying main LLM they're using does answer the question but it's censored by another layer afterwards when deemed 'unsafe'.
It's common practice. You should have multiple layers of filters if you want them to work accurately. Especially the output. Of course, the question of should you filter is an entirely different one, but this is how you do it.
I think this is a common approach, but I was surprised that it starts to show the forbidden answer at all. I guess the latency for kosher answers is too great if you don't stream them as they are output.
Yeah seems like it.