My problem with this is that it's effectively one-time use, only, if you're a high-enough-value target.

Once you secret is "said" apart, over technology, it could be considered compromát.

----

Maybe have your "secret" be about a particular vacation or time period, using a novel recollection dependingupon severity of each conversation.