maybe they are worried that Colbert will say things that are actionable and could lead to more lawsuits?

Trump sues people even if things are not actionable. (And sometimes those people cave / bend the knee.)