I think they potentially could, depending on the license and how similar your code is to theirs. (If by "charge" you mean "sue/settle with".)