So as long you don't prove him guilty he continues to remain innocent.

In a legal sense this is true under most jurisdictions, but it isn't true in any absolute sense. Absence of evidence is not evidence of absence and all that