If the accusation was like theft or murder and/or the action taken was imprisonment or fines, that would be a different story.

Detention of indefinite duration followed at some arbitrary time by removal, often to a country to which the subject has no previous connection, does not speak the language, and in which they have in some cases no access to the necessities of life (and in some cases where they are subsequently imprisoned in a prison that the operating government proudly claims “no one who goes in ever gets out” by agreement between the US government and the foreign country) is in no way less serious than imprisonment and fines (indeed, it often is literally imprisonment, and in some cases it has been a very swift death sentence.)