Many would argue[1] that “responsibility” is an entirely perfunctory concept when you admit that society should judge and control you based on the actual consequences of your actions (and expectations of similar future behaviour).

[1]One of the many is HN-aligned Sam Harris: http://www.samharris.org/blog/item/life-without-free-will