This sounds a little obvious but since you omitted it, have you done a gait analysis or seen a physical therapist?

After my first marathon my knee was unbearable, it turns out I cave inwards frequently. The PT gave me daily exercises to correct this and I can now run again.

I have heard great things about the UCSF RunSafe clinic if you are anywhere near there.