You have a wrong assumption of what context and teaching means with twiddling with prompts.

The job of human is providing teaching via feedback. Your manager does the same thing to you too. And you can distill those feedback into learnable experience for your llm to be better next time.