Building Self-Improving Strategies with LLM Reactions