SIME: Enhancing Policy Self-Improvement with Modal-level Exploration - View it on GitHub