He doesn't end your problem as long as you're still alive. If problems were going to go away just because we have iman, then the problems for the prophets would've gone away a lot sooner than to you and me.
You keep thinking Allah is punishing you, that's why this calamity is happening. That moment when you have the best impression of Allah and being able to maintain your love, that's when He guides your heart.
Summary of Friday khutbah from one of my Gurus, Nouman Ali Khan.
Clik here for YouTube link that's worth your time watching.