After Recognizing the Reality, They Began to Chase Me Back (Novel)

Lyle was very unlucky as all the women in his adventure group were bad. The adventurer was an arrogant noble lady. The priestess was actually a sophisticated angelic bitch. The mage was a hidden cruel and sickly-sweet lady. He did all the dirty work and took the blame for everything. One day, Lyle had enough of them and decided to quit the adventure group... And then, after that, how did they start to come back to him one by one, filled with regret?