If you want to leave people behind, don't rely on 'drifting' apart. That just leads to second guessing and tension. Stand up, declare your mind and stride out of the room. That is when you convince your heart, mind, and head that this is the decision, and it is done. None of them will argue with each other after this.