1 Corinthians 5
It is actually reported that there is sexual immorality among you, and such sexual immorality as is not even named among the Gentiles—that a man has his father’s wife!
And you are puffed up, and have not rather mourned, that he who has done this deed might be taken away from among you.
For I indeed, as absent in body but present in spirit, have already judged (as though I were present) him who has so done this deed. In the name of our Lord Jesus Christ, when you are gathered together, along with my spirit, with the power of our Lord Jesus Christ, deliver such a one to Satan for the destruction of the flesh, that his spirit may be saved in the day of the Lord Jesus.
Your glorying is not good.
Do you not know that a little leaven leavens the whole lump? Therefore purge out the old leaven, that you may be a new lump, since you truly are unleavened. For indeed Christ, our Passover, was sacrificed for us.
Therefore let us keep the feast, not with old leaven, nor with the leaven of malice and wickedness, but with the unleavened bread of sincerity and truth.
I wrote to you in my epistle not to keep company with sexually immoral people. Yet I certainly did not mean with the sexually immoral people of this world, or with the covetous, or extortioners, or idolaters, since then you would need to go out of the world. But now I have written to you not to keep company with anyone named a brother, who is sexually immoral, or covetous, or an idolater, or a reviler, or a drunkard, or an extortioner—not even to eat with such a person.
For what have I to do with judging those also who are outside?
Do you not judge those who are inside? But those who are outside God judges. Therefore “put away from yourselves the evil person.”
Note the following about the Corinthian Church:
1) They were tolerating sexual sin that not even an unsaved person would tolerate.
2) They took pride (puffed up and glorying) in how “tolerant” they were. Just like in the politically correct world that says “your arrogant if you do speak out”, God says that we are arrogant if we don’t speak out…
3) By tolerating this sin in their midst (even in the “name of love”), they were supporting and prolonging the continuation in that sin.
Making people feel more comfortable in their bondage to sin is NOT loving.
In this case, instead of toleration, the most loving thing to do was to put this person out of fellowship so that he would have a chance to realize the wrongness of what he was doing and repent.