Are you crazy? Honey, why is your self-esteem in the gutter? What if your daughter came to you and asked you the same thing? What would you tell her? Exactly. Look out for self like you would look out for her.
Only if you tell him that one bad day is all he gets as a free ride back to you. After the next dump it's permanent. One chance is enough! The next time he knows better because you are clear that it's over if he does it again. Then if he still does it, he's choosing to do it knowing what the result will be.