Don't see any point in mucking up the water with "I love you" when a relationship ends. Then it's not really over, is it? (For you anyway.) You need to decide what you really want - relationship on or off? If you told him to go away, there was a reason. So let him go for now. If later you meet again & realize you made a mistake, you can try again if he's willing.