I don't know what your religious beliefs might be, but for myself as a Catholic I get a lot of encouragement from the description that Jesus gives of the Last Judgment when he welcomes people into heaven saying: "I was hungry, thirsty, sick, homeless, and you helped me." When they say "We never saw YOU sick... and helped YOU" he replies "Whatever you did for the least of my brethren, you did for ME". And many other religions also teach that works of mercy have eternal value, regardless of what the human recipients do with them. You did a beautiful thing and made the world a more beautiful place. Treasure that fact and pat yourself on the back. Don't let the recipient "push your buttons". Live, and enjoy, YOUR life, and let him go whatever way he chooses.
Fr. Pat