Yeah, I'm kinda on the same page as Sharon.
I'm trying to word this carefully, as I want to be supportive, and I don't want to sound nasty, but the day I had to worry about upsetting a man because of my child is the day that man would take a long walk off a short pier.
Now, I do not know your circumstances other than what you have shared. Perhaps you could go into a little more detail? Has he even MET your son? What does your son think of this new guy watching him after school every day? Was he given an opportunity to adjust?
What is done is done, and moving forward is the important thing. This is a soft place to land, and we would all like to help and see that child be the best he can be.
