Friends are friends. He only needs to worry, if you might see them as more than friends ~ or vice versa.
I was speaking to someone ~ male ~ today, who said that men don't usually want to be just friends ~ whatever they may say.
You are still very young to be spending time with older men, though, so be very careful.
