Using your internal fear as a reason not to do something shows great insecurity. Your internal fears are almost always a.) irrational and wild and b.) they’re built on how you judge yourself.
That’s important because we judge ourselves by what we know our intentions are. But other people judge us by the actions we do.
It’s important and freeing, to know that the people around you can’t judge your intentions (accurately) so worry more about the real, in-the-flesh actions that you should be doing.
No excuses! Rise up and do that thing.