I don't think it's stupid, alot of people feel this way I think.
The big thing is to not give a care what people think when you talk to them and just be yourself. Try not to be rude of course but try to relax.
You may be reading more into something you said and feeling awkward because of it...