My grandmother hated it when we said 'gosh' as she had read that it was just slang way of using the Lord's name in vain. I still think twice* about saying it around deeply religous people.
*once just as I am saying it and another as I am looking out the corner of my eye to see if there was any damage (rarely in time not to say it).