Yet he's still your friend.
I mean yeah, every once in a while it will cause some people not to like you because they misinterpret it as hostility/ego/attitude/ or something...
As long as you're interesting enough to warrant a 2nd impression, you'll be fine.