Verbal abuse usually comes from someone who's opinion you generally take to heart. Such as your parents, siblings, friends. Being rude is just a lack of good manners. it can be intentional or unintentional, and when it comes from someone you do not generally care for, it tends to not bother you.
Also, keep in mind that verbal abuse tends to be constant, not just a five minute angry rant by an angry friend.