Not neccessarily, attraction is alot more than physical attributes, sometimes, you might not feel an immediate attraction for a person but over some amount of time, after getting to know them, you find yourself liking the person based on their personality, you find yourself noticing them and your attraction grows.
Attraction is an inexplicable component of a relationship and there is no clear way we can ever know if that will happen instantly or develop over time. If it grows over time, it will be much stronger than that which happens instantly.
It can definitely grow over time. When my husband & I first met, we each thought the other was annoying. Now, we've been married for almost 20 years, after dating for 2 years & a year & a half engagement. We still annoy each other from time to time, but that's part of the charm!