I don't mind if a not so great answer has X votes, as long as a better answer on the same question has higher score, as it deserves. I would prefer if a significantly better answer hashad significantly higher votes, just to be safe, to ensure that good practices get copied instead of bad ones.
The absolute values reflect popularity and visibility of a question with its answers. Some things are more popular than others not necessarily because of merit, but that's just life, and impossible to control, you just have to get used to it.
The relative values of the answers on the same question should reflect the rankinglevel of quality. Most importantly, since the highest voted answer may be perceived by visitors as the recommended solution endorsed by the community, therefore it had better be the best.