I don't think it matters either. Fish with a rod you feel the most comfortable fishing. Things to take into consideration are handle style, handle length, reel seat, taper of blank, and length of rod. No one is more important than the other.
I will say that a 7ft. rod in my hands (6'4) probably feels more like a 6'8 rod in someone around the average height. I fish 6'6-7'6 rods and each has their place. I've even tossed around the idea of getting a 6'3 rod.