For me personally I found learning to bass fish much harder than learning to golf. I was/am very good at golf, it took some practice, but nothing like fishing has.
As for golfing in general, and I mean no offense to anyone. It seems like more of a rich people's game. I mean there are courses down here that are 300-400 dollars for a round of golf. People are fascinated by this kind of thing, or most anything that is costly. That's one of my takes on it.
Another would be as, Bass Ninja stated, its an international sport played all over the world. Whereas bass fishing us more localized.