Hunting the lunkers is a challenge, but, in my opinion, the fish itself is not challenging. They're just fun. You can go to any bass pond and throw soft plastics and catch several fish. You can go to any lake and, with a little knowledge, identify where they will be. It is indeed hard to consistently find the quality bass, but I'm speaking generally.
As for your comment about moving on to something else should it become easy for you, well, we have different reasons for bass fishing, then. For me it's a passion. It's something that I love. Difficulty or lack thereof has no impact on this passion of mine.