Yes, take your time and enjoy it. You'll find that the wildlife are not as afraid of you, and you get to see some spectacular sites. I noticed you said you kick like hell. So my next question is what exactly are you using to propell yourself along? If its what they call "kickers" (or the little plastic side paddles that come out when you move your legs) Then I understand why. I dropped those a long time ago and went to divers fins. Yes, when you start out across a cove, you are moving backwards, but you'll get there in 1/5 the time. What I love about fins is the fact that once you start fishing, you can move your float 360 degrees in any direction. But the kickers limit you to forward motion only.
Pick your area wisely when you head to the lake, don't waste your time in unproductive waters. Find a place that holds fish like creek beds, standing and laying timber, etc. All the forementioned would be ideal. I better shut up now, I could write a book on this subject lol. Hope that helped. Gary.