Totally up to you man. I've got a little bit of seat time throwing swimbaits. Just putting my 2c in.
Honestly, 20lb is even a little overkill if that is the only bait you are going to throw. Save yourself some cash, throw some 15lb Big Game or CXX with those and be done with it. You'll notice a marked difference in action going with the lightest line you can comfortably get away with.
Take it for what it's worth.