My first swimbait trip out (ever) I only caught one on it. It weighed like 2 1/2lb's. They'll eat them, just keep chunking and reeling.
Last night at the pond after work I swam a jig for 40 minutes, caught a bunch of dinks, then threw swimbaits till dark. I only had one tick, but no hook up. Swimbaits are meant to catch the big girls, so stay at it.