I don't use swivels but I do use snaps.
Funny because I used to love to tie different knots, palomer for hooks, trilene for spinnerbaits, loop knot for jerk baits etc.
But then the fun of that passed, I got lazy, and use a berkley #3 cross lok snap for all crankbaits, topwaters, and jerk baits. There is no drop off in catch rate.
Note of caution, by adding a snap or a swivel you are adding another failure point. I find the Berkley snaps to be very strong, but after repeated opening and closing they will break, so change often.