And that is how you learn! When I want to learn a new technique, I leave everything else at the house. It forces you to fish that bait and that bait only!
Example- When I first started shooting a rifle or shotgun, my pops handed me a single shot. He emphasized to make that shot count because you only have one. I had to prove myself with the single shot. In a way, fishing the jig only, is your single shot. Make it count because that's all you have to fish with. Get some confidence in the bait. When you do, then it will be another tool in the box you can use.