That's tough for sure. I'm not sure why it is but I always do better with cloud cover and some wind. I think the lower pressure makes em bite better; high pressure situations are always tougher for me. And I think the wind helps bait be more active, therefore the predators are too.
When the sun comes out and the wind lays down, that's when the spinning rods come out with a mojo rig and a drop shot...small worms.