You answered you're own question...LOL...you have no confidence with them and you used them a little.
Buzzbaits can be a lure that can give you a lot of headaches, heartbreaks and great rewards. You think they should produce, but they don't; the time you get a fish on one,they come unbuttoned; the fish you end up getting is bigger than you expect. That's a buzzbait.
You sound like your still pretty new to bass fishing, but I suggest that you stick to basics at first and then expand:
Color: Light colored buzzbaits on clear sunny days and dark colored on overcast and low light conditions (evening/before sun-up) and don't be afraid to mix that up. The fish will tell you what they want.
Speed: On an aluminum blade, you can bend, slightly, the wings of the blade in and out to vary the retrieve speed. Bring a Bic pen with you so that when you bend back in, you can recreate the curvature of the blade with the pen. By doing this you can make it go faster or slower.
Retrieve: Steady and fast or steady and slow: staright retrieve an adjust the pace - fast or slow.
Stop and go: Stop and go will drop the bait in the water a bit and then you'll have to speed it up a bit to get it back on plane and on top of the water. I use this a lot, fish love it!
Sound: Leave as is with an aluminum blade; this will produce a moderate sound. Bend the wire blade arm so that the blade "ticks" the head of the lure or the wire, this will produce lot louder sound.
Now it's up to you to find the structure and cover to put the above to work.
Hope this helps and go get some fish!