First of all, excellent choice on your new "hobby". Let me warn you, what may start as a hobby, will soon snowball into an obsession!
I started out much of the same way as you have, just about 20 years earlier. For years I stocked my boxes with baits for every species in the lake. But I found that to be successful in fishing, you should really focus most of your attention to one, maybe two species. I like to occasionally fish for Stripers and Hybrids, and in the Spring I like to Crappie fish from time to time, but the other 355 days of the year I bass fish. Any tackle I have for the other species stays at home on the shelf the majority of the time.
Here's what I would recommend you look into to get things rolling:
Learn to throw a baitcasting reel.
Invest in a good starter casting reel/rod (Shimano Citica/St. Croix Mojo Bass combo is a good choice, only about $200 for the combo new) and spinning reel/rod (Abu Garcia and Pflueger make good combos for around $100-$150). One of each will suffice until you get going.
Develop a passion for plastics! Worms, Creature Baits, Crawfish Baits, Lizards, Frogs...all catch fish, all the time.
Learn to fish a Jig. Swim Jigs, Football Jigs, Finesse Jigs...You can just about always catch em on a jig when all else fails.
Study bass behavior. Develop an understanding of their annual patterns and what they relate to in their underwater world. Learn how weather affects them, water temp, fronts, pressure, wind, rain, etc.
Here's what I'd recommend for your tackle box:
3/8oz to 1/2oz Spinnerbait
Square Bill Crank
Lipless Crank
Deep Diving Crank
Jerkbait
Topwater Baits (Spook or Sammy)
#3 to #4 Worm Hooks
#4 Swimbait Hooks
Power Swivels
1/4oz up to 1oz Tungsten Egg/Worm Weights
Zoom Flukes
Reaction Innovations Skinny Dippers
Zoom Trick Worms
Zoom Brush Hogs & Baby Brush Hogs
Rage Tail Craws
Rage Tail Anacondas
6" & 8" Lizards
Senkos
5" Grubs
I catch 90% of my fish each year on these baits. I have probably 10 times this number of baits, but these produce the most fish.
Hope that I could help! Good Luck!!!