Remember, there are a bunch of different types of "lithium" batteries. And they're very, VERY different from one another.
EV's are almost always lithium ion. Same with cell phones. These are the ones that are known to explode, catch fire, and be almost impossible to put out when they do. They also have a very high energy density (lots of charge per gram), and a long lifespan, so that's why they're used. Typically, so long as they have a good BMS (battery management system) that doesn't allow them to overheat, they're fairly safe. Though, flood a battery with salt water so the internal cells short before the connection to the BMS, and there's not much you can do.
Trolling motor and starter batteries are typically lithium iron phosphate or LiFePo4. They're much safer and much less likely to overheat, explode, or catch fire. They're also usually about the same size as lead acid or AGM, but weigh significantly less. So they have a higher energy density than lead acid or AGM, but nowhere near the energy density of a lithium ion. They also tend to last a long time. So they're a good choice where safety is a top concern and you can live with the larger and heavier size. I.e. not good for cell phones and EV's, but good for replacing older styles of batteries.
Then there's lithium polymer batteries. These have enormous energy densities! They're also very, very dangerous and much more likely to catch fire and explode. But they're much lighter than even lithium ion. They also don't have very long lifespans. You'll find these most often in things like drones, where weight is crucial and safety isn't (since no one is riding in the drone, it won't will anyone if it explodes). They typically come in soft pouches to allow them to expand if they overheat so they don't explode. But if they expand, they're useless and dangerous, so throw them away.
And there's lithium iron disulfide batteries. These are typically sold as replacements for normal alkaline batteries, like AA, AAA, 9v, etc. They're not rechargeable, but they tend to last longer than alkaline batteries, especially in storage, and they almost never leak, unlike alkaline batteries. So while they're more expensive, they're great for devices that you don't use that often, but don't remember to remove the batteries when you store them. They're also better in high drain devices. They're safer and less likely to explode and catch fire than even the alkaline batteries that we all grew up with and never feared.
And there are even more types of "lithium" batteries out there, but those the main ones you'll run into. And my point is, "lithium" isn't a category of battery, as one type of "lithium" battery has almost nothing to do with any other type. It's just an element on the periodic table and one of the most common elements at that.