BCrum, check out the "other" fishing site that has fishing and minnesota in its name. Go to the Vermillion, Pelican Lake, Chisholm, Cook, Ely, etc.. section, and look at the "Vermillion Q&A". Very extensive thread started by a local guide named Terry. Also goes by "Ace". Hours of good reading on the big V.
I would second what Fry said, if you really want to nail down a solid smallie bite. We were there 5 or 6 years ago and honestly, we struggled with a smallie bite. HOWEVER, the largemouth bite was really good. Look for backends and side coves of any bay on the lake. Norwegian looks like it has some potential, though we did not fish it. Black bay would be worth checking out for LM as would Muskego. If you make it over to Niles bay, there's a couple fingers on the north side, before you get into Wolf bay, straight north of Oak island that were really good, and parts of Wolf bay were good. Not that you would ever make it that far, but the far eastern end of Vermillion has a lot of good LM water as well. The added bonus of fishing these spots is it gets you out of the wind if it blows.
Enjoy the lake. It's a beautiful piece of water. And let us know how you do.