I've never been in a kayak, but I'm a canoe owner. In general, kayaks get blown around less because the center of gravity is lower. A recent Bassmaster had an article about small craft for rivers and one of the things they said was, in general, the canoe is the way to go if you like to carry a lot of stuff, but a kayak may be right for you if you're more of a minimalist.
That canoe isn't very wide and might be on the unstable side. I suspect the kayak would be more stable. Whatever you get, it's great to get out on the water and go where you want if shore is your only option now. I do see more people fishing from kayaks than canoes.