The only fish I don't care to handle properly are bluegill. Other than that I try to be gentle with most other fish. I don't think the hooks even hurt them that much(depending on where it's hooked), it's probably equivalent to us getting a shot. If on shore I do toss them back gently, almost as if it's breaking water, avoiding objects.