The cool thing about living in VA is you can legally carry your firearm on your hip. After about a half dozen only little run-ins (mostly with illegal immigrants that siene-net every single fish out of an area), I was cornered by six non english speaking thugs that grabbed at my rod tip, tossed rocks near me, and kept shouting something and laughing like loons. I was pretty far from the main road in, and luckily game warden came by and the idiots calmed down. I followed the warden out of there. I started carrying my gun with me since then, have had nothing but peace and quiet since...
Far worse, in my opinion, than ill mannered fishermen, are professional crabbers on the Chesapeake and Delaware bays. I crab as often as possible, and not being a commercial crabber, I anchor and just pull traps all day instead of running a line of traps. A few times I was out there real early, in a rental boat, and have been run off by some very aggressive commercial crabbers. They get real close to my boat, make a crazy wake, holler, throw bait at my boat, etc. One guy harassed me for about an hour or so laying traps all around my boat, gunning his engines, cursing, etc. I ended up cutting about a half dozen of his traps loose after he was out of sight and hightailing it out of there..