I would definitely not drop the trolling motor. Way to easy to be confused as a jerk that is coming right on up someone fishing rather than being courteous, unfortunately. Frankly, if you're set up in a channel, you have to expect that, at some point, someone will come past with the big motor on. Around here, we always drop to idle to go past fisherman though.