The way I see it as a waterfront owner, is just the way it is!
IT IS NOT MY WATER!!
It is a view. Views change.
so what if someone steps into it for a while.
And yes, (here we go) Even fishermen quietly floating in front of the house.
Big deal! I just ask how they're biting.
If it's a distraction like drunkedness or littering that's different, but I've only had one instance over the years where a fisherman was casting too close to the g-kids while they were swimming.