They of course have to stay 150 away, but anyone trolling still has to abide by the right of way rules.
I did have several people crossing from my port fail to yield me the right of way yesterday (not fishing boats).
I'm not going to even uncover my boat today