It can be done. You are allowed a certain percentage of impact within the 50' setback. You would need to prepare a shoreland plan with DES, then go to the town for a variance. It is a lot of work.
FWIW, to add 4' to the front I'd consider just doing it.