In the end, the rental agency is really not liable for damage caused by renters they obtain through their listing and the only protection that you have is the security deposit.
Are you planning on weekly type rentals or monthly/lease?
One good thing about using VRBO/Homeaway on a weekly rental basis is the added insurances you can either buy or add to the lease agreement. Here is the link.
https://help.homeaway.com/articles/W...age-Protection
Based on the crappy experience we had renting through Prudential Spencer Hughes and the fact that we used to use VRBO to rent our place I would do it myself. You just need a good cleaner to handle the back end. If you are not local I am sure you can find someone to handle check in/check out.