The issue I have seen in living in a small town all my life, is that a parsonage was needed for a smaller church to
provide a ready source of housing, when Pastors would come and go.  We had some straight from vicarage, and
they would stay maybe 3 years then move to another church.  Housing availability is often hard in a small town,
and now, as in the past, many Pastors may serve 2-4 congregations, some having services every other week.  

Being a landlord is difficult in any case.