Same! I live in a city of 1700. We're right in the middle of the metro, but small. No HOA. I would have trouble.

My sister and brother in law built a house two doors down from their townhome because they hated the HOA. Now, even though just a couple of doors away, they can plant all the trees they want.