City exodus adds to housing worries in Northern Grampians Shire