Kevin Hollinrake says the community of Linton-on-Ouse will be "devastated" if plans for an asylum centre in the North Yorkshire village goes ahead.