'You can't turn it into a prison': Security fears over house