'It was our dream … but now we are being told to move