Derbyshire housing site could 'invite vandalism and criminal