Former barracks to be left empty due to danger presented by