Plans for apartments as derelict Bagot Arms has 'no future'