Attorney: Removal of Spears' father is 'a loss for Britney'