Charles visits Isles of Scilly as controversy continues over