Mumford & Sons musician explains why he had to leave the ban