Illegal structures have been worst hit by flood damage, says