Poll says almost a fifth of workers won't return to offices