Owners concerned but business goes on after downtown Port of