We fulfilled responsibility as Olympics host, says Japan PM