'Don't think my phone was being hacked', says Union Minister