Taoiseach 'not concerned' for his leadership after FF byelec