Ghana must not give up on fight against violent extremism :