Nigeria will not be sending an official government delegation to the Olympic Games in London, Sports Minister Bolaji Abdullahi has said.