Niger's agriculture minister has been arrested on suspicion of involvement in a baby-trafficking network, a spokesman for his political party and legal sources has said.