Boxing legend Azumah Nelson has expressed worry over the current state of the sport in the country.