Across all fisheries, the number of people holding permits who are out harvesting commercially each year has been cut in half since the 1980s.