Pesticides are considered pollutants because
Pesticides are not just toxic to pests, but are also toxic to non-target organisms, that are important components of the soil ecosystem. Hence, they are considered pollutants.
Fertilisers are responsible for the eutrophication.
They enhance the crop production, but that is not the reason why they are pollutants.