"Indeed, they are a people who keep themselves pure," meaning: they abstain from your deeds, and therefore they do not do what you do.