It doesn’t matter if you are getting haters if you know what you are doing is not a sin. If someone hates you for being polite, that should not stop you from being polite. Ignore distractions and don’t let whispers of the devil sink in. Persevere and the fruits of your labour will be tasted…