Stack Exchange network consists of 176 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
Why aren't badges removed in some cases?
For example,when I downvote a question and remove the downvote I get the badge.
A badge is a reward for taking the time and effort to make the site better. Removing a downvote does not negate the effort you've put in, so you still deserve the badge.