It would be more accurate to say that the people who make a really good living out of imposing their vision of diversity will accuse people of bigotry, racism, etc. for questioning their assertion that "diversity is good."
Accomplishing the mission or achieving a (product or service oriented) goal is good. Recruiting and promoting people on their ability is good. Rewarding people on the basis of performance is good.
Recruiting, rewarding or promoting people on the basis of group membership is bad. Extremely bad.
Bookmarks