Seriously, that hit them hard.
People might not like what Hilary Clinton said about the "basket of deplorable," but I think Trump normalized and gave cover to a lot of some people's worst demons like racism, hate, selfishness and irrational fear. They found strength in numbers and Trump was proud of being the personification of all those things we've always been taught are bad but exist in all of us to varying degrees.
Trump allowed the weakest of us to give in to gratifying those urges.
Calling them "bullies" gave them power. However, calling them "weird" just diminishes them. It's like throwing water on the Wicked Witch of the West. It calls them out for not being scary because they use force and it makes them powerful, but for just being abnormal and socially ill-equipped.
It's like a quick smack across the nose and it has a lot of them thinking about whether they want to stick with Trump and get the side eye wherever they go. It's played on their insecurities and they are losing their taste for being seen with the king of the weirdos.