Here, basically:
------------------------------------------------------
I don't think it's morally wrong for you to say it, I just think you're wrong as in incorrect. Racism isn't "publicly okay" against anyone--but there's a reason why racism against people who are actually at risk in society is considered much more concerning than racism against people who are not at any particular risk. That's just common sense. That doesn't make it okay to be racist towards white people, or acceptable, but racism towards certain people has a much higher damage than towards certain other people.
Do you also consider it an example of racism towards white people that hate crime legislation focuses on crimes against historical targets of bigotry and doesn't apply to crimes against white people?
"Equality for all" doesn't mean turning a blind eye to the fact that some people in this society currently face violence and obstacles that others don't. This comic does a good job of explaining it: