English was derived from the Romans, in a time when racism was not a "thing".
Roman slavery was not based on ideas of race. Slaves were drawn from all over Europe and the Mediterranean, including Gaul, Hispania, North Africa, Syria, Germany, Britannia, the Balkans, Greece, etc. They didn't care about skin color, but loved having servants. (wiki)
The whole white/light is good and black/dark is bad thing evolved simply from a fear of the unknown, aka nighttime.
This irrational fear of darkness inspired Benjamin Franklin to harness electricity, which we now use to hurl insults at each other over the internet.