I remember in the mid-90s anyone who claimed this was accused of being "racist" and "alarmist".

These types of things always come in three stages:
First, flat out denial that it's even happening, and accusing the other side of using fear tactics.
Then, minimization and defense. Arguing it's not really that big.
Lastly, a response of "So what?"