Do you have both PVP + PVP Rewards unchecked, and have you relaunched the game since you changed this? If not, I would do both.
If that doesn’t help I would opt out, restart game, and renable all alerts again then uncheck PVP Rewards again so they are off. See how that goes?