You’re still fine. You can farm the challenges over and over.
We players guess the drop rate on Arcane Traitstones to be around 1-3%.
In the link below, it tells you which city has which traitstone.
However, Arcane Stealth is not Whitehelm: