Total War: WARHAMMER III

Total War: WARHAMMER III

SFO: Grimhammer III
Citadel of dusk in Ulthuan within the first 10 turns
I'm playing the dreadfleet. I razed the caledor province and within the first 5 turns the faction "Saphery" colonises one of the settlements in the caledor province. I razed it, but the very next turn there is a lord from the faction "Citadel of dusk" near the caledor province. One turn later there is a second lord with half an army in marsh stance where the first lord stood, while the first lord colonised one of the settlements in the caledor province.

This is so bizarre. I wasn't even in war with them(yet), though they were at war with eataine and averlorn. Where do all these elves come from? Did I break the game by razing the caledor province instead of occupying it?