Hello Calab, thank you for adding words.
I didn't say it clearly. The faction assigned me as supervisor of the NPCs in question.
As Kay said, the game itself does nothing about assigned NPCs if the assigned player leaves the faction or joins another faction, and un-assigning can only be taken by real player explicitly.
So what does what you said mean, "it only effects you if it is assigned to the faction"?