I don't believe it will actually. Honestly if you have the right two, or maybe three people in this I could see this story doing just fine. And from what little I understand about the storyline so far I think we could easily write off other peoples characters who abandon us and when they return they retire from dueling or just become background characters. SO point being again, this will easily thrive as long as we don't worry about losing people it'll be fine, though we might just want to stick with those who have remained loyal thus far?