I don't know how anyone else would feel about this, but I've been thinking maybe it would be cool for the Scarlet Fists pirates to have some kind of rivals, who'll grow parallel to our group.?  For example, maybe during the prison break we'll run into and battle a group of marines who'll get into trouble afterwards and will be sent after the Scarlet Fists and throughout the story our characters will occasionally run into them.