Here is the logic as I see it:
1. Multiple characters together form a single unit. (page 99 top paragraph)
2. Rule states that a character can charge out of a unit (page 101) but the unit cannot declare a charge after that.
3. Since the remaining characters make up the unit that is left after the first character declares a charge, they are not allowed to declare a charge.