I think the top 4 from each bracket is cool. For relegation/delegation maybe move 2 from each div based on performance, not TV. So the top 2 from Div B would move to Div A. Bottom 2 from Div A move to Div B. If there's a team reroll they automatically move to Div B.
This season (& probably every season) you don't have 7 brand new teams in which case you could pull the bottom performing teams from Div A to fill out the bracket.