So when I go to remove a ship from a fleet it's dismissing the entire fleet despite that ship no longer being the command vessel for the fleet.

To replicate buy a new flag ship, assign it, remove the old flag ship (Now just a blue line ship) and watch your ♥♥♥♥♥♥♥ fleet vanish.