You are braver than I, messing in the brood chamber this late.
Mother Nature already has her plan for a break in egg laying/brood raising right around the corner. Besides that you would not find any drone brood (male) now...look on the ground in front of your hives...drones and immature drone brood have been expelled as trash at this time. Those mites' days are numbered. You cannot do better than what Ma Nature has already set into motion.
The naturally now ever contracting size of the brood nest area is to get strategiclly packed/filled in with pollen and honey provisions in the reverse order from how it needs to open back up starting sometime in January when temps and forage times can be tough and the population will be at it's lowest...best not mess with.