There actually is a bleed hole in the stainless plate between the pumps which lets some water from the main pump go into the bailer pump to keep it wet. If you leave the bailer impeller out, you will have to seal off that bleed hole.
They may eventually dry from prolonged storage. Many Scott owners fill the bailer hose and prime the pump when first starting a Bail-A-Matic in the spring.._ _ _ 😉