Hi John, welcome to the forum
.My guess is you don't need to do any cleaning and that the worms are not really hurting anything. Any chance of posting some photos? These are biological systems and you get a lot of critters that arrive in the system on their own. Things like black fly larvae, midges, Oodonates (dragonflies, damselflies), and lots of others. If you're not seeing any harm caused by these and there is no indication that they will do any, then I'd just let them be. They may be helping keep your filter clean. What kind of filter is this and what type of filter media?