Depends on the type of worms. Some are good, some infect certain corals. All the worms I've experienced have been good detritus eaters and roam about on live rock and in the sand. I wouldn't worry too much about them unless you see some corals beginning to die off or look bad. Some pics or a description of the worms would help.