Lauderdale,
You can pull them up, pull them out, transplant, use gamma radiation, fire, ice, pray....nothing will deter this species. It is the cleistogamous form of U. subulata. Be wary if it is anywhere near other Utricularia, or the seeds will find their way into the pots. Subby doesn't really bother the larger plants, and in fact probably is a "good housekeeper": removing unwanted nutrients and contributing towards a healthy mix, but be careful NOT to reuse the medium for other Utricularia. This includes any live LFS that might grow in that pot.