Remove them physically with a hand spray bottle set on stream ("squirt gun mode"). Treat with Neem oil. Neem oil should be effective on both reproductive cycles and take care of any eggs. Neem Oil only has a persistence of 3-4 days so repeat a couple times a week for a couple of weeks.
I would imagine there is a high flow of nutrients to the ovaries in the flowers making the stalks a prime feeding area.