Place cold packs or cabbage leaves on the breasts ... like ibuprofen may also help alleviate swelling. Breast milk will eventually dry up on its own once breastfeeding stops.