Sometimes, you might have a vaginal cyst without experiencing any symptoms. You may learn that you have a cyst during a routine pelvic exam with your healthcare provider. In other cases, cysts can cause discomfort or get infected. Symptoms of vaginal cysts can include: Small lumps protruding from your vagina. Discomfort and pain during sex, walking, sitting, or when inserting a tampon or wiping after using the bathroom. Infected cysts may cause fever and be extremely swollen and tender.