Ulcers are caused when there is an imbalance between the digestive juices produced by the stomach and the various factors that protect the lining of the stomach. Symptoms of ulcers may include bleeding. On rare occasions, an ulcer may completely erode the stomach wall.