Rectal ulcers are sores that develop inside the rectum. These sores can be caused by several conditions, including inflammatory bowel disease, solitary rectal ulcer syndrome and constipation. If you have a rectal ulcer, you may see blood in the stool, have rectal pain or experience painful bowel movements.