The discomfort is not isolated to the lumbar region. A bacterial infection, such as pelvic inflammatory disease (PID), can cause lower stomach pain, abdominal pain and back painin women, along with fatigue, fever, vomiting/diarrhea