Celiac disease is not typically known for causing back problems. However, it can cause arthritis and arthritis of the spine could cause back trouble.