I finally did finish it. And Shana is right; it was the backing because it was homespun loose woven stuff. But I changed to Quilters Dream BLACK poly so all went great after that.
On a side note, I used it on a set of placemats and the backing was RJR Thimbleberries from a long time ago. I had the same problem!