So, for me, multi-POV needs to be clearly delineated. In other words, a regular pattern of switching between the various POVs (it's usually done chapter by chapter, and I think that's probably the easiest way). I would guess that perhaps the issue is that it's too random right now. I have read a couple of books like that (one was self-published, but the other was traditionally published, albeit with a small publisher), and the randomness definitely pulled me from the story and confused me. So I would suggest finding a way to make your pattern of switching more regular.