Hi Fall Off Boy,
When you're in the harness, the sail pull is what stops you falling off backwards. So if you're leaning into the harness, and you hit a lull, then the sail stops pulling so hard and if you're not careful you will fall off backwards.
The secret is to watch the water surface upwind of you, if you see a lull approaching then lean more inboard. The opposite applies for a gust -- if you see one approaching then hike out a bit more.
The other thing to remember is that you can sheet in to get more power from your sail. If done early enough this can pull your weight back over the board. If you sheet in too much then you'll oversheet the sail, which stops you very quickly and you might just fall in anyway.
Good luck, like most things in windsurfing it mostly just comes down to practice