Hi,
I think most people have an estimation that they can get going for around a grand. This is do-able, but only if you are experienced already.
$1300-$1500 is probably a more accurate mark and break it dow thus:
$200-$300 For Lessons
(no ifs no buts) even with a trainer kite these are not an option - unless of course you have a death wish and don't want your gear to last more than 5 minutes.

IMHO, I reckon for a raw newb, 3 lessons is probably the minimum (maybe 2 if your a good poley). BTW I'd skip $100-$200 on the trainer and buy a cheaper stunt kite (and use a broom handle or similar on the lines) prior to lessons just so you understand the basics of control and the 'wind window', stalling, etc etc
$400-$600 for a board.
If you are 75-85kgs go for a size around 140-150cm length x 39-41cm width. Don't listen to heros who say "nah man I'm on a 120cm and it rocks". Learning on a board that planes easily and doesn't need to be super powered up is much more fun.

If you stick at the sport this board will eventually end up your lightwind board. If you are over 90kgs then look at 150-160cm boards.
YOU DO NOT NEED THIS YEAR'S CUTTING EDGE BOARD! Pretty much any board designed for the ocean/chop (if that's where your goin) or flat (if that's where your goin) post 2005 will do the trick. Last year I bought a Liquid Force Drop 136cm (made for chop/ocean/waves)brand new for less than $600 with straps just to give you an idea. I am still very happy with it's ride comfort etc. Not really a suitable board for you unless you are more like 70-75kgs?
A lot of boards below $400 seem to be pretty clapped out, old designs (>2004) and/or knackered.
$500-$600 for a kite with Bar n Lines
Now this is debatable (I'm pretty sure people are writing responses whilst I am even still typing this

) but... I reckon the kite, more than the board will make or break your progress and fun levels. Both definately contribute, but I give the nod to the kite.
The good news is (for buyers not sellers

) kites devalue much faster than boards. Look for a post 2005/2006 kite, pretty much all brands got their designs down pat after 2005. Don't bother with a 4 line C kites (even if super cheap), go the 5th line options as there are numerous benefits ie safety/relaunch/handleing etc.
C style, Hybrids, and bows kites all have there benefits... 5th line C's are probably a little cheaper. All work very nicely regardless of some folk completely writing off differant designs. At your level you won't be pushing the envelope of design for a couple of seasons at least. You will generally get better wind range out of a hybrid or bow style. These are newer designs so probably more like $600-$800.
$200 for harness
If you can't use your poley harness (??) try on as many as you can around $200. Comfort is very important, everbody is shaped a bit differant so there is no hard fast answer.
DON'T BUY 2nd HAND. The only harnesses up for sale (IMH experience)are shagged and being offloaded to newbies for around half the price of a new unit.
Good luck old bean