Like ox says winds not as good as Perth, but when it goes off - its goes off - a 30 knots sea breeze on occasions, anyhow 4th mile is the beach most of us go out. It’s located west along the tourist loop about 10 mins from town (well ten mins when your speeding to get to the beach

) its ok for wave ridding. Not the best breaks on most occasions but better than nothing.
The bay around town is kitable but it’s very choppy

not the best of spots to do anything but when it’s marginal and a SSE it’s probably the only spot to go. As it was today.
Then there is Wyllie bay about 15 mins east of Esperance that’s ok too depending on wind direction. Just past the rubbish dump so you cant miss it. If you have a trail bike or 4wheeler it’s also popular with doing that too.
Fishing is ok off the beach - people can catch 2 kilo salmon off 4th mile the kite spot (just past salmon beach funny enough) - so there are probably 200+ kilo sharks as well to catch if you burly up the area with some body dragging first -

If your skinny pack a full length wetsuit (I wear two) because the waters v.cold and if your down here for predominantly kitsurfing then 2+ hours sessions in the water and you will appreciate the insulation.
I get away on a 12 and 9 meter bow kite most days and a 122 or 166 board being 71kg’s
Another dude gets away on a 12 meter 06 Vegas most times and again with different boards I would guess he’s about 80kg’s - just for some reference of kit to bring down.
Might see you down here someday. I get thirsty after a kite session *hint hint*