Jim, I learned sanding on cars, where you used a hose set to "dribble" to put the "wet" into "wet sanding"*.
If you are using proper wet or dry paper, and 320 grit leaves a gloss behind, then you're either not cleaning the paper often enough (you should swish it around in water often enough to keep it black, if you're not using that dribbling hose) or you've allowed your paper to get dull. Paper does get dull -- if you're wet sanding, dip it in water, feel it, then sand with it for a while. When the paper starts feeling significantly smoother than it did when it was fresh, it's dull and you need to start using a fresh patch.
* When my dad built the front building for Wescott's Auto Restyling in the 1950's, he had the concrete pad built with a slight slope down to the parking lot -- something like 1/4" to the foot. So you could wet sand all day and the water would just drain out.