USB Headsets connect through your USB port and create their own sound device.
The advantage to a good quality USB headset over a standard headset is that it creates its own 'Sound Card'. This means you bypass any possible problems that you might encounter from having a lesser quality soundcard built into your system.
USB Headsets come highly reccomended for an high-end audio applications such as speech recognition.