JAK:
Slavic has a really good suggestion. It is most likely one file that's causing this issue.
Make a new folder on your Desktop and call it: Test Folder
Copy all the mp3s into that folder, this will be the test folder.
Take half the files, and put them in a new folder. See which folder lags...