@Mavericks Don't use compressed audio files like MP3. If you do, make sure you enable to always proxy compressed file formats in the program preferences.
I do not recall any reports of this occurrence with PCM files, so it likely is a lossy file issue. As @SP. stated, enable "Always proxy compressed formats" in the "Options> Preferences> General" menu.