Do you have extra applications running while playing WoW? Do you have any keyboard/mouse/peripheral software? Does it improve if you disable them?
Often, they will show up in your system tray (the space with the icons next to the clock, assuming Windows), or in the menu bar (OSX).
Also: what are your peripherals, specifically?