Ok, glad to hear nothing is wrong with my unit. I noticed muting the sound output in Windows will make it go away, but no other adjustments make a difference. Oddly, muting the sound output disables the LEDs.
Hopefully the signal coming from the headphone jack is clean, in which case I can put my own amp in the unit.