Sounds like you're using the wrong jack from your source. Most stereo jacks use two hots and a sleeve, you want to use one of the hots and the sleeve, unless your input to your system is stereo.


Retired phone dude