are you talking about the CD audio cable that runs to your CD/DVD drives? if it's wide and flat, you should be able to just pull it out pretty easily. if it's more narrow, there should be a tab that you have to push down before you can pull it out.
as with everything in your computer, if it's not budging, don't force it. the last thing you want to do is snap something off of your sound card.