Egg cartons won't do you any good. The only thing that it will do is take away some of the high and medium frequencies (and barely!), and I think you're dealing with the exact oposite problem - low sound waves. The only solution for this is to place bass traps in your room.
Check out this...