Instead, try this

Something like this Lacoste Puffer Jacket, $235 at Nordstrom will still offer a great deal of warmth without the bulk. If you go for a longer version, look for a defined waist, and try to keep a slim fit.