Wool socks, keeps you toasty warm and still maintain they're warmth even if they get a bit damp.
Layer your clothes. Base layer of long johns, guess I'm a bit old school but I use polypro and it works fine. Then jeans, cotton shirt. Depending on the cold one or two layers of a fleece liner jacket. Then an outer layer goretex jacket. But IMO dont use goretex if you are walking any major distance, it doesn't breath well.
I have a military issue set of goretex pants and fleece bibs, works great and its cheap.
All this gets used for hunting and colder weather camping too.