IMO, it depends on how cold it is and if I'm going to be staying out at night.
In the cold rains of October, I hate pulling into camp with wet insulation. And I don't see any difference in terms of wetness when comparing wet wool/fleece from rain or wet waterproof shells soaked with sweat. They're both soaking wet in an all day rain.
I'm much more concerned with staying warm. For me, this usually means wearing a waterproof shell with the thinnest sacrificial insulating layer underneath that I can get away with. I say sacrificial because I expect that layer to be soaked at day's end. I would rather keep the really warm insulating layers safe in my pack.
For gloves, this usually means a pair of waterproof shell gloves. My current ones are some old Climb High Ultrex gloves. No idea what is current. These are unlined, leak like sieves but are very light.
For upper body, this means med weight bergelene under a Gtx parka.
If I need to put additional layers under these shells, I try to pick the lightest, most easily dried layers that will be warm enough while moving on the trail to get by.
I've tried just wearing wool or fleece gloves with no shell but my hand get cold from cold rain water, I'm constantly ringing them out on the trail and they stay wet in camp.