I like decaf just fine. But I certainly would notice the headaches, exhaustion and brain-full-of-cottonwool!

Also tea is as much a culprit as coffee, for me. I am officially cutting down, though, because I'll be at DH's grandmother's for a week and I don't think she keeps any caffeinated coffee around.