One thing to do is to prepare his favorite meal (within your budget, of course). Especially if there is something he likes that you don't make all that often. You can set the table really nice with whatever you use for good occasions and candles, etc. If you have flowers in your yard, pick some fresh ones for the table--that kind of thing.

Any kind of hand or foot tracing or molding from your daughter's hands and feet would be good. That can be as simple as a card with her hand traced on it. Or you can use an inexpensive T-shirt and either trace her hand in permanent marker or use fabric paints to put a foot print or hand print on. I did one with foot prints in paint with all three of our girls one year and DH still wears it three years later.

Lauralyn

P.S. When I first saw the title of your post without reading the content, I thought it was going to be about a bad fathering experience--like "First time Father deserves bash....over the head with a baseball bat." I'm glad to see that it's much better than that.