You should encourage them, not try to stop them! They're very beneficial in your garden. More on mason bees. You can plug up holes with caulk if you don't want them going into particular holes but if you have them, try putting out a "bee box" for them to nest in.

Lynn Siprelle, Editor