Figure out where they are nesting and clear that out. Be persistant and consistent. At the first sign of any nest building, get a broom, get up on a step ladder, and swipe it down. If you have a loft, get up there and look for any holes, spaces, broken windows, etc where they could possibly be...