One Neighborhood at a Time