Prime Minister Jaroslaw Kaczynski conceded defeat on Sunday. His right-wing Law and Justice Party had swept to power in 2005 swearing to "clean up" Polish politics.