David Cameron has told community leaders that they will be in charge if the Tories win the General Election.