The growth of impact investing is being held back in part by advisers to institutional investors such as pension funds, experts have said.