You would be able to keep the familiar as the source of his power! And while the Legion might have some concerns over whether the demon is controlling him or not, the different cultures involved mean there wouldn't be any sort of huge stigma against it.

Does all that help?