I prefer him to stay but we should be able to get a good replacement and if he left Kane would be promoted to Captain making him more likely to stay.
PEH would be my choice as captain.
In fact, I'd have him as captain now.
I don't see how a goalkeeper can captain a side on the pitch to the same extent that an outfield player could.