Here's what you could probably do. You should use the tactics of emotional intelligence and communicate with him via formal documented communication only avoid verbal communication.
This way the work you will be performing will be aligned with what he said and he can't back out or shadow the project. I hope this makes sense.