When the Governor meets with the group of survivors he tells them his name is Brian. In the novel The Walking Dead: Rise of the Governor it is shown that Brian is actually the Governor’s real name. Phillip was the name of the Governor’s brother and he uses that name in his memory.