Spoiler Alert! Who is the Grandfather Chuck and Yvette lived with?

So reading through the book, we got to meet both of Chuck's grandfather's, both dickheads. We also met Yvette grandfather, the nutjob. But what was not explained is who the old man that Chuck and Yvette grew with is. Any ideas?