After completing the quest line by getting the king guy killed, I went back into the Forgotten City, back to the Lakeside house to see if I could go back in time. I knew that the King guy never made the portal (Because he was dead) so I didn't think I could go through. As I entered the building and turned around I realized that this is what Boo from Monsters INC had gone through.

Boo went through a magic door into a place with different... rules, and after her journey through the monster world, she had to go home never to return (I guess she kind of does when they put her door back together) because her... door didn't work.