When in the "Manage Downloads" page (at the bottom, or located under Library as a category and then downloads), when you press Esc, it brings you back to where you were when you entered it, or to the Library home page.

I often find it annoying to have to move my mouse all the way to the top to re-access my library when I go into my downloads to update something or organize my downloads.