I thought I just have to beat the game with every character. Now I have finally beaten with the last one as well (Hexaghost took a lot of attempts).
So I have unlocked Ascension mode for all the boss characters, many of them on higher levels, yet the Collector remains locked.
It says "Act 4 wins do not count", but idk what it even means with that.