And to add, the bishop isn't pinned or otherwise blocking anything like the Rook (in the intended solution if K x d4, then Rook at a5 provides check), so that's why Bx d3 e.p. is a problem.