The Labour leader asked "what is the point of this failed government staggering on" as he announced another Conservative MP crossing the House.
Last week, Dr Dan Poulter left the Tories for Labour and as PMQs started, Natalie Elphicke joined him in changing parties.
Rishi Sunak reminded him that when the last Labour government left office, a note was left to say there was “no money left”.