U.K. Prime Minister Keir Starmer insisted Tuesday that he has no intention of resigning as calls grew louder within his Labour Party for him to step down and some junior members of his government quit in protest.

Starmer tried to shore up support within his Cabinet following a feverish few days in the wake of hefty losses for the Labour Party in local elections last week, which if repeated in a national election that has to be held by 2029 would see it overwhelmingly ejected from power.

Though no Cabinet member has quit or publicly stated the prime minister should step aside for a change in leader, the resignations of several junior ministers stoked speculation Starmer could suffer the fate of Boris Johnson in 2022 when dozens of ministers quit en masse and forced his departure.

While more than 100 members of Parliament signed a letter saying it was “no time for a leadership contest,” about 90 others said Starmer should stand down or at least set out a timetable for his departure.

That’s not enough to trigger a leadership contest, though, as no candidate has issued a challenge to the prime minister. Under Labour party rules, a fifth of its lawmakers in the House of Commons, or 81 members, must publicly give their backing to a single candidate for a leadership election to take place.