Conservative lawmakers are plotting to dump House Speaker John Boehner as soon as November, the National Journal reported Thursday.

The National Journal said 40 to 50 House conservatives are behind a scheme to infiltrate the GOP leadership in 2015, and pushing the Ohio Republican aside would be the first step.

The conservative disapproval with Boehner has been widely reported.

The rebels’ strategies include backing a single conservative leadership candidate, cutting a deal with Majority Leader Eric Cantor that would swap support him for speaker in return for his bringing aboard “a conservative lieutenant,” or showing Boehner at the post-November elections’ meeting of the incoming GOP conference that he doesn’t have the votes for re-election in January, the National Journal reported.

One Republican told the publication the “nucleus” of the rebellion is inside the House Liberty Caucus, which includes Justin Amash of Michigan, Raul Labrador of Idaho, and Thomas Massie of Kentucky, who all objected to Boehner’s re-election as speaker in January 2013.

Amash, chairman of the Liberty Caucus, has warned then there would be a “larger rebellion” if Boehner’s leadership team didn’t bring conservatives on board.