One activist said the MP was 'not going to be difficult to unseat'.