'Any way you do a poll of British Muslims, you end up making compromises.'