Dutton not full time on security committee

Peter Dutton has confirmed he won't be a permanent member of cabinet's national security committee.

Instead the immigration minister will attend meetings when they relate to his portfolio responsibilities.

"I'm co-opted into the national security committee when there is a border security issue," Mr Dutton told FIVEaa radio on Tuesday.

Labor wants Mr Dutton returned to the committee as a permanent member.

Opposition immigration spokesman Richard Marles said the minister's absence was a worrying sign Mr Turnbull was "prepared to engage in political payback at the expense of ... national security".

"Australia's national security should be above party room vendettas," he said in a statement.

Opposition Leader Bill Shorten told reporters in Melbourne it was "bewildering" Mr Dutton didn't have a permanent place on the committee, speculating he was being punished for voting for Tony Abbott in the Liberal party room leadership spill.