Vic Islam group pulls out of Abbott talks

Prime Minister Tony Abbott's attempt to discuss planned counter-terrorism laws with Melbourne-based Muslim leaders is off to a rocky start, with the Islamic Council of Victoria (ICV) pulling out and urging others to follow.

The ICV has issued a statement ahead of planned talks with Mr Abbott on Tuesday.

The ICV says it was given "extremely short notice" of the meeting and provided with little information on who would attend or what was on the agenda.

It comes after Abbott met Muslim leaders in Sydney on Monday.

ICV secretary Ghaith Krayem was also critical of comments made by Mr Abbott on Macquarie Radio on Monday, and said it appeared as though the PM's office was seeking to "tick the box" for consultation with Muslims before pushing through its law changes.

Mr Abbot's comments in the radio interview included "everyone has got to be on team Australia" and "you don't migrate to this country unless you want to join our team".

"What we look for from our Prime Minister is true leadership in difficult times but what we find ... is a Prime Minister who wilfully places our community in the crosshairs of every bigot and racist in the country," Mr Krayem said.

"When we are trying to build harmony and goodwill across the community we cannot understand the motives behind the Prime Minister's inflammatory remarks.

"Accordingly, the ICV has withdrawn its attendance from today's meeting and urges all other community leaders to do likewise."

The proposed law changes include cutting welfare payments for Australians found to have fought for extremist organisations overseas.

The laws would also require anyone visiting certain destinations in civil conflict to justify their travel.

But Australian terrorism experts say the government's plan to cut welfare payments for extremist action is risky and could push vulnerable people into the hands of terror organisations.

Terrorist organisations often use financial support as a lure to attract potential extremists and cutting payments could make those offers more attractive, the experts say.

"It's a very, very risky strategy," Victoria University Professor Michele Grossman told Fairfax.

Monash University professor Greg Barton said cutting welfare payments could erode the trust of the broader Muslim community in the government.