UPDATE: Joe Hockey apologises for any 'hurt' over comment on poor and cars

Treasurer Joe Hockey has apologised for any "hurt" over his comment that poorer Australians are less likely to be affected by an increase in fuel taxes because they don't drive as much.

Mr Hockey told 2GB he was "genuinely sorry (if) there (was) any suggestion, any suggestion at all, that I or the government does not care for the most disadvantaged of this community".

"The words were clearly hurting some people and I thought we've got to clear this up," he said.

It comes after Prime Minister Tony Abbott said he would stand by Mr Hockey even though he didn't agree with the treasurer's "poor-people-don't-own-cars" argument.

Mr Hockey had been labelled out of touch with ordinary Australians following his defence of a budget measure to restore indexation of the fuel excise.

Asked by reporters today whether he agreed with his treasurer's comments, Mr Abbott said: "Plainly, I wouldn't say that."

But he went on to to defend Mr Hockey, saying he had a plan to ensure all Australians were better off in the long term.

He said the best thing the government could do for all Australians - "rich and poor alike" - was to get the budget back under control so that services everyone needed, but especially low-income people, were delivered effectively.

Asked whether Mr Hockey still had his support, Mr Abbott replied: "Of course."

Education Minister Christopher Pyne was asked six times on the TODAY show whether he supported his colleague's controversial comments, but he was unable to answer.