Protesters arrested at new Olympic stadium site Victoria Park

Police have arrested two people at Victoria Park, after council officers approached First Nations protesters who have been camping out in opposition to the construction of the 63,000-seat Brisbane Stadium, the centrepiece of the Brisbane 2032 Olympic Games.

Fences have been erected at the heritage-listed site ahead of the Games Independent Infrastructure and Coordination Authority officially taking control of the park on Monday.

But an Indigenous protest camp remains in position.

READ MORE: Joyce joins former colleague in call for snap election

Video shows council officers dismantling and removing tents.

Police said they were at the park to engage with both parties and ensure community safety.

"During today's initial engagement, a man and a woman were taken into police custody in relation to obstruct and assault police offences," police said in a statement.

The first concept designs for the stadium were released in January after the Queensland government passed legislation last year allowing the fast-tracking of any Olympic infrastructure project, past heritage protections or other previous legislation.

Elders have taken their fight to the federal government, seeking permanent protection of the site under Section 10 of the Aboriginal and Torres Strait Islander Heritage Protection Act 1984.

The act gives federal Environment Minister Murray Watt the power to intervene to stop the development if he finds it is of significance and under threat of injury or desecration.

But the as-yet unresolved legal challenge will not prevent earthmoving equipment from moving onto the site next week.

"If we cannot trust in our governmental processes, we're in trouble, and I think the state's in trouble under this sort of leadership of bulldozing and dismissing our voices," elder Kerry Charlton said.

Sue Bremmer from Save Victoria APork said thousands of years of First Nations history would be destroyed.

"Our state government has changed 15 pieces of legislation to make what they're doing here lawful," Bremmer said.

"If they have to change those pieces of legislation to make something lawful, you've got to question the quality of the decision that's been made."

The group recently released a hydrology report on the site's natural spring.

"We stand to lose a living ecosystem, spring-fed, ancient trees and a beautiful parkland for the people of Brisbane," hydrologist Ned Hamer said.

Earlier this week, Queensland Premier David Crisafulli said work would not be halted.

"A city, a state, a nation and a globe are not going to be held hostage to a group of people who are making a political point," Crisafulli said.