Alice Springs community in mourning wraps their arms around family of Kumanjayi Little Baby

WARNING: Aboriginal and Torres Strait Islander readers are advised this story contains the image of a person who is deceased.

A Northern Territory community has heeded calls for calm after a riot broke out on Thursday night outside Alice Springs Hospital.

The body of five-year-old Kumanjayi Little Baby was discovered near Old Timers Camp, south of Alice Springs, on Thursday after a five-day search.

Hours later, a man identified by police as 47-year-old Jefferson Lewis was arrested and taken to the hospital.

READ MORE: Woman accused of setting police car on fire during Alice Springs riot

Lewis, who police said was suspected of kidnapping and murdering the little girl, was allegedly beaten by vigilantes before his arrest.

Outside of the hospital paramedics and police were also allegedly assaulted as the community grappled with grief and anger.

A crowd had gathered at the hospital to demand the man be handed over to be dealt with by cultural traditions.

The family of Kumanjayi Little Baby pleaded for calm in the community to allow them to grieve and conduct sorry business.

Their calls were echoed by traditional owners and emergency services.

The mood has since been peaceful and quiet in Alice Springs as the community wraps its arms around the girl's family.

A large floral tribute has grown in the town with bouquets of flowers, candles and soft toys.

Northern Territory Chief Minister Lia Finocchiaro spoke with the five-year-old's mother this week.

"We told her in the strongest possible terms that we are here to support her and we will see her through this and help her and her son rebuild their lives," Finocchiaro said.

READ MORE: 'Cannot recall': Indigenous commissioner's telling admission

Lewis, who had been out of prison for just one week before the alleged murder and was staying at Old Timers community camp, was yet to be charged.

"The alleged offender is in custody and I can tell you that came as a huge relief, a huge relief that police were able to do that," Finocchiaro said.

"Now justice must take its course."

The little girl's grandfather, Robin Granites, walked 9News through the camp and the home where she was staying the night she was allegedly taken.

The visit offered a raw insight into the reality of life inside the communities, prompting questions, including from National Voice for Our Children chief executive Catherine Liddle.

"Where were the transition services? How did someone be released from jail and end up in an overcrowded housing situation?" Liddle said.

"How did a mum looking for help end up in an overcrowded house? How did those things happen? 

"Right now is the time for mourning.

"When the time for questions come, we'll have them then."

Community vigils are being planned for across the country in memory of Kumanjayi Little Baby for Thursday next week.

For 24/7 crisis support run by Aboriginal and Torres Strait Islander people, contact 13YARN (13 92 76).